2024-09-13T17:08:52.635 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:08:52.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:08:52.748 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap_schedule_snapdir} email: null first_in_suite: false job_id: '7903883' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 client snapdir: .customsnapfuse debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: snapdirname: .customsnapkernel syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:08:52.748 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:08:52.749 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:08:52.749 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:08:52.751 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:08:52.774 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:08:52.774 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:08:52.774 INFO:teuthology.packaging:ref: None 2024-09-13T17:08:52.775 INFO:teuthology.packaging:tag: None 2024-09-13T17:08:52.775 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:08:52.775 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:08:52.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:08:52.933 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:08:52.935 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:08:52.940 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:08:52.941 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:08:53.029 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:08:53.046 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:08:53.053 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:08:53.086 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:02:33.581005', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T17:08:53.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:02:33.582970', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T17:08:53.119 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:08:53.125 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T17:08:53.125 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T17:08:53.125 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:08:53.200 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0f5ddffbe0>, signals=[15]) 2024-09-13T17:08:53.201 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:08:53.207 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:08:53.207 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:08:53.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:53.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:08:53.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:08:53.405 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:08:53.411 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-13T17:08:53.417 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-13T17:08:53.417 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-13T17:08:53.464 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-09-13T17:08:53.464 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T17:08:53.464 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-09-13T17:08:53.464 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:08:53.465 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2024-09-13T17:08:53.466 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2024-09-13T17:08:53.466 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-13T17:08:53.501 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-13T17:08:53.508 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-13T17:08:53.508 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="20.04" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:08:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:08:53.556 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=focal 2024-09-13T17:08:53.556 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=focal 2024-09-13T17:08:53.557 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-13T17:08:53.585 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:08:53.593 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:08:53.633 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:08:53.633 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:08:53.636 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:08:53.641 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:08:53.647 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:08:53.647 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:08:53.649 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:08:53.706 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:08:53.782 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:08:53.799 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:08:53.799 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T17:08:53.799 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T17:08:53.800 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:08:53.800 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:08:53.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:53.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T17:08:53.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:53.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T17:08:53.986 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:08:53.986 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T17:08:53.987 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-13T17:08:53.994 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:08:53.994 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T17:08:53.994 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-13T17:08:53.995 INFO:teuthology.orchestra.run.smithi139.stdout:5.4.0-124-generic 2024-09-13T17:08:53.995 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:08:53.996 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T17:08:53.996 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-13T17:08:53.996 DEBUG:teuthology.orchestra.run.smithi139:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T17:08:54.002 INFO:teuthology.orchestra.run.smithi176.stdout:5.4.0-124-generic 2024-09-13T17:08:54.002 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:08:54.002 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T17:08:54.003 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-13T17:08:54.003 DEBUG:teuthology.orchestra.run.smithi176:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T17:08:54.058 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T17:08:54.058 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T17:08:54.174 INFO:teuthology.orchestra.run.smithi139.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T17:08:54.174 INFO:teuthology.orchestra.run.smithi176.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T17:08:54.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T17:08:54.176 DEBUG:teuthology.orchestra.run.smithi139:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T17:08:54.205 DEBUG:teuthology.orchestra.run.smithi176:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T17:08:54.206 DEBUG:teuthology.orchestra.run.smithi139:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T17:08:54.219 DEBUG:teuthology.orchestra.run.smithi176:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T17:08:54.222 DEBUG:teuthology.orchestra.run.smithi139:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T17:09:35.109 INFO:teuthology.orchestra.run.smithi139.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T17:09:35.110 INFO:teuthology.orchestra.run.smithi139.stderr: * [new branch] main -> origin/main 2024-09-13T17:09:35.168 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T17:09:35.168 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T17:09:35.168 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T17:09:35.169 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T17:09:35.171 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T17:09:35.175 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T17:09:35.176 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T17:09:35.177 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T17:09:35.178 INFO:teuthology.orchestra.run.smithi139.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T17:09:38.969 INFO:teuthology.orchestra.run.smithi176.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T17:09:38.969 INFO:teuthology.orchestra.run.smithi176.stderr: * [new branch] main -> origin/main 2024-09-13T17:09:39.022 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T17:09:39.022 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T17:09:39.023 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T17:09:39.025 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T17:09:39.026 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T17:09:39.026 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T17:09:39.026 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T17:09:39.026 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T17:09:39.029 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T17:09:39.029 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T17:09:39.029 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T17:09:39.029 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T17:09:39.030 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T17:09:39.031 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T17:09:39.032 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T17:09:39.032 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T17:09:39.032 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T17:09:39.032 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T17:09:39.032 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T17:09:39.719 INFO:teuthology.orchestra.run.smithi139.stderr:Updating files: 44% (1560/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2081/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2440/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2908/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T17:09:39.724 INFO:teuthology.orchestra.run.smithi139.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T17:09:39.742 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:09:39.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:09:39.895 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:09:39.896 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T17:09:39.899 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi139.front.sepia.ceph.com to complete... 2024-09-13T17:09:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13 17:09:41 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T17:09:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:FINISHED --2024-09-13 17:09:41-- 2024-09-13T17:09:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:Total wall clock time: 1.0s 2024-09-13T17:09:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:Downloaded: 1 files, 43M in 0.8s (50.9 MB/s) 2024-09-13T17:09:40.962 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:09:40.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T17:09:41.276 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T17:09:43.068 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T17:09:43.073 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T17:09:43.242 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:09:43.585 INFO:teuthology.orchestra.run.smithi176.stderr:Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2081/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2439/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2906/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T17:09:43.590 INFO:teuthology.orchestra.run.smithi176.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T17:09:43.608 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T17:09:43.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:09:43.763 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:09:43.764 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T17:09:43.766 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi176.front.sepia.ceph.com to complete... 2024-09-13T17:09:44.790 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13 17:09:45 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T17:09:44.790 INFO:teuthology.orchestra.run.smithi176.stderr:FINISHED --2024-09-13 17:09:45-- 2024-09-13T17:09:44.790 INFO:teuthology.orchestra.run.smithi176.stderr:Total wall clock time: 1.0s 2024-09-13T17:09:44.791 INFO:teuthology.orchestra.run.smithi176.stderr:Downloaded: 1 files, 43M in 0.8s (50.9 MB/s) 2024-09-13T17:09:44.793 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T17:09:44.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T17:09:45.061 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T17:09:46.801 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:09:46.802 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T17:09:46.807 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T17:09:46.908 INFO:teuthology.orchestra.run.smithi139.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:09:46.909 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:09:50.152 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:09:50.276 INFO:teuthology.orchestra.run.smithi176.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:14.919 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:10:14.925 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:10:14.953 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-13T17:10:15.304 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:15.330 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:15.726 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:10:15.739 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:10:17.500 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-13T17:10:17.713 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T17:10:17.723 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T17:10:17.723 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T17:10:17.723 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:17.746 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:17.746 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T17:10:17.773 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T17:10:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T17:10:17.775 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T17:10:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T17:10:17.777 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T17:10:17.797 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T17:10:17.797 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T17:10:17.797 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T17:10:17.797 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T17:10:17.798 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T17:10:17.799 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T17:10:17.800 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T17:10:17.801 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T17:10:17.802 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T17:10:17.803 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T17:10:17.804 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T17:10:17.805 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T17:10:17.806 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T17:10:17.807 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T17:10:17.808 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T17:10:17.809 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T17:10:17.810 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T17:10:17.811 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T17:10:17.812 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T17:10:17.813 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T17:10:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T17:10:17.815 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T17:10:17.815 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T17:10:17.815 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T17:10:17.815 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T17:10:17.815 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T17:10:17.827 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:10:17.840 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:10:17.868 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-13T17:10:17.873 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T17:10:17.873 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T17:10:17.873 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T17:10:17.873 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T17:10:17.874 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T17:10:17.875 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T17:10:17.876 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T17:10:17.876 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T17:10:17.877 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T17:10:17.878 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T17:10:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T17:10:17.880 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T17:10:17.881 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T17:10:17.882 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T17:10:17.883 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T17:10:17.884 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T17:10:17.885 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T17:10:17.886 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T17:10:17.887 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T17:10:17.888 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T17:10:17.889 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T17:10:17.890 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T17:10:17.891 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T17:10:17.892 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T17:10:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T17:10:17.894 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T17:10:17.895 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T17:10:17.896 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T17:10:17.897 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T17:10:17.898 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T17:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T17:10:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T17:10:17.901 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T17:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T17:10:17.903 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T17:10:17.904 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T17:10:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T17:10:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T17:10:17.907 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T17:10:17.908 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T17:10:17.909 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T17:10:17.910 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T17:10:17.911 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T17:10:17.912 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T17:10:17.913 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T17:10:17.914 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T17:10:17.915 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T17:10:17.916 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T17:10:17.917 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T17:10:17.918 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T17:10:17.919 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T17:10:17.920 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T17:10:17.921 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T17:10:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T17:10:17.923 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T17:10:17.924 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T17:10:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T17:10:17.926 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T17:10:17.927 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T17:10:17.928 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T17:10:17.929 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T17:10:17.930 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T17:10:17.931 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T17:10:17.932 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T17:10:17.990 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T17:10:17.991 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T17:10:17.992 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T17:10:17.993 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T17:10:17.994 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T17:10:17.995 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T17:10:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T17:10:17.997 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T17:10:17.998 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T17:10:17.999 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T17:10:18.000 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T17:10:18.001 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T17:10:18.002 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T17:10:18.003 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T17:10:18.004 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T17:10:18.005 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T17:10:18.006 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T17:10:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T17:10:18.008 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T17:10:18.009 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T17:10:18.010 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T17:10:18.011 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T17:10:18.012 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T17:10:18.013 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T17:10:18.014 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T17:10:18.015 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T17:10:18.016 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T17:10:18.017 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T17:10:18.018 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T17:10:18.019 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T17:10:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T17:10:18.021 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T17:10:18.022 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T17:10:18.022 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T17:10:18.022 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T17:10:18.022 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T17:10:18.022 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T17:10:18.022 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T17:10:18.023 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T17:10:18.023 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T17:10:18.023 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T17:10:18.023 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T17:10:18.024 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T17:10:18.025 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T17:10:18.026 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T17:10:18.027 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T17:10:18.028 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T17:10:18.029 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T17:10:18.030 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T17:10:18.031 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T17:10:18.032 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T17:10:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T17:10:18.034 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T17:10:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T17:10:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T17:10:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T17:10:18.038 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T17:10:18.039 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T17:10:18.040 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T17:10:18.041 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T17:10:18.042 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T17:10:18.043 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T17:10:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T17:10:18.045 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T17:10:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T17:10:18.047 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T17:10:18.048 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T17:10:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T17:10:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T17:10:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T17:10:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T17:10:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T17:10:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T17:10:18.055 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T17:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T17:10:18.057 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T17:10:18.057 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T17:10:18.057 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T17:10:18.057 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T17:10:18.095 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T17:10:18.096 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T17:10:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T17:10:18.098 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T17:10:18.099 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T17:10:18.100 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T17:10:18.101 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T17:10:18.102 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T17:10:18.103 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T17:10:18.104 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T17:10:18.105 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T17:10:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T17:10:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T17:10:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T17:10:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T17:10:18.110 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T17:10:18.111 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T17:10:18.112 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T17:10:18.113 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T17:10:18.114 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T17:10:18.115 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T17:10:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T17:10:18.117 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T17:10:18.118 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T17:10:18.119 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T17:10:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T17:10:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T17:10:18.122 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T17:10:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T17:10:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T17:10:18.126 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T17:10:18.127 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T17:10:18.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T17:10:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T17:10:18.133 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T17:10:18.134 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T17:10:18.135 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T17:10:18.136 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T17:10:18.137 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T17:10:18.138 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T17:10:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T17:10:18.140 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T17:10:18.141 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T17:10:18.142 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T17:10:18.143 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T17:10:18.144 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T17:10:18.144 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T17:10:18.144 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T17:10:18.144 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T17:10:18.144 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T17:10:18.146 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T17:10:18.147 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T17:10:18.148 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T17:10:18.149 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T17:10:18.155 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:18.155 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:18.155 DEBUG:teuthology.orchestra.run.smithi139:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T17:10:18.198 INFO:teuthology.orchestra.run.smithi139.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T17:10:18.198 INFO:teuthology.orchestra.run.smithi139.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T17:10:18.198 INFO:teuthology.orchestra.run.smithi139.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T17:10:18.199 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T17:10:18.199 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:18.199 DEBUG:teuthology.orchestra.run.smithi139:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T17:10:18.201 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi139.front.sepia.ceph.com to complete... 2024-09-13T17:10:18.240 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:18.260 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:18.640 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:10:18.651 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:10:18.887 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:10:18.894 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:10:18.910 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-13T17:10:19.198 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:19.209 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:19.611 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:10:19.622 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:10:20.400 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-13T17:10:20.794 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-13T17:10:20.947 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T17:10:20.957 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T17:10:20.957 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T17:10:20.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:20.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:20.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:21.002 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T17:10:21.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T17:10:21.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T17:10:21.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T17:10:21.006 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T17:10:21.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T17:10:21.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T17:10:21.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T17:10:21.024 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T17:10:21.025 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T17:10:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T17:10:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T17:10:21.028 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T17:10:21.029 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T17:10:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T17:10:21.031 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T17:10:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T17:10:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T17:10:21.034 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T17:10:21.035 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T17:10:21.036 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T17:10:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T17:10:21.097 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T17:10:21.098 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T17:10:21.099 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T17:10:21.100 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T17:10:21.101 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T17:10:21.102 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T17:10:21.103 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T17:10:21.104 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T17:10:21.105 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T17:10:21.106 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T17:10:21.107 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T17:10:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T17:10:21.109 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T17:10:21.110 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T17:10:21.111 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T17:10:21.112 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T17:10:21.113 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T17:10:21.114 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T17:10:21.115 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T17:10:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T17:10:21.117 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T17:10:21.118 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T17:10:21.119 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T17:10:21.120 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T17:10:21.121 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T17:10:21.122 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T17:10:21.123 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T17:10:21.124 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T17:10:21.125 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T17:10:21.126 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T17:10:21.127 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T17:10:21.128 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T17:10:21.129 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T17:10:21.130 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T17:10:21.131 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T17:10:21.132 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T17:10:21.133 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T17:10:21.134 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T17:10:21.135 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T17:10:21.136 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T17:10:21.137 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T17:10:21.138 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T17:10:21.139 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T17:10:21.140 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T17:10:21.141 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T17:10:21.142 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T17:10:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T17:10:21.144 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T17:10:21.145 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T17:10:21.146 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T17:10:21.147 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T17:10:21.148 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T17:10:21.149 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T17:10:21.150 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T17:10:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T17:10:21.152 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T17:10:21.225 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T17:10:21.225 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T17:10:21.225 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T17:10:21.225 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T17:10:21.225 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T17:10:21.226 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T17:10:21.227 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T17:10:21.228 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T17:10:21.229 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T17:10:21.230 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T17:10:21.231 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T17:10:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T17:10:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T17:10:21.234 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T17:10:21.235 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T17:10:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T17:10:21.237 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T17:10:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T17:10:21.239 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T17:10:21.240 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T17:10:21.241 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T17:10:21.242 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T17:10:21.243 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T17:10:21.244 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T17:10:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T17:10:21.246 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T17:10:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T17:10:21.248 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T17:10:21.249 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T17:10:21.250 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T17:10:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T17:10:21.252 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T17:10:21.253 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T17:10:21.254 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T17:10:21.255 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T17:10:21.256 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T17:10:21.257 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T17:10:21.258 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T17:10:21.259 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T17:10:21.260 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T17:10:21.261 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T17:10:21.262 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T17:10:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T17:10:21.264 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T17:10:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T17:10:21.266 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T17:10:21.267 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T17:10:21.268 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T17:10:21.269 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T17:10:21.270 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T17:10:21.271 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T17:10:21.272 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T17:10:21.273 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T17:10:21.274 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T17:10:21.275 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T17:10:21.276 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T17:10:21.277 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T17:10:21.278 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T17:10:21.279 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T17:10:21.280 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T17:10:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T17:10:21.282 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T17:10:21.283 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T17:10:21.284 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T17:10:21.285 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T17:10:21.286 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T17:10:21.287 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T17:10:21.288 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T17:10:21.289 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T17:10:21.290 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T17:10:21.291 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T17:10:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T17:10:21.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T17:10:21.294 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T17:10:21.295 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T17:10:21.349 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T17:10:21.349 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T17:10:21.350 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T17:10:21.351 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T17:10:21.352 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T17:10:21.353 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T17:10:21.354 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T17:10:21.355 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T17:10:21.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T17:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T17:10:21.358 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T17:10:21.359 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T17:10:21.360 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T17:10:21.361 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T17:10:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T17:10:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T17:10:21.364 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T17:10:21.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T17:10:21.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T17:10:21.367 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T17:10:21.368 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T17:10:21.369 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T17:10:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T17:10:21.371 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T17:10:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T17:10:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T17:10:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T17:10:21.375 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T17:10:21.376 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T17:10:21.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T17:10:21.378 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T17:10:21.379 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T17:10:21.380 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T17:10:21.381 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T17:10:21.382 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T17:10:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T17:10:21.384 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T17:10:21.385 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T17:10:21.386 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T17:10:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T17:10:21.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T17:10:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T17:10:21.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T17:10:21.391 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T17:10:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T17:10:21.393 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T17:10:21.394 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T17:10:21.395 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T17:10:21.396 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T17:10:21.397 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T17:10:21.398 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T17:10:21.399 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T17:10:21.400 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T17:10:21.405 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:21.405 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:21.405 DEBUG:teuthology.orchestra.run.smithi176:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T17:10:21.413 INFO:teuthology.orchestra.run.smithi176.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T17:10:21.413 INFO:teuthology.orchestra.run.smithi176.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T17:10:21.414 INFO:teuthology.orchestra.run.smithi176.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T17:10:21.414 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T17:10:21.414 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:21.414 DEBUG:teuthology.orchestra.run.smithi176:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T17:10:21.457 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi176.front.sepia.ceph.com to complete... 2024-09-13T17:10:22.001 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:10:22.002 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:10:22.014 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-13T17:10:22.249 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:22.260 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:10:22.600 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:10:22.612 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:10:23.616 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-13T17:10:51.537 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T17:10:51.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:10:51.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:10:54.727 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T17:10:54.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:10:54.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:11:09.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T17:11:13.213 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-13T17:11:18.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:11:18.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:11:21.981 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T17:11:22.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:11:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:11:25.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-13T17:11:33.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:11:33.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:11:37.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:11:37.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:11:52.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T17:11:55.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-13T17:12:07.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:12:07.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:12:07.653 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T17:12:08.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:12:08.400 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T17:12:08.400 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-13T17:12:08.459 INFO:teuthology.orchestra.run.smithi139.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:12:08.460 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:12:08.460 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:12:08.460 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:12:09.461 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:10.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:12:10.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:12:10.961 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-13T17:12:11.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:12:11.684 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T17:12:11.684 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-13T17:12:11.745 INFO:teuthology.orchestra.run.smithi176.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:12:11.745 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:12:11.745 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:12:11.745 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:12:12.748 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:12.748 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:12:12.755 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:12:12.755 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:12:12.761 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:12:12.780 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:12:12.787 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:12:12.796 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:12:12.796 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:12:12.822 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:12:12.855 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:12:12.862 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:12:12.862 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:12:12.893 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:12:12.982 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:12:13.005 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:12:13.011 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:12:13.033 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:12:13.037 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:12:13.044 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:12:13.044 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:12:13.049 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:12:13.090 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:12:13.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:12:13.130 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:12:13.137 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:12:13.154 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:12:13.205 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:12:13.265 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:12:13.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:12:13.369 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:12:13.389 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:12:13.452 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:12:13.452 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:12:13.544 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-13T17:12:13.550 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-13T17:12:13.721 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:12:13.728 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:12:13.728 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:12:13.740 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:12:13.750 DEBUG:teuthology.task.selinux:Excluding smithi139: OS 'ubuntu' does not support SELinux 2024-09-13T17:12:13.750 DEBUG:teuthology.task.selinux:Excluding smithi176: OS 'ubuntu' does not support SELinux 2024-09-13T17:12:13.750 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:12:13.750 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T17:12:13.750 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:12:13.750 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:12:13.758 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:12:13.769 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:12:13.770 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi139.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:19:34.269 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-13T17:19:34.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:19:34.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:19:34.391 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T17:19:34.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T17:19:34.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:19:34.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:19:34.736 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-13T17:19:34.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-13T17:19:34.961 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:19:34.971 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:19:34.971 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:19:34.972 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:19:34.978 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:19:34.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:19:35.045 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T17:19:35.045 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Command line: ntpd -gq 2024-09-13T17:19:35.046 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: proto: precision = 0.072 usec (-24) 2024-09-13T17:19:35.047 INFO:teuthology.orchestra.run.smithi139.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:19:35.047 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:19:35.047 INFO:teuthology.orchestra.run.smithi139.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:19:35.048 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:19:35.048 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:19:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:19:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:19:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listen normally on 3 enp3s0f1 172.21.15.139:123 2024-09-13T17:19:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listen normally on 4 lo [::1]:123 2024-09-13T17:19:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f59%5]:123 2024-09-13T17:19:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:35 ntpd[13629]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:19:35.081 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T17:19:35.081 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Command line: ntpd -gq 2024-09-13T17:19:35.084 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: proto: precision = 0.108 usec (-23) 2024-09-13T17:19:35.084 INFO:teuthology.orchestra.run.smithi176.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:19:35.085 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:19:35.085 INFO:teuthology.orchestra.run.smithi176.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listen normally on 3 enp3s0f1 172.21.15.176:123 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listen normally on 4 lo [::1]:123 2024-09-13T17:19:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f61%5]:123 2024-09-13T17:19:35.087 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:35 ntpd[13607]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:19:36.045 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:36 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:36.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:36 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:36.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:36 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:36.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:36 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:36.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:36 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:36.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:36 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:36.082 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:36.082 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:36.082 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:36.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:36.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:36.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:36.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:36.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:36 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:37.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:37 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:37.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:37 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:37.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:37 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:37.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:37 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:37.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:37 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:37.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:37 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:38.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:38 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:38.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:38 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:38.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:38 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:38.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:38 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:38.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:38 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:38.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:38 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:38.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:38 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:38.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:38 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:38.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:38 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:38.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:38 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:38.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:38 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:38.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:38 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:39.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:39.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:39.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:39.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:39.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:39.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:39.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:39.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:39 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:40.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:40.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:40 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:40.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:40.085 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:40 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:41.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:41 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:41.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:41 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:41.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:41 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:41.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:41 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:41.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:41 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:41.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:41 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:42.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.046 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:42.047 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:42.048 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 17:19:42 ntpd[13629]: ntpd: time slew +0.000311 s 2024-09-13T17:19:42.048 INFO:teuthology.orchestra.run.smithi139.stdout:ntpd: time slew +0.000311s 2024-09-13T17:19:42.048 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:19:42.048 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 17:19:42 ntpd[13629]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:19:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.084 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.087 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.087 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.087 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:42.088 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:42.088 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:19:42.088 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:19:42.088 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:19:42.088 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:19:42.089 INFO:teuthology.orchestra.run.smithi176.stdout:13 Sep 17:19:42 ntpd[13607]: ntpd: time slew -0.000324 s 2024-09-13T17:19:42.089 INFO:teuthology.orchestra.run.smithi176.stdout:ntpd: time slew -0.000324s 2024-09-13T17:19:42.090 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:19:42.091 INFO:teuthology.orchestra.run.smithi176.stderr:13 Sep 17:19:42 ntpd[13607]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:19:42.192 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:19:42.192 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-13T17:19:42.192 INFO:teuthology.orchestra.run.smithi139.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.192 INFO:teuthology.orchestra.run.smithi139.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.192 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.193 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.216 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:19:42.216 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-09-13T17:19:42.216 INFO:teuthology.orchestra.run.smithi176.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.216 INFO:teuthology.orchestra.run.smithi176.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.216 INFO:teuthology.orchestra.run.smithi176.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.216 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:19:42.218 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:19:42.226 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:19:42.227 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:19:42.227 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:19:42.227 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:19:42.232 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:19:42.233 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:19:42.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-key list | grep Ceph 2024-09-13T17:19:42.233 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-key list | grep Ceph 2024-09-13T17:19:42.460 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T17:19:42.461 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T17:19:42.597 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:19:42.597 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:19:42.599 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:19:42.599 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:19:42.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:19:42.613 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:19:42.613 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:19:42.613 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:19:42.613 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:19:42.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:19:42.754 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T17:19:42.755 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:19:42.770 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T17:19:42.770 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:19:42.880 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:19:42.880 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:19:42.887 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:19:42.887 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:19:42.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-09-13T17:19:42.919 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T17:19:43.199 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T17:19:43.200 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:19:43.200 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T17:19:43.200 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T17:19:43.210 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T17:19:43.240 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T17:19:43.245 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T17:19:43.262 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T17:19:43.267 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T17:19:43.286 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T17:19:43.291 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T17:19:43.297 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:19:43.307 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T17:19:43.313 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T17:19:43.348 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T17:19:43.351 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T17:19:43.379 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T17:19:43.461 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T17:19:44.539 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 28.7 kB in 1s (22.5 kB/s) 2024-09-13T17:19:44.583 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 28.7 kB in 1s (21.7 kB/s) 2024-09-13T17:19:45.848 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T17:19:45.887 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-13T17:19:45.891 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T17:19:45.932 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T17:19:46.022 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T17:19:46.057 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-13T17:19:46.240 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T17:19:46.241 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T17:19:46.275 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-09-13T17:19:46.446 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T17:19:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T17:19:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:19:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T17:19:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T17:19:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T17:19:46.452 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-13T17:19:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: btrfs-tools 2024-09-13T17:19:46.498 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:19:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:19:46.499 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:19:46.499 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-09-13T17:19:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:19:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T17:19:46.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:19:46.502 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2024-09-13T17:19:46.503 INFO:teuthology.orchestra.run.smithi176.stdout: btrfs-tools 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T17:19:46.668 INFO:teuthology.orchestra.run.smithi139.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T17:19:46.669 INFO:teuthology.orchestra.run.smithi139.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T17:19:46.669 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T17:19:46.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-09-13T17:19:46.671 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 librbd1 2024-09-13T17:19:46.724 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-09-13T17:19:46.724 INFO:teuthology.orchestra.run.smithi176.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:19:46.724 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:19:46.724 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:19:46.725 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T17:19:46.725 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T17:19:46.725 INFO:teuthology.orchestra.run.smithi176.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T17:19:46.725 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T17:19:46.726 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 librbd1 2024-09-13T17:19:46.817 INFO:teuthology.orchestra.run.smithi176.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T17:19:46.817 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 200 MB of archives. 2024-09-13T17:19:46.817 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T17:19:46.817 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T17:19:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T17:19:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T17:19:46.854 INFO:teuthology.orchestra.run.smithi139.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T17:19:46.854 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 200 MB of archives. 2024-09-13T17:19:46.854 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T17:19:46.854 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T17:19:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T17:19:46.889 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T17:19:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T17:19:46.903 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T17:19:46.906 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T17:19:46.916 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T17:19:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T17:19:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T17:19:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T17:19:46.972 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T17:19:46.972 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T17:19:46.973 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T17:19:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T17:19:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T17:19:46.978 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T17:19:46.978 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T17:19:46.980 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T17:19:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T17:19:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T17:19:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T17:19:46.999 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:19:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T17:19:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T17:19:47.008 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T17:19:47.010 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T17:19:47.012 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T17:19:47.015 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T17:19:47.018 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T17:19:47.027 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T17:19:47.029 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T17:19:47.039 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T17:19:47.039 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T17:19:47.040 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T17:19:47.041 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T17:19:47.042 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T17:19:47.044 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T17:19:47.045 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T17:19:47.047 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T17:19:47.048 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T17:19:47.062 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T17:19:47.064 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T17:19:47.065 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T17:19:47.066 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T17:19:47.067 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T17:19:47.069 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T17:19:47.079 INFO:teuthology.orchestra.run.smithi176.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T17:19:47.080 INFO:teuthology.orchestra.run.smithi176.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T17:19:47.082 INFO:teuthology.orchestra.run.smithi176.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:19:47.082 INFO:teuthology.orchestra.run.smithi176.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T17:19:47.095 INFO:teuthology.orchestra.run.smithi176.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T17:19:47.097 INFO:teuthology.orchestra.run.smithi176.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T17:19:47.099 INFO:teuthology.orchestra.run.smithi176.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T17:19:47.100 INFO:teuthology.orchestra.run.smithi176.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T17:19:47.101 INFO:teuthology.orchestra.run.smithi176.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T17:19:47.123 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T17:19:47.130 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T17:19:47.131 INFO:teuthology.orchestra.run.smithi176.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T17:19:47.163 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T17:19:47.164 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T17:19:47.167 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T17:19:47.168 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T17:19:47.173 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T17:19:47.190 INFO:teuthology.orchestra.run.smithi176.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T17:19:47.209 INFO:teuthology.orchestra.run.smithi176.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T17:19:47.210 INFO:teuthology.orchestra.run.smithi176.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T17:19:47.224 INFO:teuthology.orchestra.run.smithi176.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T17:19:47.224 INFO:teuthology.orchestra.run.smithi176.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T17:19:47.225 INFO:teuthology.orchestra.run.smithi176.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T17:19:47.225 INFO:teuthology.orchestra.run.smithi176.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T17:19:47.226 INFO:teuthology.orchestra.run.smithi176.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T17:19:47.227 INFO:teuthology.orchestra.run.smithi176.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T17:19:47.227 INFO:teuthology.orchestra.run.smithi176.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T17:19:47.231 INFO:teuthology.orchestra.run.smithi176.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T17:19:47.232 INFO:teuthology.orchestra.run.smithi176.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T17:19:47.250 INFO:teuthology.orchestra.run.smithi176.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T17:19:47.254 INFO:teuthology.orchestra.run.smithi176.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T17:19:47.258 INFO:teuthology.orchestra.run.smithi176.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T17:19:47.261 INFO:teuthology.orchestra.run.smithi176.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T17:19:47.262 INFO:teuthology.orchestra.run.smithi176.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T17:19:47.263 INFO:teuthology.orchestra.run.smithi176.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T17:19:47.264 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T17:19:47.265 INFO:teuthology.orchestra.run.smithi176.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T17:19:47.269 INFO:teuthology.orchestra.run.smithi176.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T17:19:47.269 INFO:teuthology.orchestra.run.smithi176.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T17:19:47.281 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi176.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T17:19:47.290 INFO:teuthology.orchestra.run.smithi176.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T17:19:47.292 INFO:teuthology.orchestra.run.smithi176.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T17:19:47.298 INFO:teuthology.orchestra.run.smithi176.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T17:19:47.304 INFO:teuthology.orchestra.run.smithi176.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T17:19:47.305 INFO:teuthology.orchestra.run.smithi176.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T17:19:47.308 INFO:teuthology.orchestra.run.smithi176.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T17:19:47.309 INFO:teuthology.orchestra.run.smithi176.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T17:19:47.316 INFO:teuthology.orchestra.run.smithi176.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T17:19:47.337 INFO:teuthology.orchestra.run.smithi176.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T17:19:47.338 INFO:teuthology.orchestra.run.smithi176.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T17:19:47.338 INFO:teuthology.orchestra.run.smithi176.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T17:19:47.339 INFO:teuthology.orchestra.run.smithi176.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T17:19:47.341 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T17:19:47.352 INFO:teuthology.orchestra.run.smithi176.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:19:47.353 INFO:teuthology.orchestra.run.smithi176.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T17:19:47.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T17:19:47.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T17:19:47.370 INFO:teuthology.orchestra.run.smithi176.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T17:19:47.395 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T17:19:47.396 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T17:19:47.400 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T17:19:47.540 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T17:19:47.549 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T17:19:47.566 INFO:teuthology.orchestra.run.smithi176.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T17:19:47.568 INFO:teuthology.orchestra.run.smithi176.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T17:19:47.573 INFO:teuthology.orchestra.run.smithi176.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T17:19:47.574 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T17:19:47.582 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T17:19:47.582 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T17:19:47.586 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T17:19:47.586 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T17:19:47.599 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T17:19:47.600 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T17:19:47.623 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T17:19:47.691 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T17:19:47.692 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T17:19:47.693 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T17:19:47.695 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:19:47.696 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T17:19:47.697 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T17:19:47.699 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T17:19:47.700 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T17:19:47.705 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T17:19:47.786 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T17:19:47.787 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T17:19:47.798 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T17:19:47.798 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T17:19:47.800 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T17:19:47.801 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T17:19:47.802 INFO:teuthology.orchestra.run.smithi139.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T17:19:47.804 INFO:teuthology.orchestra.run.smithi139.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T17:19:47.868 INFO:teuthology.orchestra.run.smithi139.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T17:19:47.869 INFO:teuthology.orchestra.run.smithi139.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T17:19:47.949 INFO:teuthology.orchestra.run.smithi139.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T17:19:47.953 INFO:teuthology.orchestra.run.smithi139.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T17:19:47.955 INFO:teuthology.orchestra.run.smithi139.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T17:19:47.955 INFO:teuthology.orchestra.run.smithi139.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T17:19:47.957 INFO:teuthology.orchestra.run.smithi139.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T17:19:47.957 INFO:teuthology.orchestra.run.smithi139.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T17:19:47.959 INFO:teuthology.orchestra.run.smithi139.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T17:19:47.959 INFO:teuthology.orchestra.run.smithi139.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi139.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T17:19:48.034 INFO:teuthology.orchestra.run.smithi139.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:19:48.112 INFO:teuthology.orchestra.run.smithi139.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T17:19:48.114 INFO:teuthology.orchestra.run.smithi139.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T17:19:48.116 INFO:teuthology.orchestra.run.smithi139.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T17:19:48.118 INFO:teuthology.orchestra.run.smithi139.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T17:19:48.119 INFO:teuthology.orchestra.run.smithi139.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T17:19:48.120 INFO:teuthology.orchestra.run.smithi139.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T17:19:48.198 INFO:teuthology.orchestra.run.smithi139.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T17:19:48.448 INFO:teuthology.orchestra.run.smithi139.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T17:19:48.472 INFO:teuthology.orchestra.run.smithi139.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T17:19:48.474 INFO:teuthology.orchestra.run.smithi139.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T17:19:48.475 INFO:teuthology.orchestra.run.smithi139.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T17:19:48.481 INFO:teuthology.orchestra.run.smithi139.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T17:19:48.492 INFO:teuthology.orchestra.run.smithi176.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T17:19:48.521 INFO:teuthology.orchestra.run.smithi139.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T17:19:48.528 INFO:teuthology.orchestra.run.smithi139.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T17:19:48.546 INFO:teuthology.orchestra.run.smithi139.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T17:19:48.547 INFO:teuthology.orchestra.run.smithi139.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T17:19:48.547 INFO:teuthology.orchestra.run.smithi139.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T17:19:48.548 INFO:teuthology.orchestra.run.smithi139.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T17:19:48.549 INFO:teuthology.orchestra.run.smithi139.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T17:19:48.550 INFO:teuthology.orchestra.run.smithi139.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T17:19:48.550 INFO:teuthology.orchestra.run.smithi139.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T17:19:48.612 INFO:teuthology.orchestra.run.smithi139.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T17:19:48.613 INFO:teuthology.orchestra.run.smithi139.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T17:19:48.694 INFO:teuthology.orchestra.run.smithi139.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T17:19:48.702 INFO:teuthology.orchestra.run.smithi139.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T17:19:48.706 INFO:teuthology.orchestra.run.smithi139.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T17:19:48.709 INFO:teuthology.orchestra.run.smithi139.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T17:19:48.710 INFO:teuthology.orchestra.run.smithi139.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T17:19:48.714 INFO:teuthology.orchestra.run.smithi139.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T17:19:48.717 INFO:teuthology.orchestra.run.smithi139.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T17:19:48.717 INFO:teuthology.orchestra.run.smithi139.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T17:19:48.723 INFO:teuthology.orchestra.run.smithi139.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T17:19:48.784 INFO:teuthology.orchestra.run.smithi139.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T17:19:48.788 INFO:teuthology.orchestra.run.smithi139.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T17:19:48.845 INFO:teuthology.orchestra.run.smithi176.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T17:19:48.848 INFO:teuthology.orchestra.run.smithi176.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T17:19:48.851 INFO:teuthology.orchestra.run.smithi176.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T17:19:48.857 INFO:teuthology.orchestra.run.smithi139.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T17:19:48.912 INFO:teuthology.orchestra.run.smithi176.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T17:19:49.024 INFO:teuthology.orchestra.run.smithi139.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T17:19:49.025 INFO:teuthology.orchestra.run.smithi139.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T17:19:49.025 INFO:teuthology.orchestra.run.smithi139.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T17:19:49.027 INFO:teuthology.orchestra.run.smithi139.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T17:19:49.047 INFO:teuthology.orchestra.run.smithi139.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:19:49.048 INFO:teuthology.orchestra.run.smithi139.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T17:19:49.049 INFO:teuthology.orchestra.run.smithi139.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T17:19:49.050 INFO:teuthology.orchestra.run.smithi139.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T17:19:49.050 INFO:teuthology.orchestra.run.smithi139.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T17:19:49.156 INFO:teuthology.orchestra.run.smithi176.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T17:19:49.471 INFO:teuthology.orchestra.run.smithi139.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T17:19:49.471 INFO:teuthology.orchestra.run.smithi139.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T17:19:49.479 INFO:teuthology.orchestra.run.smithi139.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T17:19:49.548 INFO:teuthology.orchestra.run.smithi139.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T17:19:49.558 INFO:teuthology.orchestra.run.smithi139.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T17:19:49.565 INFO:teuthology.orchestra.run.smithi139.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T17:19:49.774 INFO:teuthology.orchestra.run.smithi139.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T17:19:50.017 INFO:teuthology.orchestra.run.smithi139.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T17:19:50.017 INFO:teuthology.orchestra.run.smithi139.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T17:19:50.047 INFO:teuthology.orchestra.run.smithi176.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T17:19:50.047 INFO:teuthology.orchestra.run.smithi176.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T17:19:50.063 INFO:teuthology.orchestra.run.smithi176.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T17:19:50.154 INFO:teuthology.orchestra.run.smithi176.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T17:19:50.163 INFO:teuthology.orchestra.run.smithi176.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T17:19:50.167 INFO:teuthology.orchestra.run.smithi176.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T17:19:50.411 INFO:teuthology.orchestra.run.smithi176.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T17:19:50.707 INFO:teuthology.orchestra.run.smithi176.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T17:19:50.707 INFO:teuthology.orchestra.run.smithi176.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T17:19:51.452 INFO:teuthology.orchestra.run.smithi139.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T17:19:51.453 INFO:teuthology.orchestra.run.smithi139.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T17:19:51.456 INFO:teuthology.orchestra.run.smithi139.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T17:19:51.456 INFO:teuthology.orchestra.run.smithi139.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T17:19:51.457 INFO:teuthology.orchestra.run.smithi139.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T17:19:51.457 INFO:teuthology.orchestra.run.smithi139.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T17:19:51.866 INFO:teuthology.orchestra.run.smithi139.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T17:19:52.117 INFO:teuthology.orchestra.run.smithi176.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T17:19:52.118 INFO:teuthology.orchestra.run.smithi176.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T17:19:52.121 INFO:teuthology.orchestra.run.smithi176.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T17:19:52.121 INFO:teuthology.orchestra.run.smithi176.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T17:19:52.122 INFO:teuthology.orchestra.run.smithi176.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T17:19:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T17:19:52.333 INFO:teuthology.orchestra.run.smithi176.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T17:19:52.778 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 200 MB in 5s (38.5 MB/s) 2024-09-13T17:19:52.975 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:19:53.044 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T17:19:53.047 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T17:19:53.080 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T17:19:53.297 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 200 MB in 6s (35.7 MB/s) 2024-09-13T17:19:53.441 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:19:53.459 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T17:19:53.472 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:19:53.498 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:19:53.539 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T17:19:53.542 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T17:19:53.585 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T17:19:53.860 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:19:53.878 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T17:19:53.926 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:19:53.955 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:19:53.972 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T17:19:54.013 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:19:54.329 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T17:19:54.341 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:19:54.349 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T17:19:54.360 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T17:19:54.399 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:19:54.429 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:19:54.795 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T17:19:54.815 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T17:19:54.815 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:19:54.829 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T17:19:54.874 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:19:54.895 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:19:55.202 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:19:55.214 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T17:19:55.243 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:19:55.299 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:19:55.322 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T17:19:55.365 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:19:55.760 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:19:55.764 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:19:55.779 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T17:19:55.782 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:19:55.818 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:19:55.842 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:19:56.330 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:19:56.348 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:19:56.358 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:19:56.378 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:19:56.408 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:19:56.410 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:19:56.828 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:19:56.846 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:19:56.886 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:19:56.967 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:19:56.987 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:19:57.024 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:19:57.314 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T17:19:57.333 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T17:19:57.372 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:19:57.428 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:19:57.446 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:19:57.494 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:19:57.794 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:19:57.914 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T17:19:57.917 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:19:57.935 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T17:19:57.972 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:19:58.377 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:19:58.500 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:19:58.665 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:19:58.796 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:19:59.264 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:19:59.388 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:19:59.567 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:19:59.586 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:19:59.658 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:00.027 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:20:00.043 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:00.102 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:00.142 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:20:00.160 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:00.199 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:00.505 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:20:00.522 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:00.563 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:20:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:00.841 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:20:00.858 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:00.932 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:01.122 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:20:01.140 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:01.179 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:01.260 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:20:01.276 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:01.351 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:01.474 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:20:01.494 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:01.532 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:01.918 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:20:01.937 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:01.976 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:02.165 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:20:02.176 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T17:20:02.246 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T17:20:02.363 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:20:02.384 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T17:20:02.429 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T17:20:02.507 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:20:02.527 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:02.565 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:02.699 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:20:02.719 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:02.781 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:02.960 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T17:20:02.975 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T17:20:03.059 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:20:03.160 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T17:20:03.180 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T17:20:03.234 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:20:03.371 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T17:20:03.390 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T17:20:03.449 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:20:03.579 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T17:20:03.600 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T17:20:03.670 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:20:03.815 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:20:03.832 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T17:20:03.906 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:20:03.990 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:20:04.007 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T17:20:04.048 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:20:04.301 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:20:04.312 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:04.350 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:04.409 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:20:04.429 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:04.467 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:05.253 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:20:05.270 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:05.303 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:05.386 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:20:05.406 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:05.478 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:05.698 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liboath0. 2024-09-13T17:20:05.715 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T17:20:05.755 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T17:20:05.831 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liboath0. 2024-09-13T17:20:05.848 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T17:20:05.914 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T17:20:06.108 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:20:06.124 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:06.166 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:06.225 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:20:06.244 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:06.283 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:06.629 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:20:06.644 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:06.677 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:06.812 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:20:06.830 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:06.869 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:09.225 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:20:09.240 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:09.330 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:09.413 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:20:09.431 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:09.518 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:10.626 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:20:10.641 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T17:20:10.684 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:20:11.037 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:20:11.052 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T17:20:11.087 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T17:20:11.152 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:20:11.174 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T17:20:11.217 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:20:11.432 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:20:11.446 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T17:20:11.490 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T17:20:11.633 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:20:11.648 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T17:20:11.721 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T17:20:11.843 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:20:11.858 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T17:20:11.900 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:20:12.074 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:20:12.092 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T17:20:12.166 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T17:20:12.249 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:20:12.260 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T17:20:12.303 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:20:12.493 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:20:12.515 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T17:20:12.560 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:20:12.715 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:20:12.729 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:20:12.773 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:20:12.905 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:20:12.924 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T17:20:12.963 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:20:13.135 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:20:13.150 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T17:20:13.193 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:20:13.342 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:20:13.359 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:20:13.399 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:20:13.558 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:20:13.573 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T17:20:13.632 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:20:13.763 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:20:13.781 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T17:20:13.821 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:20:13.977 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T17:20:13.991 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T17:20:14.043 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:20:14.134 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:20:14.152 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T17:20:14.192 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:20:14.380 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T17:20:14.394 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T17:20:14.429 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T17:20:14.570 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T17:20:14.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T17:20:14.636 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:20:14.823 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:20:14.837 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T17:20:14.886 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:20:14.997 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T17:20:15.016 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T17:20:15.055 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T17:20:15.258 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:20:15.268 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T17:20:15.308 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T17:20:15.433 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:20:15.452 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T17:20:15.498 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:20:15.645 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:20:15.656 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T17:20:15.695 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:20:16.057 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:20:16.073 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T17:20:16.115 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:20:16.485 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:20:16.493 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T17:20:16.534 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:20:16.594 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:20:16.608 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T17:20:16.652 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T17:20:16.879 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:20:16.895 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T17:20:16.937 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T17:20:17.015 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:20:17.032 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T17:20:17.073 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:20:17.315 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:20:17.330 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T17:20:17.373 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:20:17.451 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:20:17.468 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T17:20:17.509 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:20:17.870 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:20:17.889 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T17:20:17.928 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:20:18.265 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:20:18.284 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T17:20:18.323 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T17:20:18.545 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:20:18.558 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T17:20:18.603 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:20:18.692 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:20:18.711 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T17:20:18.750 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:20:18.964 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:20:18.979 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:19.022 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:19.164 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:20:19.186 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T17:20:19.230 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:20:19.477 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:20:19.491 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:19.535 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:19.575 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:20:19.596 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:19.641 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:19.896 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:20:19.910 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T17:20:19.954 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:20:20.071 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:20:20.089 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:20.129 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:20.299 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T17:20:20.316 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T17:20:20.357 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:20:20.500 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:20:20.516 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T17:20:20.556 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:20:20.802 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:20:20.820 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T17:20:20.860 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T17:20:20.910 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T17:20:20.931 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T17:20:20.976 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:20:21.264 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:20:21.281 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:21.348 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:21.430 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:20:21.448 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T17:20:21.488 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T17:20:21.867 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:20:21.868 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:20:21.885 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:21.888 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:21.925 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:21.925 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:22.478 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:20:22.496 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:22.536 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:22.898 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:20:22.915 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:22.955 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:23.557 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:20:23.576 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:23.614 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:25.042 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph. 2024-09-13T17:20:25.061 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:25.133 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:25.511 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:20:25.530 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:25.569 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:25.709 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph. 2024-09-13T17:20:25.726 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:25.791 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:26.055 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:20:26.070 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:26.113 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:26.153 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:20:26.171 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:26.235 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:26.667 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:20:26.683 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:26.724 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:20:26.741 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:26.749 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:26.781 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:27.102 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:20:27.119 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T17:20:27.185 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T17:20:27.351 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:20:27.369 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:27.409 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:27.596 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:20:27.610 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T17:20:27.654 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:20:27.787 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:20:27.804 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T17:20:27.844 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T17:20:28.033 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:20:28.049 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:28.090 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:28.265 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:20:28.284 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T17:20:28.322 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:20:28.485 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T17:20:28.503 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T17:20:28.543 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:20:28.676 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:20:28.695 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:28.725 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:28.905 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-attr. 2024-09-13T17:20:28.919 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T17:20:28.963 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T17:20:29.120 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T17:20:29.139 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T17:20:29.178 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:20:29.357 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:20:29.368 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T17:20:29.406 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T17:20:29.565 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-attr. 2024-09-13T17:20:29.584 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T17:20:29.623 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T17:20:29.777 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:20:29.792 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T17:20:29.834 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:20:30.026 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:20:30.047 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T17:20:30.092 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T17:20:30.196 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T17:20:30.211 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T17:20:30.254 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:20:30.462 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:20:30.479 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T17:20:30.519 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:20:30.591 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T17:20:30.610 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T17:20:30.649 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T17:20:30.906 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T17:20:30.924 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T17:20:30.965 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:20:30.985 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:20:31.001 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T17:20:31.043 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T17:20:31.310 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T17:20:31.327 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T17:20:31.367 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T17:20:31.439 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:20:31.455 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:20:31.496 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:20:31.704 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:20:31.724 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T17:20:31.761 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T17:20:31.807 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T17:20:31.823 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T17:20:31.865 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:20:32.165 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:20:32.185 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T17:20:32.189 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:20:32.201 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T17:20:32.231 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:20:32.243 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:20:32.527 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T17:20:32.544 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T17:20:32.584 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:20:32.612 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:20:32.628 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T17:20:32.671 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T17:20:32.879 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T17:20:32.900 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T17:20:32.970 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:20:33.049 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:20:33.064 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:33.106 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:33.331 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:20:33.349 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T17:20:33.414 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T17:20:33.775 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:20:33.790 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:33.861 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:34.782 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T17:20:34.800 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T17:20:34.865 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:20:35.201 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T17:20:35.216 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T17:20:35.261 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T17:20:35.281 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T17:20:35.292 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:20:35.319 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:20:35.612 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T17:20:35.627 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T17:20:35.672 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T17:20:35.709 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T17:20:35.710 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T17:20:35.738 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:20:36.091 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T17:20:36.104 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T17:20:36.149 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T17:20:37.129 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T17:20:37.148 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T17:20:37.195 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:20:37.575 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T17:20:37.595 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T17:20:37.649 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:20:37.785 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:20:37.798 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T17:20:37.835 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T17:20:38.232 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:20:38.245 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T17:20:38.256 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:20:38.273 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T17:20:38.289 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T17:20:38.314 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:20:38.727 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:20:38.752 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T17:20:38.793 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:20:39.124 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:20:39.144 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:39.662 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:20:39.680 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:39.719 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:40.410 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:20:40.429 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T17:20:40.467 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T17:20:40.906 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:20:40.925 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T17:20:40.948 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:20:40.956 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:20:40.965 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T17:20:41.005 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T17:20:41.351 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:20:41.364 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T17:20:41.401 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:20:41.478 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:20:41.499 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T17:20:41.544 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:20:41.788 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:20:41.806 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T17:20:41.854 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T17:20:41.923 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:20:41.942 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T17:20:41.995 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:20:42.241 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:20:42.258 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T17:20:42.299 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T17:20:42.569 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:20:42.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T17:20:42.626 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T17:20:42.661 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T17:20:42.678 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T17:20:42.719 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:20:43.022 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:20:43.043 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T17:20:43.056 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T17:20:43.074 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T17:20:43.088 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T17:20:43.114 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:20:43.484 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T17:20:43.504 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T17:20:43.512 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:20:43.531 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T17:20:43.550 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:20:43.594 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:20:43.921 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T17:20:43.941 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T17:20:43.948 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:20:43.966 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T17:20:43.979 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:20:44.031 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:20:44.376 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:20:44.398 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T17:20:44.434 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:20:44.442 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:20:44.453 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T17:20:44.493 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:20:44.828 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:20:44.848 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T17:20:44.886 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:20:45.125 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:20:45.145 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:45.183 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:45.260 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:20:45.281 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T17:20:45.325 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:20:45.561 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:20:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T17:20:45.619 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:20:45.981 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:20:46.004 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:46.016 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:20:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:20:46.046 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:46.099 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:20:46.402 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package jq. 2024-09-13T17:20:46.419 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:20:46.421 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:20:46.437 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T17:20:46.459 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:20:46.476 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:20:46.754 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package socat. 2024-09-13T17:20:46.776 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T17:20:46.820 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T17:20:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:20:46.882 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:20:46.921 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:20:47.208 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:20:47.228 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T17:20:47.241 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package jq. 2024-09-13T17:20:47.260 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:20:47.273 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:20:47.299 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:20:47.568 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package socat. 2024-09-13T17:20:47.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T17:20:47.618 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T17:20:47.678 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:20:47.699 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:47.777 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:47.963 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:20:47.985 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T17:20:48.029 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:20:48.476 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:20:48.496 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:48.567 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:51.756 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:20:51.770 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:51.814 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:52.244 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:20:52.266 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:52.310 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:52.529 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:20:52.548 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:52.587 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:52.688 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:20:52.706 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T17:20:52.745 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T17:20:53.016 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:20:53.036 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:53.057 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:20:53.079 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:53.107 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:53.123 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:53.434 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:20:53.452 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:20:53.456 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:53.472 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T17:20:53.500 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:53.535 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T17:20:53.811 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T17:20:53.828 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:20:53.830 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:20:53.852 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:53.869 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:20:53.895 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:54.232 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:20:54.251 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:20:54.290 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:54.398 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:20:54.412 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:54.481 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:54.643 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T17:20:54.662 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:20:54.700 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:20:54.917 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:20:54.937 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T17:20:55.012 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:20:55.263 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:20:55.281 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:20:55.345 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:20:55.397 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:20:55.419 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T17:20:55.463 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:20:55.799 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:20:55.816 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T17:20:55.890 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:20:55.908 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T17:20:55.930 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:20:55.974 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:20:56.270 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:20:56.289 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T17:20:56.328 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:20:56.814 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T17:20:56.837 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:20:56.880 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:20:57.966 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T17:20:57.988 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T17:20:58.032 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T17:20:58.411 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T17:20:58.431 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T17:20:58.469 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:20:58.830 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T17:20:58.850 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T17:20:58.855 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T17:20:58.875 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T17:20:58.887 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T17:20:58.913 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T17:20:59.299 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T17:20:59.318 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T17:20:59.324 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T17:20:59.343 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T17:20:59.357 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:20:59.391 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:20:59.719 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T17:20:59.737 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T17:20:59.776 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T17:20:59.919 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:20:59.939 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:20:59.977 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:21:00.172 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T17:21:00.190 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T17:21:00.229 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:21:00.347 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:21:00.370 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T17:21:00.413 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:21:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:21:00.735 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:21:00.791 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:21:00.807 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:21:00.811 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T17:21:00.849 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:21:01.136 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:21:01.160 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T17:21:01.211 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:21:01.231 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T17:21:01.235 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:21:01.277 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:21:01.589 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:21:01.609 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T17:21:01.613 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:21:01.634 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T17:21:01.663 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:21:01.679 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:21:01.999 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:21:02.013 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T17:21:02.057 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:21:02.402 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:21:02.423 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T17:21:02.468 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:21:02.483 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:21:02.503 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:21:02.541 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:03.272 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:21:03.291 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:21:03.329 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:03.961 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:21:03.979 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:21:04.019 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:04.534 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T17:21:04.708 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:21:04.730 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:21:04.773 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:04.907 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:21:05.067 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:21:05.159 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T17:21:05.193 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:21:05.453 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:05.514 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:21:05.657 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:21:05.807 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:21:06.026 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:06.107 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user cephadm....done 2024-09-13T17:21:06.308 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:21:06.434 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:21:06.728 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user cephadm....done 2024-09-13T17:21:06.861 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:21:06.915 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:21:07.041 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:21:07.212 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:21:07.338 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T17:21:07.464 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:21:07.509 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:21:07.891 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T17:21:08.002 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:21:08.153 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T17:21:08.279 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:21:08.401 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:21:08.680 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T17:21:08.777 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T17:21:09.120 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T17:21:09.174 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:21:09.534 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T17:21:09.855 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:21:09.893 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T17:21:10.206 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:21:10.286 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:21:10.557 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:10.621 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:21:10.916 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:21:11.013 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:11.042 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T17:21:11.372 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:21:11.402 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:21:11.498 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T17:21:11.753 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:21:11.866 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:21:12.142 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:21:12.200 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:21:12.271 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:21:12.543 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:21:12.677 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:21:12.722 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T17:21:13.057 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:21:13.408 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:21:13.470 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T17:21:13.830 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:21:13.837 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:21:14.177 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:21:14.231 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:21:14.656 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T17:21:14.657 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:21:15.012 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T17:21:15.016 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:21:15.405 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:21:15.417 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T17:21:15.556 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:21:15.682 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:21:15.802 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T17:21:16.041 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:21:16.161 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:21:16.287 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:21:16.413 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:21:16.543 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:21:16.764 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:21:16.911 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:21:17.241 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:21:17.346 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:21:17.617 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:21:17.797 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T17:21:17.961 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:18.068 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:21:18.391 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:21:18.503 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T17:21:18.534 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T17:21:18.629 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:18.977 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:21:19.030 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:21:19.103 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:21:19.181 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T17:21:19.262 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T17:21:19.624 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:21:19.629 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:21:19.777 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:21:19.909 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T17:21:20.038 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:21:20.165 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:21:20.269 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:21:20.291 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:21:20.653 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:21:20.685 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:21:20.797 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:21:20.922 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:21:21.036 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T17:21:21.324 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:21:21.403 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:21:21.546 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:21:21.666 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T17:21:21.889 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T17:21:22.017 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:21:22.143 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:21:22.240 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:21:22.503 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T17:21:22.616 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:21:22.879 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:21:23.027 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T17:21:23.249 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:21:23.377 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:21:23.503 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:21:23.695 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T17:21:23.904 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:21:24.040 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:21:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:21:24.339 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:21:24.465 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:21:24.593 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:21:24.624 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:21:25.044 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:21:25.050 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:21:25.203 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:21:25.329 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:21:25.401 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T17:21:25.738 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:21:26.098 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T17:21:27.248 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:21:27.374 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T17:21:27.834 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T17:21:27.904 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:21:28.021 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T17:21:28.243 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:21:28.464 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:21:28.795 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T17:21:28.840 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:21:29.191 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:21:29.230 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:21:29.317 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T17:21:29.640 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T17:21:29.735 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:21:30.108 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:21:30.137 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T17:21:30.526 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:21:30.596 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:21:31.014 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:21:31.773 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:21:31.899 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T17:21:32.025 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:21:32.193 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T17:21:32.262 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:21:32.379 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T17:21:32.505 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:21:32.553 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:21:32.631 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T17:21:32.678 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T17:21:33.032 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:21:33.054 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:21:33.182 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T17:21:33.397 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:21:33.542 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:21:33.798 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:21:33.918 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:21:34.234 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:34.303 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:21:34.461 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:21:34.621 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:34.738 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:34.747 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:34.873 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:34.991 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:21:35.041 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T17:21:35.125 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:35.251 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:35.411 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:35.467 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:35.537 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T17:21:35.593 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T17:21:35.905 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:35.961 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:36.031 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T17:21:36.087 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:36.213 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:36.399 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:36.511 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:21:36.511 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:21:36.525 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:36.651 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:36.936 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:21:36.936 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:21:37.332 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:37.458 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:37.617 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:37.743 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:21:37.785 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:37.912 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:38.054 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:38.205 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:21:38.922 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.048 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.224 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.326 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.350 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.476 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.485 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.611 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.643 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.737 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:39.896 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:40.022 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:40.634 INFO:teuthology.orchestra.run.smithi176.stdout:Adding group ceph....done 2024-09-13T17:21:40.660 INFO:teuthology.orchestra.run.smithi139.stdout:Adding group ceph....done 2024-09-13T17:21:41.115 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user ceph....done 2024-09-13T17:21:41.142 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user ceph....done 2024-09-13T17:21:41.338 INFO:teuthology.orchestra.run.smithi176.stdout:Setting system user ceph properties....done 2024-09-13T17:21:41.345 INFO:teuthology.orchestra.run.smithi139.stdout:Setting system user ceph properties....done 2024-09-13T17:21:41.367 INFO:teuthology.orchestra.run.smithi176.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:21:41.377 INFO:teuthology.orchestra.run.smithi139.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:21:41.561 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:21:41.589 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:21:42.123 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:21:42.131 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:21:43.057 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:43.114 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:43.323 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:21:43.324 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:21:43.378 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:21:43.378 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:21:44.146 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:44.266 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:44.373 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:44.425 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:45.117 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:21:45.117 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:21:45.126 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:21:45.126 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:21:45.919 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:45.934 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:46.436 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:21:46.438 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:21:47.294 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:47.303 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:47.565 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:21:47.565 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:21:47.587 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:21:47.587 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:21:48.404 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:48.480 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:48.686 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:21:48.686 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:21:48.753 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:21:48.753 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:21:49.563 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:50.375 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:21:50.375 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:21:50.454 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:21:50.454 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:21:51.232 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:51.316 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:51.358 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:51.442 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:51.509 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:51.618 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:51.804 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:21:51.804 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:21:51.870 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:21:51.870 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:21:52.693 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:52.712 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:52.875 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:52.887 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:53.003 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:53.013 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:53.164 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:53.332 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:21:53.626 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:21:53.783 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:21:53.818 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:21:53.943 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:21:54.287 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:21:54.411 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:21:59.273 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T17:21:59.363 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T17:22:00.054 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:22:00.059 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:22:00.185 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:22:00.186 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-13T17:22:00.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:22:00.316 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T17:22:00.405 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-09-13T17:22:00.406 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-09-13T17:22:00.534 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T17:22:00.535 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T17:22:00.633 INFO:teuthology.orchestra.run.smithi176.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T17:22:00.633 INFO:teuthology.orchestra.run.smithi176.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T17:22:00.633 INFO:teuthology.orchestra.run.smithi176.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T17:22:00.633 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T17:22:00.633 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T17:22:00.633 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:22:00.634 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:22:00.634 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:22:00.634 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-09-13T17:22:00.635 INFO:teuthology.orchestra.run.smithi176.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T17:22:00.635 INFO:teuthology.orchestra.run.smithi176.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T17:22:00.635 INFO:teuthology.orchestra.run.smithi176.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T17:22:00.635 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T17:22:00.635 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T17:22:00.637 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-09-13T17:22:00.637 INFO:teuthology.orchestra.run.smithi176.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T17:22:00.637 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T17:22:00.637 INFO:teuthology.orchestra.run.smithi176.stdout: libengine-pkcs11-openssl 2024-09-13T17:22:00.747 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-09-13T17:22:00.747 INFO:teuthology.orchestra.run.smithi176.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T17:22:00.748 INFO:teuthology.orchestra.run.smithi176.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T17:22:00.748 INFO:teuthology.orchestra.run.smithi176.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T17:22:00.748 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T17:22:00.749 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T17:22:00.749 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:22:00.750 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-09-13T17:22:00.751 INFO:teuthology.orchestra.run.smithi176.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T17:22:00.758 INFO:teuthology.orchestra.run.smithi139.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T17:22:00.758 INFO:teuthology.orchestra.run.smithi139.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T17:22:00.758 INFO:teuthology.orchestra.run.smithi139.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T17:22:00.758 INFO:teuthology.orchestra.run.smithi139.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T17:22:00.758 INFO:teuthology.orchestra.run.smithi139.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T17:22:00.758 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:22:00.759 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:22:00.759 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:22:00.759 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-13T17:22:00.760 INFO:teuthology.orchestra.run.smithi139.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T17:22:00.760 INFO:teuthology.orchestra.run.smithi139.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T17:22:00.760 INFO:teuthology.orchestra.run.smithi139.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T17:22:00.760 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T17:22:00.760 INFO:teuthology.orchestra.run.smithi139.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T17:22:00.762 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-13T17:22:00.762 INFO:teuthology.orchestra.run.smithi139.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T17:22:00.762 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T17:22:00.762 INFO:teuthology.orchestra.run.smithi139.stdout: libengine-pkcs11-openssl 2024-09-13T17:22:00.872 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-13T17:22:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T17:22:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T17:22:00.949 INFO:teuthology.orchestra.run.smithi176.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T17:22:00.949 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 25.4 MB of archives. 2024-09-13T17:22:00.950 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T17:22:00.950 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T17:22:01.070 INFO:teuthology.orchestra.run.smithi139.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T17:22:01.071 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 25.4 MB of archives. 2024-09-13T17:22:01.071 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T17:22:01.071 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T17:22:01.573 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T17:22:01.575 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T17:22:01.576 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T17:22:01.590 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T17:22:01.592 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T17:22:01.690 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T17:22:01.691 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T17:22:01.692 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T17:22:01.693 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T17:22:01.695 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T17:22:01.699 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T17:22:01.704 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T17:22:01.705 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T17:22:01.706 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T17:22:01.708 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T17:22:01.736 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T17:22:01.737 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T17:22:01.740 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T17:22:01.741 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T17:22:01.807 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T17:22:01.809 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T17:22:01.816 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T17:22:01.817 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T17:22:01.818 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T17:22:01.821 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T17:22:01.822 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T17:22:01.829 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T17:22:01.833 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T17:22:01.846 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T17:22:01.846 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T17:22:01.861 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T17:22:01.862 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T17:22:01.866 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T17:22:01.866 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T17:22:01.898 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T17:22:01.899 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T17:22:01.922 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T17:22:01.943 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T17:22:01.943 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T17:22:01.951 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T17:22:01.953 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T17:22:01.957 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T17:22:01.974 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T17:22:01.974 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T17:22:02.012 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T17:22:02.018 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T17:22:02.018 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T17:22:02.019 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T17:22:02.019 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T17:22:02.024 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T17:22:02.025 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T17:22:02.047 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T17:22:02.051 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T17:22:02.061 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T17:22:02.081 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T17:22:02.140 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T17:22:02.146 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T17:22:02.146 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T17:22:02.152 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T17:22:02.152 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T17:22:02.176 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T17:22:02.188 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T17:22:02.450 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T17:22:02.450 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T17:22:02.451 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T17:22:02.451 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T17:22:02.451 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T17:22:02.582 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T17:22:02.582 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T17:22:02.582 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T17:22:02.582 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T17:22:02.583 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T17:22:03.038 INFO:teuthology.orchestra.run.smithi176.stdout:Preconfiguring packages ... 2024-09-13T17:22:03.168 INFO:teuthology.orchestra.run.smithi139.stdout:Preconfiguring packages ... 2024-09-13T17:22:03.279 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 25.4 MB in 2s (15.0 MB/s) 2024-09-13T17:22:03.437 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 25.4 MB in 2s (14.9 MB/s) 2024-09-13T17:22:03.596 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T17:22:03.600 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:22:03.789 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T17:22:03.793 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:22:03.795 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:22:03.979 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:22:05.564 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T17:22:05.598 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T17:22:07.570 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T17:22:07.574 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:22:07.622 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T17:22:07.625 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:22:07.732 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:22:07.775 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:22:08.190 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:22:08.272 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:22:08.354 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:22:08.456 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:22:08.747 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:22:08.837 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:22:09.243 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T17:22:09.246 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:22:09.311 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T17:22:09.315 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:22:09.446 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:22:09.564 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:22:09.995 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:22:10.115 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:22:10.135 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:22:10.252 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:22:10.675 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:22:10.778 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:22:10.839 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T17:22:10.956 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T17:22:11.510 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:22:11.531 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T17:22:11.569 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:22:11.928 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:22:11.948 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T17:22:11.972 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package dump. 2024-09-13T17:22:11.986 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:22:11.990 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T17:22:12.029 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T17:22:12.383 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package indent. 2024-09-13T17:22:12.398 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package dump. 2024-09-13T17:22:12.405 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:12.416 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T17:22:12.450 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:22:12.456 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T17:22:12.801 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package indent. 2024-09-13T17:22:12.803 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:22:12.810 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:12.823 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T17:22:12.851 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:22:12.861 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:22:13.212 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:22:13.231 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:22:13.231 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T17:22:13.250 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T17:22:13.270 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:22:13.289 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:22:13.575 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:22:13.598 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:22:13.641 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:13.674 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:22:13.691 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T17:22:13.732 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:22:14.037 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:22:14.055 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:14.068 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:22:14.084 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:22:14.094 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:14.126 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:14.397 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:22:14.441 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:14.521 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:22:14.536 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:14.579 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:14.763 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:14.932 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:22:14.951 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:14.990 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:15.133 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:22:15.154 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:15.191 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:15.359 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:22:15.377 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:15.417 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:15.603 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:22:15.625 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T17:22:15.669 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:22:15.837 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:22:15.851 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T17:22:15.895 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:22:16.055 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:22:16.075 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:22:16.113 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:16.273 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:22:16.288 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:22:16.356 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:16.527 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:22:16.547 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:16.585 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:16.792 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:22:16.808 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:16.850 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:17.021 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:22:17.042 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:17.071 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:17.229 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:22:17.246 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:17.286 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:17.432 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:22:17.454 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:17.498 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:17.656 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:22:17.666 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:17.706 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:17.793 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:22:17.814 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:22:17.859 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:22:17.975 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:22:17.985 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:22:18.058 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:22:18.396 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:22:18.417 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T17:22:18.487 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:22:18.620 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:22:18.637 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T17:22:18.678 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:22:18.924 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:22:18.944 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:19.002 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:19.148 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:22:19.166 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:22:19.227 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:19.671 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:22:19.691 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T17:22:19.729 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:22:19.904 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:22:19.920 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T17:22:19.961 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:22:20.309 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:22:20.323 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:22:20.417 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:20.575 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:22:20.597 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:22:20.688 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:21.233 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ppp. 2024-09-13T17:22:21.251 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T17:22:21.515 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ppp. 2024-09-13T17:22:21.535 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T17:22:21.732 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:22:22.002 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:22:22.137 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:22:22.152 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T17:22:22.195 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T17:22:22.387 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:22:22.404 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T17:22:22.444 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T17:22:22.632 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:22:22.651 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T17:22:22.727 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T17:22:22.882 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:22:22.899 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T17:22:22.973 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T17:22:23.102 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:22:23.127 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T17:22:23.167 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:22:23.318 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:22:23.334 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T17:22:23.376 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:22:23.522 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T17:22:23.542 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:23.581 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:23.739 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T17:22:23.755 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:23.796 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:22:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T17:22:24.352 INFO:teuthology.orchestra.run.smithi176.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:22:24.380 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T17:22:24.418 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:22:24.435 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T17:22:24.508 INFO:teuthology.orchestra.run.smithi139.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:22:24.538 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T17:22:24.908 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T17:22:24.927 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:24.973 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:25.099 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T17:22:25.112 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:22:25.155 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:26.577 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:22:26.599 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T17:22:26.643 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T17:22:26.827 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:22:26.844 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T17:22:26.885 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T17:22:26.912 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:22:26.936 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T17:22:26.996 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:22:27.169 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:22:27.184 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T17:22:27.229 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:22:27.264 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:22:27.283 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T17:22:27.322 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:22:27.506 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:22:27.524 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T17:22:27.597 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:22:27.608 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:22:27.627 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T17:22:27.666 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T17:22:27.858 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:22:27.874 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T17:22:27.916 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T17:22:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:22:28.090 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T17:22:28.156 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:22:28.344 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:22:28.363 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T17:22:28.448 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:22:28.519 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:22:28.733 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:22:28.768 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:22:28.999 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:22:29.126 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:29.277 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:22:29.367 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:29.386 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:22:29.493 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:22:29.495 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:22:29.619 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:22:29.770 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:22:29.953 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:22:29.953 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:22:30.210 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:22:30.211 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:22:30.840 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:31.090 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:32.778 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:22:32.903 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:22:33.029 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:22:33.078 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:22:33.155 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T17:22:33.195 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:22:33.321 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:22:33.489 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T17:22:34.441 INFO:teuthology.orchestra.run.smithi176.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:22:34.732 INFO:teuthology.orchestra.run.smithi139.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:22:34.797 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:34.797 INFO:teuthology.orchestra.run.smithi176.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:22:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:35.128 INFO:teuthology.orchestra.run.smithi139.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:22:35.526 INFO:teuthology.orchestra.run.smithi176.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:22:35.526 INFO:teuthology.orchestra.run.smithi176.stdout:Removing obsolete dictionary files: 2024-09-13T17:22:35.577 INFO:teuthology.orchestra.run.smithi139.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:22:35.577 INFO:teuthology.orchestra.run.smithi139.stdout:Removing obsolete dictionary files: 2024-09-13T17:22:36.122 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:22:36.125 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:22:37.573 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:22:37.592 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:22:37.698 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T17:22:37.724 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T17:22:37.824 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:37.850 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:37.975 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:22:37.976 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:22:39.226 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T17:22:39.232 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T17:22:39.648 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T17:22:39.664 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T17:22:39.771 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:22:39.784 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:22:39.840 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:39.849 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:39.967 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:22:39.975 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:22:40.126 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:22:40.159 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:22:40.252 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:22:40.285 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:22:40.437 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:22:40.478 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:22:40.588 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:40.629 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:22:41.132 INFO:teuthology.orchestra.run.smithi139.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T17:22:41.144 INFO:teuthology.orchestra.run.smithi176.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T17:22:41.160 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T17:22:41.179 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T17:22:41.233 INFO:teuthology.orchestra.run.smithi139.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:22:41.233 INFO:teuthology.orchestra.run.smithi139.stdout:This user must also own the server process. 2024-09-13T17:22:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:41.234 INFO:teuthology.orchestra.run.smithi139.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:22:41.234 INFO:teuthology.orchestra.run.smithi139.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:22:41.234 INFO:teuthology.orchestra.run.smithi139.stdout:The default text search configuration will be set to "english". 2024-09-13T17:22:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:41.235 INFO:teuthology.orchestra.run.smithi139.stdout:Data page checksums are disabled. 2024-09-13T17:22:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:41.235 INFO:teuthology.orchestra.run.smithi139.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T17:22:41.237 INFO:teuthology.orchestra.run.smithi139.stdout:creating subdirectories ... ok 2024-09-13T17:22:41.237 INFO:teuthology.orchestra.run.smithi139.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout:This user must also own the server process. 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout:The default text search configuration will be set to "english". 2024-09-13T17:22:41.247 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:41.248 INFO:teuthology.orchestra.run.smithi176.stdout:Data page checksums are disabled. 2024-09-13T17:22:41.248 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:41.248 INFO:teuthology.orchestra.run.smithi176.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T17:22:41.250 INFO:teuthology.orchestra.run.smithi176.stdout:creating subdirectories ... ok 2024-09-13T17:22:41.251 INFO:teuthology.orchestra.run.smithi176.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:22:41.273 INFO:teuthology.orchestra.run.smithi139.stdout:selecting default max_connections ... 100 2024-09-13T17:22:41.290 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default max_connections ... 100 2024-09-13T17:22:41.320 INFO:teuthology.orchestra.run.smithi139.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:22:41.333 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:22:41.343 INFO:teuthology.orchestra.run.smithi139.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:22:41.344 INFO:teuthology.orchestra.run.smithi139.stdout:creating configuration files ... ok 2024-09-13T17:22:41.354 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:22:41.355 INFO:teuthology.orchestra.run.smithi176.stdout:creating configuration files ... ok 2024-09-13T17:22:41.529 INFO:teuthology.orchestra.run.smithi139.stdout:running bootstrap script ... ok 2024-09-13T17:22:41.531 INFO:teuthology.orchestra.run.smithi176.stdout:running bootstrap script ... ok 2024-09-13T17:22:42.143 INFO:teuthology.orchestra.run.smithi139.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:22:42.172 INFO:teuthology.orchestra.run.smithi176.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:22:42.696 INFO:teuthology.orchestra.run.smithi176.stdout:syncing data to disk ... ok 2024-09-13T17:22:42.696 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:42.696 INFO:teuthology.orchestra.run.smithi176.stdout:Success. You can now start the database server using: 2024-09-13T17:22:42.697 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:42.697 INFO:teuthology.orchestra.run.smithi176.stdout: pg_ctlcluster 12 main start 2024-09-13T17:22:42.697 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:42.953 INFO:teuthology.orchestra.run.smithi139.stdout:syncing data to disk ... ok 2024-09-13T17:22:42.953 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:42.953 INFO:teuthology.orchestra.run.smithi139.stdout:Success. You can now start the database server using: 2024-09-13T17:22:42.953 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:42.953 INFO:teuthology.orchestra.run.smithi139.stdout: pg_ctlcluster 12 main start 2024-09-13T17:22:42.953 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:43.285 INFO:teuthology.orchestra.run.smithi176.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T17:22:43.285 INFO:teuthology.orchestra.run.smithi176.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T17:22:43.495 INFO:teuthology.orchestra.run.smithi139.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T17:22:43.495 INFO:teuthology.orchestra.run.smithi139.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T17:22:43.495 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:22:43.706 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:22:47.195 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:47.320 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:47.403 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:47.446 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T17:22:47.537 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:47.648 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:47.663 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T17:22:47.773 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:22:47.873 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:47.900 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:47.999 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:22:48.125 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout:- enp3s0f1 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:22:49.130 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:22:49.333 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:49.333 INFO:teuthology.orchestra.run.smithi139.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:22:49.333 INFO:teuthology.orchestra.run.smithi139.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:22:49.333 INFO:teuthology.orchestra.run.smithi139.stdout:- enp3s0f1 2024-09-13T17:22:49.333 INFO:teuthology.orchestra.run.smithi139.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:22:49.333 INFO:teuthology.orchestra.run.smithi139.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:22:49.334 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:22:49.365 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:22:49.565 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:22:49.893 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:22:50.096 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:22:50.901 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:22:51.065 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:22:51.861 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:51.986 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:22:51.987 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T17:22:52.120 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T17:22:52.180 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:52.297 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:22:52.314 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:22:52.440 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T17:22:52.464 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:22:52.590 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T17:22:52.591 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:52.717 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:52.843 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:52.941 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:53.068 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:22:53.186 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:22:53.186 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:22:53.218 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:22:53.538 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:22:53.538 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:22:54.178 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T17:22:54.321 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:22:54.455 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:22:54.495 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T17:22:54.605 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:22:54.623 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:22:54.739 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:22:54.932 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:22:55.133 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:22:55.417 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:23:07.853 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T17:23:07.961 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T17:23:08.062 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T17:23:08.203 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T17:23:09.169 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:23:09.178 DEBUG:teuthology.parallel:result is None 2024-09-13T17:23:09.435 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:23:09.443 DEBUG:teuthology.parallel:result is None 2024-09-13T17:23:09.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:23:09.596 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:23:09.636 INFO:teuthology.orchestra.run.smithi139.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T17:23:09.637 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:23:09.637 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T17:23:09.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:23:09.785 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:23:09.821 INFO:teuthology.orchestra.run.smithi176.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T17:23:09.822 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:23:09.822 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T17:23:09.824 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:23:09.824 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:09.824 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:23:09.855 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:09.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:23:09.899 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:23:09.900 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:09.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:23:09.933 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:23:10.012 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:10.013 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:23:10.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:23:10.160 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:23:10.161 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:10.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:23:10.197 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:23:10.274 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:10.275 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:23:10.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:23:10.385 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:23:10.386 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:10.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:23:10.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:23:10.499 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:10.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:23:10.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:23:10.603 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T17:23:10.689 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T17:23:10.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-09-13T17:23:10.695 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-13T17:23:10.728 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T17:23:10.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:23:10.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:23:10.802 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T17:23:10.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:23:10.841 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:23:10.880 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T17:23:10.880 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T17:23:10.880 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T17:23:10.880 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:10.881 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:23:10.929 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:11.049 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:11.049 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:23:11.067 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:11.192 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T17:23:11.192 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T17:23:11.193 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap_schedule_snapdir}', 'email': None, 'first_in_suite': False, 'job_id': '7903883', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'snapdirname': '.customsnapkernel', 'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T17:23:11.193 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:23:11.199 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:23:11.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:23:11.257 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:23:11.291 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:11.291 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:23:11.343 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:23:11.343 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-13T17:23:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:23:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:11.404 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 494 Links: 1 2024-09-13T17:23:11.404 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:11.404 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 17:17:47.424373325 +0000 2024-09-13T17:23:11.404 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 17:17:47.084381166 +0000 2024-09-13T17:23:11.404 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 17:17:47.084381166 +0000 2024-09-13T17:23:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T17:23:11.405 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:23:11.474 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T17:23:11.474 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T17:23:11.474 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000706181 s, 725 kB/s 2024-09-13T17:23:11.476 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:23:11.548 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-13T17:23:11.607 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:23:11.607 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:11.607 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 499 Links: 1 2024-09-13T17:23:11.608 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:11.608 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 17:17:48.080358197 +0000 2024-09-13T17:23:11.608 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 17:17:47.764365483 +0000 2024-09-13T17:23:11.608 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 17:17:47.764365483 +0000 2024-09-13T17:23:11.608 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T17:23:11.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:23:11.683 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T17:23:11.684 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T17:23:11.684 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000577321 s, 887 kB/s 2024-09-13T17:23:11.686 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:23:11.753 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 505 Links: 1 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 17:17:48.400350818 +0000 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 17:17:48.396350910 +0000 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 17:17:48.396350910 +0000 2024-09-13T17:23:11.814 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T17:23:11.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:23:11.890 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T17:23:11.890 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T17:23:11.890 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000660259 s, 775 kB/s 2024-09-13T17:23:11.892 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:23:11.960 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-13T17:23:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:23:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:12.024 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 514 Links: 1 2024-09-13T17:23:12.024 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:12.025 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 17:17:49.372328403 +0000 2024-09-13T17:23:12.025 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 17:17:49.036336150 +0000 2024-09-13T17:23:12.025 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 17:17:49.036336150 +0000 2024-09-13T17:23:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T17:23:12.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:23:12.098 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T17:23:12.098 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T17:23:12.098 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000532997 s, 961 kB/s 2024-09-13T17:23:12.101 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:23:12.168 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:12.168 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:12.168 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:23:12.185 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:23:12.186 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-13T17:23:12.247 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:23:12.248 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:12.248 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 497 Links: 1 2024-09-13T17:23:12.248 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:12.248 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-13 17:17:38.532064029 +0000 2024-09-13T17:23:12.248 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-13 17:17:38.220071223 +0000 2024-09-13T17:23:12.249 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-13 17:17:38.220071223 +0000 2024-09-13T17:23:12.249 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-13T17:23:12.249 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:23:12.322 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-13T17:23:12.322 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-13T17:23:12.322 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000688032 s, 744 kB/s 2024-09-13T17:23:12.324 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:23:12.393 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-13T17:23:12.456 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:23:12.456 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:12.456 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 503 Links: 1 2024-09-13T17:23:12.457 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:12.457 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-13 17:17:39.172049269 +0000 2024-09-13T17:23:12.457 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-13 17:17:38.864056373 +0000 2024-09-13T17:23:12.457 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-13 17:17:38.864056373 +0000 2024-09-13T17:23:12.457 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-13T17:23:12.457 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:23:12.532 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-13T17:23:12.533 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-13T17:23:12.533 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000687796 s, 744 kB/s 2024-09-13T17:23:12.535 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:23:12.601 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-13T17:23:12.662 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:23:12.662 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:12.662 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 509 Links: 1 2024-09-13T17:23:12.663 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:12.663 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-13 17:17:39.516041336 +0000 2024-09-13T17:23:12.663 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-13 17:17:39.512041429 +0000 2024-09-13T17:23:12.663 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-13 17:17:39.512041429 +0000 2024-09-13T17:23:12.663 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-13T17:23:12.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:23:12.737 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-13T17:23:12.737 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-13T17:23:12.737 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000664963 s, 770 kB/s 2024-09-13T17:23:12.739 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:23:12.805 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-13T17:23:12.865 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:23:12.865 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:23:12.865 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 517 Links: 1 2024-09-13T17:23:12.865 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:23:12.865 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-13 17:17:40.528017999 +0000 2024-09-13T17:23:12.865 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-13 17:17:40.208025378 +0000 2024-09-13T17:23:12.866 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-13 17:17:40.208025378 +0000 2024-09-13T17:23:12.866 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-13T17:23:12.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:23:12.939 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-13T17:23:12.939 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-13T17:23:12.940 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000597412 s, 857 kB/s 2024-09-13T17:23:12.941 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:23:13.009 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:13.010 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:23:13.010 INFO:tasks.ceph:Generating config... 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] client snapdir = .customsnapfuse 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] pid file = 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T17:23:13.011 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T17:23:13.011 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T17:23:13.011 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T17:23:13.012 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T17:23:13.013 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T17:23:13.013 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T17:23:13.013 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T17:23:13.013 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T17:23:13.014 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T17:23:13.014 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T17:23:13.014 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T17:23:13.014 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T17:23:13.014 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T17:23:13.078 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T17:23:13.098 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T17:23:13.171 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:23:13.200 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.139'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-09-13T17:23:13.201 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.139,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T17:23:13.202 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:13.202 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:23:13.262 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.139 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:13.373 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:13.373 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: generated fsid a6cff629-1d3c-470e-abc7-14e2fbc4e0ad 2024-09-13T17:23:13.373 INFO:teuthology.orchestra.run.smithi139.stdout:setting min_mon_release = pacific 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 0 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:fsid a6cff629-1d3c-470e-abc7-14e2fbc4e0ad 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:last_changed 2024-09-13T17:23:13.372885+0000 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:created 2024-09-13T17:23:13.372885+0000 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:min_mon_release 16 (pacific) 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:election_strategy: 1 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:0: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.a 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-09-13T17:23:13.374 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T17:23:13.377 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:23:13.394 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a6cff629-1d3c-470e-abc7-14e2fbc4e0ad... 2024-09-13T17:23:13.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:23:13.440 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-09-13T17:23:13.504 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:23:13.505 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-09-13T17:23:13.506 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.139,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on skipped message = False 2024-09-13T17:23:13.507 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = a6cff629-1d3c-470e-abc7-14e2fbc4e0ad 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.508 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-09-13T17:23:13.509 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-09-13T17:23:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-13T17:23:13.511 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-09-13T17:23:13.512 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:23:13.513 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on pool no app = False 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-09-13T17:23:13.514 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: client snapdir = .customsnapfuse 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = "" 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 900 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 900 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2024-09-13T17:23:13.515 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds balancer = 20 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2024-09-13T17:23:13.516 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 900 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 900 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.517 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-13T17:23:13.518 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-13T17:23:13.519 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.520 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.139,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = a6cff629-1d3c-470e-abc7-14e2fbc4e0ad 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-13T17:23:13.521 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-13T17:23:13.522 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:23:13.523 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-13T17:23:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-13T17:23:13.525 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-13T17:23:13.526 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.527 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:23:13.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on pool no app = False 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-13T17:23:13.529 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: client snapdir = .customsnapfuse 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-13T17:23:13.530 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-09-13T17:23:13.531 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-13T17:23:13.532 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-13T17:23:13.537 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T17:23:13.537 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T17:23:13.627 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T17:23:13.627 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:13.627 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T17:23:13.643 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:13.643 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T17:23:13.705 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:23:13.705 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:13.705 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:23:13.705 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:23:13.807 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:13.807 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:13.865 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:23:13.866 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:13.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:23:13.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:23:13.923 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:13.924 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:13.986 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T17:23:13.986 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T17:23:13.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:23:14.079 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:23:14.088 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:23:14.178 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:23:14.197 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T17:23:14.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:23:14.296 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:23:14.305 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T17:23:14.337 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:23:14.477 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:23:14.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T17:23:14.515 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:23:14.619 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:23:14.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T17:23:14.658 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:23:14.798 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:23:14.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T17:23:14.836 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T17:23:14.837 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:23:14.909 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T17:23:14.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T17:23:15.000 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T17:23:15.030 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T17:23:15.108 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T17:23:15.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T17:23:15.204 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T17:23:15.233 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T17:23:15.233 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:23:15.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T17:23:15.271 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:15.271 INFO:tasks.ceph:role: osd.0 2024-09-13T17:23:15.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:23:15.271 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:23:15.876 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:15.876 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:15.877 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:15.881 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T17:23:15.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T17:23:16.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T17:23:16.031 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:16.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:16.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T17:23:16.106 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:16.107 INFO:tasks.ceph:role: osd.1 2024-09-13T17:23:16.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:23:16.107 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:23:16.626 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:16.627 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:16.631 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T17:23:16.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T17:23:16.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T17:23:16.721 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:16.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:16.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T17:23:16.800 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:16.801 INFO:tasks.ceph:role: osd.2 2024-09-13T17:23:16.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:23:16.801 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:17.359 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:17.360 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:17.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T17:23:17.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T17:23:17.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T17:23:17.511 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:17.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:17.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T17:23:17.599 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:17.599 INFO:tasks.ceph:role: osd.3 2024-09-13T17:23:17.599 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:23:17.599 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:18.167 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:18.167 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:18.167 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:18.169 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T17:23:18.170 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T17:23:18.297 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T17:23:18.320 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:18.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:18.322 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:18.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:18.465+0000 7f3887b13880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T17:23:18.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:18.469+0000 7f3887b13880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T17:23:18.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:18.469+0000 7f3887b13880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:23:18.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:18.469+0000 7f3887b13880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:23:18.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:18.469+0000 7f3887b13880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:23:18.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:18.473+0000 7f3887b13880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T17:23:21.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:23:21.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:21.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:21.737+0000 7f83095b2880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T17:23:21.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:21.741+0000 7f83095b2880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T17:23:21.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:21.741+0000 7f83095b2880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:23:21.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:21.741+0000 7f83095b2880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:23:21.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:21.741+0000 7f83095b2880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:23:21.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:21.741+0000 7f83095b2880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T17:23:24.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:23:24.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:25.001+0000 7f3505cb4880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T17:23:25.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:25.001+0000 7f3505cb4880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T17:23:25.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:25.001+0000 7f3505cb4880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:23:25.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:25.001+0000 7f3505cb4880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:23:25.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:25.001+0000 7f3505cb4880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:23:25.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:25.005+0000 7f3505cb4880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T17:23:28.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:23:28.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:28.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:28.265+0000 7fcb5b554880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T17:23:28.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:28.265+0000 7fcb5b554880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T17:23:28.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:28.265+0000 7fcb5b554880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:23:28.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:28.265+0000 7fcb5b554880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:23:28.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:28.265+0000 7fcb5b554880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:23:28.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:28.269+0000 7fcb5b554880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T17:23:31.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:23:31.390 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T17:23:31.429 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:31.429 INFO:tasks.ceph:role: osd.4 2024-09-13T17:23:31.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:23:31.430 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:23:32.026 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:32.026 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:32.026 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:32.026 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2024-09-13T17:23:32.026 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:32.027 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:32.027 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:32.027 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:32.027 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:32.027 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:32.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-13T17:23:32.031 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T17:23:32.161 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T17:23:32.181 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:32.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:32.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T17:23:32.269 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:32.269 INFO:tasks.ceph:role: osd.5 2024-09-13T17:23:32.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:23:32.269 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:23:32.782 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:32.783 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:32.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-13T17:23:32.788 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T17:23:32.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T17:23:32.868 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:32.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:32.870 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T17:23:32.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:32.946 INFO:tasks.ceph:role: osd.6 2024-09-13T17:23:32.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:23:32.947 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:23:33.512 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:33.512 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:33.512 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:33.512 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2024-09-13T17:23:33.512 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:33.512 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:33.513 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:33.513 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:33.513 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:33.513 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:33.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-13T17:23:33.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T17:23:33.610 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T17:23:33.632 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:33.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:33.634 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T17:23:33.712 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:23:33.713 INFO:tasks.ceph:role: osd.7 2024-09-13T17:23:33.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:23:33.713 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:23:34.299 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:23:34.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-13T17:23:34.306 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T17:23:34.438 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T17:23:34.458 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:23:34.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:23:34.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:34.615 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:34.612+0000 7f745e681880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T17:23:34.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:34.612+0000 7f745e681880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T17:23:34.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:34.612+0000 7f745e681880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:23:34.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:34.612+0000 7f745e681880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:23:34.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:34.612+0000 7f745e681880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:23:34.622 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:34.616+0000 7f745e681880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T17:23:37.701 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:23:37.735 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:37.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:37.852+0000 7f9119ab2880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T17:23:37.859 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:37.856+0000 7f9119ab2880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T17:23:37.859 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:37.856+0000 7f9119ab2880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:23:37.860 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:37.856+0000 7f9119ab2880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:23:37.860 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:37.856+0000 7f9119ab2880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:23:37.862 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:37.860+0000 7f9119ab2880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T17:23:40.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:23:41.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:41.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:41.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:23:41.277 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:41.272+0000 7f12fe109880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T17:23:41.278 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:41.276+0000 7f12fe109880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T17:23:41.279 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:41.276+0000 7f12fe109880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:23:41.279 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:41.276+0000 7f12fe109880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:23:41.279 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:41.276+0000 7f12fe109880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:23:41.281 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:41.276+0000 7f12fe109880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T17:23:44.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T17:23:44.424 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:44.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:44.548+0000 7f090e1d9880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T17:23:44.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:44.552+0000 7f090e1d9880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T17:23:44.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:44.552+0000 7f090e1d9880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:23:44.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:44.552+0000 7f090e1d9880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:23:44.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:44.552+0000 7f090e1d9880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:23:44.558 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:44.552+0000 7f090e1d9880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T17:23:47.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T17:23:47.702 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T17:23:47.703 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:47.703 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T17:23:47.740 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:47.740 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T17:23:47.820 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:47.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T17:23:47.895 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:47.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T17:23:47.967 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:47.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T17:23:48.040 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:48.040 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T17:23:48.117 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:48.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T17:23:48.197 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.197 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T17:23:48.231 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.232 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T17:23:48.305 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T17:23:48.381 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.381 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T17:23:48.453 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.453 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T17:23:48.525 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.525 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T17:23:48.596 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.597 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T17:23:48.668 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:48.668 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T17:23:48.687 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:48.687 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T17:23:48.750 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.750 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T17:23:48.766 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:48.766 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T17:23:48.832 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T17:23:48.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:23:48.838 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:23:48.884 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2024-09-13T17:23:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRm+gG2BBAAGYqsMaxu2yCriuAaJF5Nig== 2024-09-13T17:23:48.884 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-09-13T17:23:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRmdOWfERAAyhpOow7qplI6Bxgch9MGPQ== 2024-09-13T17:23:48.884 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRmmc1tHBAAHwemx+1QjSg+Op9OzzJaUA== 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAGdeRm/oUnHBAA+2zsuZpm9UqYzVejEITiAQ== 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAJdeRm4nVTLBAAzilrc5cH75EoI2QCW1zn4Q== 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQANdeRm6dxMABAAQQ61mLSrFZwLTJ2mx/7jpA== 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAQdeRmtPMFEBAAiHsBV8RND4X17wBahgOi0w== 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRma/eBChAAuz690AoAtsDoQp2Y4/VTBA== 2024-09-13T17:23:48.885 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRmYi2+JBAAB+vmJElMfVLbLYxNDuKhYQ== 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRmk69qLxAA5swhp2q2a9P4bqO6PY8mXA== 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAWdeRmKLeMJBAA7mzaA4rfcGjWXt8tm7/7wA== 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAZdeRmXfYEMxAA8tlgIdirlWCznRgJ0Dybyg== 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2024-09-13T17:23:48.886 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAddeRmfGZ1EBAAlrePafDoL2vr8pQXoVfUDg== 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAgdeRmPS/zIBAASms2uvvAsBcnrL3gDs5/4A== 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRmbiwnNhAAh3aNnIynrEu4YvbqINN2gg== 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:[client.2] 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQACdeRmsSKaOxAAhADsLSIYCa52g/d4zedsJA== 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:[client.1] 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQADdeRmyhpKBhAAFX7reIfFLnR9R40is1zNEg== 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:[client.3] 2024-09-13T17:23:48.887 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQADdeRmeTgIDBAAH5kdeKK4O/pGLodaEj1nQQ== 2024-09-13T17:23:48.906 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-09-13T17:23:48.906 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRm+gG2BBAAGYqsMaxu2yCriuAaJF5Nig== 2024-09-13T17:23:48.906 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-13T17:23:48.906 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRmdOWfERAAyhpOow7qplI6Bxgch9MGPQ== 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRmmc1tHBAAHwemx+1QjSg+Op9OzzJaUA== 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAGdeRm/oUnHBAA+2zsuZpm9UqYzVejEITiAQ== 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAJdeRm4nVTLBAAzilrc5cH75EoI2QCW1zn4Q== 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQANdeRm6dxMABAAQQ61mLSrFZwLTJ2mx/7jpA== 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAQdeRmtPMFEBAAiHsBV8RND4X17wBahgOi0w== 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-09-13T17:23:48.907 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRma/eBChAAuz690AoAtsDoQp2Y4/VTBA== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRmYi2+JBAAB+vmJElMfVLbLYxNDuKhYQ== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRmk69qLxAA5swhp2q2a9P4bqO6PY8mXA== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAWdeRmKLeMJBAA7mzaA4rfcGjWXt8tm7/7wA== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAZdeRmXfYEMxAA8tlgIdirlWCznRgJ0Dybyg== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAddeRmfGZ1EBAAlrePafDoL2vr8pQXoVfUDg== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAgdeRmPS/zIBAASms2uvvAsBcnrL3gDs5/4A== 2024-09-13T17:23:48.908 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRmbiwnNhAAh3aNnIynrEu4YvbqINN2gg== 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQACdeRmsSKaOxAAhADsLSIYCa52g/d4zedsJA== 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQADdeRmyhpKBhAAFX7reIfFLnR9R40is1zNEg== 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-09-13T17:23:48.909 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQADdeRmeTgIDBAAH5kdeKK4O/pGLodaEj1nQQ== 2024-09-13T17:23:48.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:23:48.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:23:49.045 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.051 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.133 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.225 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.306 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.310 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.390 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.395 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.473 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.560 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:23:49.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:23:49.643 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.649 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.734 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:23:49.822 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:49.921 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:50.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:50.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:50.084 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:50.089 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:23:50.168 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.349 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.447 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:23:50.534 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T17:23:50.535 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T17:23:50.565 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:23:50.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T17:23:50.740 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T17:23:50.775 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:23:50.918 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T17:23:50.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T17:23:51.020 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:23:51.159 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T17:23:51.191 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:51.196 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:23:51.249 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T17:23:51.249 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T17:23:51.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T17:23:51.261 INFO:tasks.ceph.mon.a:Started 2024-09-13T17:23:51.262 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T17:23:51.262 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T17:23:51.299 INFO:tasks.ceph.mon.b:Started 2024-09-13T17:23:51.299 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T17:23:51.300 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T17:23:51.304 INFO:tasks.ceph.mon.c:Started 2024-09-13T17:23:51.304 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T17:23:51.305 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T17:23:51.305 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T17:23:51.316 INFO:tasks.ceph.mgr.y:Started 2024-09-13T17:23:51.317 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T17:23:51.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T17:23:51.326 INFO:tasks.ceph.mgr.x:Started 2024-09-13T17:23:51.326 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T17:23:51.326 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T17:23:51.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f0611c00700 1 Processor -- start 2024-09-13T17:23:51.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f0611c00700 1 -- start start 2024-09-13T17:23:51.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f0611c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 0x7f060c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f0611c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0b6340 con 0x7f060c15ab30 2024-09-13T17:23:51.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f0611c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0b3de0 con 0x7f060c15af10 2024-09-13T17:23:51.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f0611c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c06f730 con 0x7f060c15f530 2024-09-13T17:23:51.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f060aa00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f060c15ab30 0x7f060c0b5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47374/0 (socket says 172.21.15.139:47374) 2024-09-13T17:23:51.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.485+0000 7f060aa00700 1 -- 172.21.15.139:0/15902439 learned_addr learned my addr 172.21.15.139:0/15902439 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:23:51.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.489+0000 7f060b400700 1 --2- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 0x7f060c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.489+0000 7f060b400700 1 -- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 msgr2=0x7f060c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:23:51.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.489+0000 7f060b400700 1 -- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 msgr2=0x7f060c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:23:51.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.489+0000 7f060b400700 1 --2- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 0x7f060c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:23:51.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.489+0000 7f060b400700 1 --2- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 0x7f060c0d0d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:23:51.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731527155 0 0) 0x7f060c0b6340 con 0x7f060c15ab30 2024-09-13T17:23:51.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f00035d0 con 0x7f060c15ab30 2024-09-13T17:23:51.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339140265 0 0) 0x7f060c0b3de0 con 0x7f060c15af10 2024-09-13T17:23:51.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f060c0b6340 con 0x7f060c15af10 2024-09-13T17:23:51.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184076972 0 0) 0x7f05f00035d0 con 0x7f060c15ab30 2024-09-13T17:23:51.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 msgr2=0x7f060c0d0d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:23:51.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 --2- 172.21.15.139:0/15902439 >> v2:172.21.15.176:3300/0 conn(0x7f060c15f530 0x7f060c0d0d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 >> v1:172.21.15.176:6789/0 conn(0x7f060c15af10 legacy=0x7f060c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c06fa10 con 0x7f060c15ab30 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f05f8001690 con 0x7f060c15ab30 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 >> v1:172.21.15.139:6789/0 conn(0x7f060c15ab30 legacy=0x7f060c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05f0004c10 0x7f05f0005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05f0003810 0x7f05f0003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f00042f0 0x7f05f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c06f730 con 0x7f05f0004c10 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f000c2a0 con 0x7f05f00042f0 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f000c460 con 0x7f05f0003810 2024-09-13T17:23:51.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05f0004c10 0x7f05f0005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060a000700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05f0003810 0x7f05f0003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060b400700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f00042f0 0x7f05f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 -- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05f0003810 msgr2=0x7f05f0003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:51.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05f0003810 0x7f05f0003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 -- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f00042f0 msgr2=0x7f05f000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:51.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f00042f0 0x7f05f000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 -- 172.21.15.139:0/15902439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00035d0 con 0x7f05f0004c10 2024-09-13T17:23:51.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060b400700 1 -- 172.21.15.139:0/15902439 reap_dead start 2024-09-13T17:23:51.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.645+0000 7f060aa00700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05f0004c10 0x7f05f0005010 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f05f8001eb0 tx=0x7f05f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb60a955c09b1451 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:51.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800cd50 con 0x7f05f0004c10 2024-09-13T17:23:51.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8005980 con 0x7f05f0004c10 2024-09-13T17:23:51.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0609600700 1 -- 172.21.15.139:0/15902439 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8005d30 con 0x7f05f0004c10 2024-09-13T17:23:51.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 -- 172.21.15.139:0/15902439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05f0004c10 msgr2=0x7f05f0005010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:51.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05f0004c10 0x7f05f0005010 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f05f8001eb0 tx=0x7f05f00058a0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 -- 172.21.15.139:0/15902439 shutdown_connections 2024-09-13T17:23:51.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 --2- 172.21.15.139:0/15902439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05f0004c10 0x7f05f0005010 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 -- 172.21.15.139:0/15902439 >> 172.21.15.139:0/15902439 conn(0x7f060c06a390 msgr2=0x7f060c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:51.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 -- 172.21.15.139:0/15902439 shutdown_connections 2024-09-13T17:23:51.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.649+0000 7f0611c00700 1 -- 172.21.15.139:0/15902439 wait complete. 2024-09-13T17:23:51.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.653+0000 7f0611c00700 1 Processor -- start 2024-09-13T17:23:51.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.653+0000 7f0611c00700 1 -- start start 2024-09-13T17:23:51.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f0004c10 0x7f060c1f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f060c14cfb0 0x7f060c1f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f060c0c7640 0x7f060c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c1f4bd0 con 0x7f060c0c7640 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c1f4610 con 0x7f05f0004c10 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c1f48f0 con 0x7f060c14cfb0 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060aa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f0004c10 0x7f060c1f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060aa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f0004c10 0x7f060c1f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:44884/0 (socket says 172.21.15.139:44884) 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060aa00700 1 -- 172.21.15.139:0/71019901 learned_addr learned my addr 172.21.15.139:0/71019901 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060a000700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f060c14cfb0 0x7f060c1f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f060c0c7640 0x7f060c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 -- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f060c14cfb0 msgr2=0x7f060c1f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:51.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f060c14cfb0 0x7f060c1f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 -- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f0004c10 msgr2=0x7f060c1f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f0004c10 0x7f060c1f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 -- 172.21.15.139:0/71019901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0c6e40 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f060b400700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f060c0c7640 0x7f060c15c800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f060c15f910 tx=0x7f060400f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604009ea0 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0604003a40 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c0c7120 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604003e30 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c1f43e0 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f060400f940 con 0x7f060c0c7640 2024-09-13T17:23:51.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.657+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f060400a030 con 0x7f060c0c7640 2024-09-13T17:23:51.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.661+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c1f4a30 con 0x7f060c0c7640 2024-09-13T17:23:51.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.665+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f060c1f4a30 con 0x7f060c0c7640 2024-09-13T17:23:51.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.737+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f060c0cf340 con 0x7f060c0c7640 2024-09-13T17:23:51.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.741+0000 7f0602a00700 1 -- 172.21.15.139:0/71019901 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f060401a070 con 0x7f060c0c7640 2024-09-13T17:23:51.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.741+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f060c0c7640 msgr2=0x7f060c15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:51.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.741+0000 7f0611c00700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f060c0c7640 0x7f060c15c800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f060c15f910 tx=0x7f060400f430 comp rx=0 tx=0).stop 2024-09-13T17:23:51.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 shutdown_connections 2024-09-13T17:23:51.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f060c0c7640 0x7f060c15c800 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f060c14cfb0 0x7f060c1f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 --2- 172.21.15.139:0/71019901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05f0004c10 0x7f060c1f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:51.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 >> 172.21.15.139:0/71019901 conn(0x7f060c06a390 msgr2=0x7f060c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:51.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 shutdown_connections 2024-09-13T17:23:51.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:51.745+0000 7f0611c00700 1 -- 172.21.15.139:0/71019901 wait complete. 2024-09-13T17:23:51.750 INFO:teuthology.orchestra.run.smithi139.stderr:adjusted tunables profile to default 2024-09-13T17:23:51.769 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T17:23:51.769 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T17:23:51.769 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:51.770 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T17:23:51.801 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:51.801 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T17:23:51.870 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:51.871 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T17:23:51.896 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:51.892+0000 7f92237422c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:23:51.906 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:51.901+0000 7fb224e2e2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:23:51.940 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:23:51.941 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T17:23:52.019 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:52.019 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T17:23:52.054 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:52.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T17:23:52.131 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:52.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T17:23:52.208 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:23:52.208 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T17:23:52.283 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new f01ef42c-c08f-41a3-bb77-5874545218d9 0 2024-09-13T17:23:52.493 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.488+0000 7f226ec00700 1 Processor -- start 2024-09-13T17:23:52.493 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.488+0000 7f226ec00700 1 -- start start 2024-09-13T17:23:52.495 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f226ec00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f226815af10 0x7f22680cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.495 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f226ec00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680b6340 con 0x7f226815ab30 2024-09-13T17:23:52.495 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f226ec00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680b3de0 con 0x7f226815f530 2024-09-13T17:23:52.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f226ec00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226806f730 con 0x7f226815af10 2024-09-13T17:23:52.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f226815af10 0x7f22680cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f226815af10 0x7f22680cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36410/0 (socket says 172.21.15.176:36410) 2024-09-13T17:23:52.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 -- 172.21.15.176:0/425716700 learned_addr learned my addr 172.21.15.176:0/425716700 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:52.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 -- 172.21.15.176:0/425716700 >> v1:172.21.15.176:6789/0 conn(0x7f226815f530 legacy=0x7f22680d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 -- 172.21.15.176:0/425716700 >> v1:172.21.15.139:6789/0 conn(0x7f226815ab30 legacy=0x7f22680b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 -- 172.21.15.176:0/425716700 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226806fa10 con 0x7f226815af10 2024-09-13T17:23:52.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2267400700 1 --2- 172.21.15.176:0/425716700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815af10 0x7f22680cf340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2254009910 tx=0x7f2254009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fcc2a99cad2d970 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:52.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2266a00700 1 -- 172.21.15.176:0/425716700 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400ba60 con 0x7f226815af10 2024-09-13T17:23:52.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2266a00700 1 -- 172.21.15.176:0/425716700 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225400bbc0 con 0x7f226815af10 2024-09-13T17:23:52.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.492+0000 7f2266a00700 1 -- 172.21.15.176:0/425716700 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254009e60 con 0x7f226815af10 2024-09-13T17:23:52.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 -- 172.21.15.176:0/425716700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815af10 msgr2=0x7f22680cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 --2- 172.21.15.176:0/425716700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815af10 0x7f22680cf340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2254009910 tx=0x7f2254009c20 comp rx=0 tx=0).stop 2024-09-13T17:23:52.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 -- 172.21.15.176:0/425716700 shutdown_connections 2024-09-13T17:23:52.499 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 --2- 172.21.15.176:0/425716700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815af10 0x7f22680cf340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.499 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 -- 172.21.15.176:0/425716700 >> 172.21.15.176:0/425716700 conn(0x7f226806a390 msgr2=0x7f226806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:52.499 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 -- 172.21.15.176:0/425716700 shutdown_connections 2024-09-13T17:23:52.499 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 -- 172.21.15.176:0/425716700 wait complete. 2024-09-13T17:23:52.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 Processor -- start 2024-09-13T17:23:52.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.496+0000 7f226ec00700 1 -- start start 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 0x7f22681469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226815af10 0x7f226806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815f530 0x7f22680ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22680b1930 con 0x7f226815af10 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226806d610 con 0x7f226815f530 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226806d8f0 con 0x7f226815ab30 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 0x7f22681469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226cc00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815f530 0x7f22680ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226815af10 0x7f226806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 0x7f22681469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:35314/0 (socket says 172.21.15.176:35314) 2024-09-13T17:23:52.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 -- 172.21.15.176:0/1527404364 learned_addr learned my addr 172.21.15.176:0/1527404364 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 -- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815f530 msgr2=0x7f22680ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815f530 0x7f22680ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 -- 172.21.15.176:0/1527404364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226815af10 msgr2=0x7f226806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226815af10 0x7f226806cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 -- 172.21.15.176:0/1527404364 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254009570 con 0x7f226815ab30 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f2267e00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 0x7f22681469f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f225800c450 tx=0x7f225800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580052d0 con 0x7f226815ab30 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2258005430 con 0x7f226815ab30 2024-09-13T17:23:52.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226806dbd0 con 0x7f226815ab30 2024-09-13T17:23:52.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580055a0 con 0x7f226815ab30 2024-09-13T17:23:52.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2268146f30 con 0x7f226815ab30 2024-09-13T17:23:52.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2258003c00 con 0x7f226815ab30 2024-09-13T17:23:52.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.500+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f225801c780 con 0x7f226815ab30 2024-09-13T17:23:52.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.504+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22680ce680 con 0x7f226815ab30 2024-09-13T17:23:52.512 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.508+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f2258017070 con 0x7f226815ab30 2024-09-13T17:23:52.593 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.588+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f01ef42c-c08f-41a3-bb77-5874545218d9", "id": 0} v 0) v1 -- 0x7f22680cf340 con 0x7f226815ab30 2024-09-13T17:23:52.602 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f225fe00700 1 -- 172.21.15.176:0/1527404364 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f01ef42c-c08f-41a3-bb77-5874545218d9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2258011cc0 con 0x7f226815ab30 2024-09-13T17:23:52.602 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-13T17:23:52.604 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 msgr2=0x7f22681469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.604 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 0x7f22681469f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f225800c450 tx=0x7f225800c760 comp rx=0 tx=0).stop 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 shutdown_connections 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226815f530 0x7f22680ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226815af10 0x7f226806cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 --2- 172.21.15.176:0/1527404364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f226815ab30 0x7f22681469f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 >> 172.21.15.176:0/1527404364 conn(0x7f226806a390 msgr2=0x7f226815e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 shutdown_connections 2024-09-13T17:23:52.605 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.600+0000 7f226ec00700 1 -- 172.21.15.176:0/1527404364 wait complete. 2024-09-13T17:23:52.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 387b9206-8c1a-457c-8126-451235020543 1 2024-09-13T17:23:52.750 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:52.745+0000 7fb224e2e2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:23:52.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 Processor -- start 2024-09-13T17:23:52.787 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 -- start start 2024-09-13T17:23:52.789 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f92237422c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:23:52.789 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5d00155380 0x7f5d0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.790 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d00070e60 0x7f5d00071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.790 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000717b0 con 0x7f5d0015c290 2024-09-13T17:23:52.790 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0006cc30 con 0x7f5d00155380 2024-09-13T17:23:52.790 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000cdc90 con 0x7f5d00070e60 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.784+0000 7f5d05400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d00070e60 0x7f5d00071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5cffe00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f5d0015c290 0x7f5d0015b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:58262/0 (socket says 172.21.15.176:58262) 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5cffe00700 1 -- 172.21.15.176:0/4268323565 learned_addr learned my addr 172.21.15.176:0/4268323565 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d04a00700 1 --2- 172.21.15.176:0/4268323565 >> v2:172.21.15.176:3300/0 conn(0x7f5d00155380 0x7f5d0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05400700 1 -- 172.21.15.176:0/4268323565 >> v2:172.21.15.176:3300/0 conn(0x7f5d00155380 msgr2=0x7f5d0006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05400700 1 --2- 172.21.15.176:0/4268323565 >> v2:172.21.15.176:3300/0 conn(0x7f5d00155380 0x7f5d0006e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5cff400700 1 -- 172.21.15.176:0/4268323565 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978292948 0 0) 0x7f5d000717b0 con 0x7f5d0015c290 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05400700 1 -- 172.21.15.176:0/4268323565 >> v1:172.21.15.176:6789/0 conn(0x7f5d0015c290 legacy=0x7f5d0015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.791 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05400700 1 -- 172.21.15.176:0/4268323565 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0015b900 con 0x7f5d00070e60 2024-09-13T17:23:52.792 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05400700 1 --2- 172.21.15.176:0/4268323565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d00070e60 0x7f5d00071270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009d90 tx=0x7f5cf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2872419428d46c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:52.792 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5cff400700 1 -- 172.21.15.176:0/4268323565 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800e070 con 0x7f5d00070e60 2024-09-13T17:23:52.792 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5cff400700 1 -- 172.21.15.176:0/4268323565 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf800bbd0 con 0x7f5d00070e60 2024-09-13T17:23:52.792 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5cff400700 1 -- 172.21.15.176:0/4268323565 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8012430 con 0x7f5d00070e60 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 -- 172.21.15.176:0/4268323565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d00070e60 msgr2=0x7f5d00071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 --2- 172.21.15.176:0/4268323565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d00070e60 0x7f5d00071270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009d90 tx=0x7f5cf800b330 comp rx=0 tx=0).stop 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 -- 172.21.15.176:0/4268323565 shutdown_connections 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 --2- 172.21.15.176:0/4268323565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d00070e60 0x7f5d00071270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 --2- 172.21.15.176:0/4268323565 >> v2:172.21.15.176:3300/0 conn(0x7f5d00155380 0x7f5d0006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 -- 172.21.15.176:0/4268323565 >> 172.21.15.176:0/4268323565 conn(0x7f5d0006efa0 msgr2=0x7f5d000b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:52.793 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 -- 172.21.15.176:0/4268323565 shutdown_connections 2024-09-13T17:23:52.794 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.788+0000 7f5d05e00700 1 -- 172.21.15.176:0/4268323565 wait complete. 2024-09-13T17:23:52.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.792+0000 7f5d05e00700 1 Processor -- start 2024-09-13T17:23:52.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.792+0000 7f5d05e00700 1 -- start start 2024-09-13T17:23:52.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.792+0000 7f5d05e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d00070e60 0x7f5d00148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.792+0000 7f5d05e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d0015c290 0x7f5d00156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.792+0000 7f5d05e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 0x7f5d000cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:52.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.792+0000 7f5d05e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c9640 con 0x7f5d00070e60 2024-09-13T17:23:52.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001578e0 con 0x7f5d00157450 2024-09-13T17:23:52.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00157bc0 con 0x7f5d0015c290 2024-09-13T17:23:52.799 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 0x7f5d000cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.799 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 0x7f5d000cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36430/0 (socket says 172.21.15.176:36430) 2024-09-13T17:23:52.799 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 -- 172.21.15.176:0/542925338 learned_addr learned my addr 172.21.15.176:0/542925338 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:52.799 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5cffe00700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d0015c290 0x7f5d00156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d04a00700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d00070e60 0x7f5d00148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 -- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d0015c290 msgr2=0x7f5d00156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d0015c290 0x7f5d00156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 -- 172.21.15.176:0/542925338 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d00070e60 msgr2=0x7f5d00148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d00070e60 0x7f5d00148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 -- 172.21.15.176:0/542925338 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8009a70 con 0x7f5d00157450 2024-09-13T17:23:52.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05400700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 0x7f5d000cb920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d00071960 tx=0x7f5cf8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8012430 con 0x7f5d00157450 2024-09-13T17:23:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8020070 con 0x7f5d00157450 2024-09-13T17:23:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d00157ea0 con 0x7f5d00157450 2024-09-13T17:23:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8004280 con 0x7f5d00157450 2024-09-13T17:23:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d00148dd0 con 0x7f5d00157450 2024-09-13T17:23:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5cf80046e0 con 0x7f5d00157450 2024-09-13T17:23:52.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5cf8022070 con 0x7f5d00157450 2024-09-13T17:23:52.802 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.796+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d000c9780 con 0x7f5d00157450 2024-09-13T17:23:52.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.800+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5cf8046e30 con 0x7f5d00157450 2024-09-13T17:23:52.828 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:52.821+0000 7fb224e2e2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:23:52.878 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:52.872+0000 7f92237422c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:23:52.882 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.880+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "387b9206-8c1a-457c-8126-451235020543", "id": 1} v 0) v1 -- 0x7f5d0006e320 con 0x7f5d00157450 2024-09-13T17:23:52.893 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.888+0000 7f5cfcc00700 1 -- 172.21.15.176:0/542925338 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "387b9206-8c1a-457c-8126-451235020543", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5cf8035030 con 0x7f5d00157450 2024-09-13T17:23:52.894 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-13T17:23:52.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 msgr2=0x7f5d000cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:52.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 0x7f5d000cb920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d00071960 tx=0x7f5cf8004af0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 shutdown_connections 2024-09-13T17:23:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d00157450 0x7f5d000cb920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d0015c290 0x7f5d00156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 --2- 172.21.15.176:0/542925338 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d00070e60 0x7f5d00148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 >> 172.21.15.176:0/542925338 conn(0x7f5d0006efa0 msgr2=0x7f5d0015afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 shutdown_connections 2024-09-13T17:23:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:52.892+0000 7f5d05e00700 1 -- 172.21.15.176:0/542925338 wait complete. 2024-09-13T17:23:52.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849 2 2024-09-13T17:23:53.037 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:53.033+0000 7fb224e2e2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:23:53.126 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.120+0000 7f3b07e00700 1 Processor -- start 2024-09-13T17:23:53.126 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.120+0000 7f3b07e00700 1 -- start start 2024-09-13T17:23:53.127 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 0x7f3b0806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.128 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b07e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08070140 con 0x7f3b0815aff0 2024-09-13T17:23:53.128 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b07e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08070420 con 0x7f3b080cddd0 2024-09-13T17:23:53.128 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b07e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08070700 con 0x7f3b08144300 2024-09-13T17:23:53.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 0x7f3b0806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 0x7f3b0806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:35340/0 (socket says 172.21.15.176:35340) 2024-09-13T17:23:53.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 -- 172.21.15.176:0/3723227850 learned_addr learned my addr 172.21.15.176:0/3723227850 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:53.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 -- 172.21.15.176:0/3723227850 >> v1:172.21.15.176:6789/0 conn(0x7f3b080cddd0 legacy=0x7f3b080711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 -- 172.21.15.176:0/3723227850 >> v1:172.21.15.139:6789/0 conn(0x7f3b0815aff0 legacy=0x7f3b080cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 -- 172.21.15.176:0/3723227850 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080709e0 con 0x7f3b08144300 2024-09-13T17:23:53.130 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06a00700 1 --2- 172.21.15.176:0/3723227850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 0x7f3b0806d620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009e80 tx=0x7f3af800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96c01df562dfafa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:53.130 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06000700 1 -- 172.21.15.176:0/3723227850 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800e070 con 0x7f3b08144300 2024-09-13T17:23:53.130 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06000700 1 -- 172.21.15.176:0/3723227850 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800b9c0 con 0x7f3b08144300 2024-09-13T17:23:53.130 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.124+0000 7f3b06000700 1 -- 172.21.15.176:0/3723227850 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800bd70 con 0x7f3b08144300 2024-09-13T17:23:53.130 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 -- 172.21.15.176:0/3723227850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 msgr2=0x7f3b0806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.131 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 --2- 172.21.15.176:0/3723227850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 0x7f3b0806d620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009e80 tx=0x7f3af800b330 comp rx=0 tx=0).stop 2024-09-13T17:23:53.131 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 -- 172.21.15.176:0/3723227850 shutdown_connections 2024-09-13T17:23:53.131 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 --2- 172.21.15.176:0/3723227850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b08144300 0x7f3b0806d620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.131 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 -- 172.21.15.176:0/3723227850 >> 172.21.15.176:0/3723227850 conn(0x7f3b080ce9d0 msgr2=0x7f3b080cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:53.131 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 -- 172.21.15.176:0/3723227850 shutdown_connections 2024-09-13T17:23:53.131 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 -- 172.21.15.176:0/3723227850 wait complete. 2024-09-13T17:23:53.133 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 Processor -- start 2024-09-13T17:23:53.133 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.128+0000 7f3b07e00700 1 -- start start 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b080cddd0 0x7f3b080adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 0x7f3b080b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b0815aff0 0x7f3b080b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08157a20 con 0x7f3b080cddd0 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080ae140 con 0x7f3b08144300 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080abc70 con 0x7f3b0815aff0 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b0815aff0 0x7f3b080b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 0x7f3b080b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b06a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b080cddd0 0x7f3b080adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b06a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b080cddd0 0x7f3b080adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.176:43406/0 (socket says 172.21.15.176:43406) 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 0x7f3b080b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36434/0 (socket says 172.21.15.176:36434) 2024-09-13T17:23:53.136 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 -- 172.21.15.176:0/1489409191 learned_addr learned my addr 172.21.15.176:0/1489409191 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:53.137 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b0815aff0 0x7f3b080b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:35342/0 (socket says 172.21.15.176:35342) 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 -- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b0815aff0 msgr2=0x7f3b080b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b0815aff0 0x7f3b080b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 -- 172.21.15.176:0/1489409191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b080cddd0 msgr2=0x7f3b080adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b080cddd0 0x7f3b080adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 -- 172.21.15.176:0/1489409191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009b30 con 0x7f3b08144300 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3afe000700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 0x7f3b080b2be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c4d0 tx=0x7f3af000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00052d0 con 0x7f3b08144300 2024-09-13T17:23:53.138 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0005430 con 0x7f3b08144300 2024-09-13T17:23:53.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b080abf50 con 0x7f3b08144300 2024-09-13T17:23:53.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00055a0 con 0x7f3b08144300 2024-09-13T17:23:53.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b080ac510 con 0x7f3b08144300 2024-09-13T17:23:53.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3af0003bc0 con 0x7f3b08144300 2024-09-13T17:23:53.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.132+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3af0011d10 con 0x7f3b08144300 2024-09-13T17:23:53.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.136+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b080ac6d0 con 0x7f3b08144300 2024-09-13T17:23:53.143 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.140+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3af0017070 con 0x7f3b08144300 2024-09-13T17:23:53.157 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:53.152+0000 7f92237422c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:23:53.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.220+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849", "id": 2} v 0) v1 -- 0x7f3b080cd6c0 con 0x7f3b08144300 2024-09-13T17:23:53.235 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3affe00700 1 -- 172.21.15.176:0/1489409191 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3af0011590 con 0x7f3b08144300 2024-09-13T17:23:53.235 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-13T17:23:53.237 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 msgr2=0x7f3b080b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.237 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 0x7f3b080b2be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c4d0 tx=0x7f3af000c7e0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 shutdown_connections 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b0815aff0 0x7f3b080b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b08144300 0x7f3b080b2be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 --2- 172.21.15.176:0/1489409191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b080cddd0 0x7f3b080adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 >> 172.21.15.176:0/1489409191 conn(0x7f3b080ce9d0 msgr2=0x7f3b08143160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 shutdown_connections 2024-09-13T17:23:53.238 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.232+0000 7f3b07e00700 1 -- 172.21.15.176:0/1489409191 wait complete. 2024-09-13T17:23:53.261 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 6629ba9f-cb66-43f5-b3d9-ff6e34f23474 3 2024-09-13T17:23:53.323 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:53.317+0000 7fb224e2e2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:23:53.397 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:53.393+0000 7fb224e2e2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:23:53.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70b6c00700 1 Processor -- start 2024-09-13T17:23:53.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70b6c00700 1 -- start start 2024-09-13T17:23:53.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70b6c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f70b015adc0 0x7f70b00b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70b6c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00cf4f0 con 0x7f70b00cd660 2024-09-13T17:23:53.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70b6c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b015c0f0 con 0x7f70b00b5070 2024-09-13T17:23:53.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70b6c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b00b5500 con 0x7f70b015adc0 2024-09-13T17:23:53.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.424+0000 7f70af400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f70b00b5070 0x7f70b00ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:58278/0 (socket says 172.21.15.176:58278) 2024-09-13T17:23:53.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70af400700 1 -- 172.21.15.176:0/2380198153 learned_addr learned my addr 172.21.15.176:0/2380198153 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-13T17:23:53.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70afe00700 1 --2- 172.21.15.176:0/2380198153 >> v2:172.21.15.139:3300/0 conn(0x7f70b015adc0 0x7f70b00b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70aea00700 1 -- 172.21.15.176:0/2380198153 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929317950 0 0) 0x7f70b015c0f0 con 0x7f70b00b5070 2024-09-13T17:23:53.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70aea00700 1 -- 172.21.15.176:0/2380198153 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70940035d0 con 0x7f70b00b5070 2024-09-13T17:23:53.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70afe00700 1 -- 172.21.15.176:0/2380198153 >> v1:172.21.15.176:6789/0 conn(0x7f70b00b5070 legacy=0x7f70b00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70afe00700 1 -- 172.21.15.176:0/2380198153 >> v1:172.21.15.139:6789/0 conn(0x7f70b00cd660 legacy=0x7f70b015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70afe00700 1 -- 172.21.15.176:0/2380198153 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b006b7d0 con 0x7f70b015adc0 2024-09-13T17:23:53.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70afe00700 1 --2- 172.21.15.176:0/2380198153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b4b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009850 tx=0x7f70a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b05b67b5c08a1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:53.432 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70aea00700 1 -- 172.21.15.176:0/2380198153 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0011830 con 0x7f70b015adc0 2024-09-13T17:23:53.432 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70aea00700 1 -- 172.21.15.176:0/2380198153 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0011990 con 0x7f70b015adc0 2024-09-13T17:23:53.432 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70aea00700 1 -- 172.21.15.176:0/2380198153 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0011d40 con 0x7f70b015adc0 2024-09-13T17:23:53.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 -- 172.21.15.176:0/2380198153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 msgr2=0x7f70b00b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 --2- 172.21.15.176:0/2380198153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b4b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009850 tx=0x7f70a0009b60 comp rx=0 tx=0).stop 2024-09-13T17:23:53.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 -- 172.21.15.176:0/2380198153 shutdown_connections 2024-09-13T17:23:53.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 --2- 172.21.15.176:0/2380198153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b4b30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 -- 172.21.15.176:0/2380198153 >> 172.21.15.176:0/2380198153 conn(0x7f70b00717b0 msgr2=0x7f70b00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:53.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 -- 172.21.15.176:0/2380198153 shutdown_connections 2024-09-13T17:23:53.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.428+0000 7f70b6c00700 1 -- 172.21.15.176:0/2380198153 wait complete. 2024-09-13T17:23:53.437 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.432+0000 7f70b6c00700 1 Processor -- start 2024-09-13T17:23:53.437 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.432+0000 7f70b6c00700 1 -- start start 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 0x7f70b0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70b00cd660 0x7f70b0150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0151c30 con 0x7f70b015adc0 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0151f10 con 0x7f70b00b5070 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0150a50 con 0x7f70b00cd660 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70afe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 0x7f70b0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70b00cd660 0x7f70b0150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70afe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 0x7f70b0156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36440/0 (socket says 172.21.15.176:36440) 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70afe00700 1 -- 172.21.15.176:0/2091497572 learned_addr learned my addr 172.21.15.176:0/2091497572 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b4c00700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 -- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 msgr2=0x7f70b0156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 0x7f70b0156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 -- 172.21.15.176:0/2091497572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 msgr2=0x7f70b00b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 -- 172.21.15.176:0/2091497572 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094b0 con 0x7f70b00cd660 2024-09-13T17:23:53.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70afe00700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 0x7f70b0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:23:53.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70af400700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70b00cd660 0x7f70b0150510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f709c00c440 tx=0x7f709c00c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:53.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c005d90 con 0x7f70b00cd660 2024-09-13T17:23:53.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00ce10 con 0x7f70b00cd660 2024-09-13T17:23:53.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b0150cf0 con 0x7f70b00cd660 2024-09-13T17:23:53.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c0072d0 con 0x7f70b00cd660 2024-09-13T17:23:53.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b01512b0 con 0x7f70b00cd660 2024-09-13T17:23:53.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f709c01c440 con 0x7f70b00cd660 2024-09-13T17:23:53.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f709c007780 con 0x7f70b00cd660 2024-09-13T17:23:53.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.436+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b015bbd0 con 0x7f70b00cd660 2024-09-13T17:23:53.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.440+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f709c017070 con 0x7f70b00cd660 2024-09-13T17:23:53.471 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:53.468+0000 7f92237422c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:23:53.525 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.520+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6629ba9f-cb66-43f5-b3d9-ff6e34f23474", "id": 3} v 0) v1 -- 0x7f70b0152050 con 0x7f70b00cd660 2024-09-13T17:23:53.534 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70a7e00700 1 -- 172.21.15.176:0/2091497572 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6629ba9f-cb66-43f5-b3d9-ff6e34f23474", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f709c01ce00 con 0x7f70b00cd660 2024-09-13T17:23:53.534 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-09-13T17:23:53.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70b00cd660 msgr2=0x7f70b0150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70b00cd660 0x7f70b0150510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f709c00c440 tx=0x7f709c00c750 comp rx=0 tx=0).stop 2024-09-13T17:23:53.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 shutdown_connections 2024-09-13T17:23:53.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70b015adc0 0x7f70b00b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70b00cd660 0x7f70b0150510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.537 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 --2- 172.21.15.176:0/2091497572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70b00b5070 0x7f70b0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.537 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 >> 172.21.15.176:0/2091497572 conn(0x7f70b00717b0 msgr2=0x7f70b00ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:53.537 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 shutdown_connections 2024-09-13T17:23:53.537 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.532+0000 7f70b6c00700 1 -- 172.21.15.176:0/2091497572 wait complete. 2024-09-13T17:23:53.553 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:53.548+0000 7f92237422c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:23:53.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea 4 2024-09-13T17:23:53.648 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:53.641+0000 7fb224e2e2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:23:53.720 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.716+0000 7fb36ce00700 1 Processor -- start 2024-09-13T17:23:53.721 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.716+0000 7fb36ce00700 1 -- start start 2024-09-13T17:23:53.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb36ce00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb3680b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb36ce00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb36806dd70 0x7fb3680aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb36ce00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb36815a8e0 0x7fb36815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb36ce00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680aefe0 con 0x7fb36815a8e0 2024-09-13T17:23:53.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb36ce00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680af1f0 con 0x7fb36806dd70 2024-09-13T17:23:53.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb36ce00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36815b2b0 con 0x7fb36806d990 2024-09-13T17:23:53.725 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb3680b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.725 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb3680b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:35360/0 (socket says 172.21.15.176:35360) 2024-09-13T17:23:53.725 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 -- 172.21.15.176:0/1662422045 learned_addr learned my addr 172.21.15.176:0/1662422045 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:53.725 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb366800700 1 --2- 172.21.15.176:0/1662422045 >> v2:172.21.15.139:3300/0 conn(0x7fb36815a8e0 0x7fb36815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365400700 1 --2- 172.21.15.176:0/1662422045 >> v2:172.21.15.176:3300/0 conn(0x7fb36806dd70 0x7fb3680aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 -- 172.21.15.176:0/1662422045 >> v2:172.21.15.176:3300/0 conn(0x7fb36806dd70 msgr2=0x7fb3680aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:53.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 --2- 172.21.15.176:0/1662422045 >> v2:172.21.15.176:3300/0 conn(0x7fb36806dd70 0x7fb3680aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 -- 172.21.15.176:0/1662422045 >> v2:172.21.15.139:3300/0 conn(0x7fb36815a8e0 msgr2=0x7fb36815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:53.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 --2- 172.21.15.176:0/1662422045 >> v2:172.21.15.139:3300/0 conn(0x7fb36815a8e0 0x7fb36815ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.720+0000 7fb365e00700 1 -- 172.21.15.176:0/1662422045 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680cd110 con 0x7fb36806d990 2024-09-13T17:23:53.727 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb365e00700 1 --2- 172.21.15.176:0/1662422045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb3680b20a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb368071b30 tx=0x7fb358009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d74ba753f3ef77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:53.727 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb364a00700 1 -- 172.21.15.176:0/1662422045 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358011830 con 0x7fb36806d990 2024-09-13T17:23:53.727 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb364a00700 1 -- 172.21.15.176:0/1662422045 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358011990 con 0x7fb36806d990 2024-09-13T17:23:53.727 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb364a00700 1 -- 172.21.15.176:0/1662422045 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358011d20 con 0x7fb36806d990 2024-09-13T17:23:53.728 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 -- 172.21.15.176:0/1662422045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 msgr2=0x7fb3680b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.728 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 --2- 172.21.15.176:0/1662422045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb3680b20a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb368071b30 tx=0x7fb358009bf0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.728 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 -- 172.21.15.176:0/1662422045 shutdown_connections 2024-09-13T17:23:53.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 --2- 172.21.15.176:0/1662422045 >> v2:172.21.15.139:3300/0 conn(0x7fb36815a8e0 0x7fb36815ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 --2- 172.21.15.176:0/1662422045 >> v2:172.21.15.176:3300/0 conn(0x7fb36806dd70 0x7fb3680aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 --2- 172.21.15.176:0/1662422045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb3680b20a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 -- 172.21.15.176:0/1662422045 >> 172.21.15.176:0/1662422045 conn(0x7fb36806cc30 msgr2=0x7fb36806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:53.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 -- 172.21.15.176:0/1662422045 shutdown_connections 2024-09-13T17:23:53.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.724+0000 7fb36ce00700 1 -- 172.21.15.176:0/1662422045 wait complete. 2024-09-13T17:23:53.730 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:53.725+0000 7fb224e2e2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:23:53.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 Processor -- start 2024-09-13T17:23:53.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 -- start start 2024-09-13T17:23:53.732 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb36815c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.732 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb36806dd70 0x7fb36814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb36815a8e0 0x7fb36814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c5140 con 0x7fb36806dd70 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c5380 con 0x7fb36815a8e0 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c5660 con 0x7fb36806d990 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb365e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb36815c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb36815a8e0 0x7fb36814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb365e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb36815c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:35368/0 (socket says 172.21.15.176:35368) 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb365e00700 1 -- 172.21.15.176:0/2439333395 learned_addr learned my addr 172.21.15.176:0/2439333395 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:53.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb365400700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb36806dd70 0x7fb36814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:53.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 -- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 msgr2=0x7fb36815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb36815c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 -- 172.21.15.176:0/2439333395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb36806dd70 msgr2=0x7fb36814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb36806dd70 0x7fb36814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 -- 172.21.15.176:0/2439333395 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009570 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb365400700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb36806dd70 0x7fb36814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb366800700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb36815a8e0 0x7fb36814e250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb36000eba0 tx=0x7fb36000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000ca30 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000f040 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680c5940 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000cdd0 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.728+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680c5f00 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.732+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb360014780 con 0x7fb36815a8e0 2024-09-13T17:23:53.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.732+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb36001ddc0 con 0x7fb36815a8e0 2024-09-13T17:23:53.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.732+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3680ce470 con 0x7fb36815a8e0 2024-09-13T17:23:53.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.736+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb36003be30 con 0x7fb36815a8e0 2024-09-13T17:23:53.813 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:53.808+0000 7f92237422c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:23:53.819 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.816+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea", "id": 4} v 0) v1 -- 0x7fb36806b5b0 con 0x7fb36815a8e0 2024-09-13T17:23:53.828 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:53.821+0000 7fb224e2e2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:23:53.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb35e000700 1 -- 172.21.15.176:0/2439333395 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb36002a030 con 0x7fb36815a8e0 2024-09-13T17:23:53.830 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-09-13T17:23:53.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb36815a8e0 msgr2=0x7fb36814e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:53.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb36815a8e0 0x7fb36814e250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb36000eba0 tx=0x7fb36000eeb0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 shutdown_connections 2024-09-13T17:23:53.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb36815a8e0 0x7fb36814e250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb36806dd70 0x7fb36814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 --2- 172.21.15.176:0/2439333395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36806d990 0x7fb36815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:53.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 >> 172.21.15.176:0/2439333395 conn(0x7fb36806cc30 msgr2=0x7fb3680ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:53.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 shutdown_connections 2024-09-13T17:23:53.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:53.828+0000 7fb36ce00700 1 -- 172.21.15.176:0/2439333395 wait complete. 2024-09-13T17:23:53.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 815c1d2e-00dc-47ad-9f5a-cc9d43550524 5 2024-09-13T17:23:53.910 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:53.904+0000 7f92237422c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:23:54.006 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:54.000+0000 7f92237422c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:23:54.011 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.008+0000 7f6b1e200700 1 Processor -- start 2024-09-13T17:23:54.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.008+0000 7f6b1e200700 1 -- start start 2024-09-13T17:23:54.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b1e200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b1806cfa0 0x7f6b1813f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b1e200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b18071820 con 0x7f6b180b3e70 2024-09-13T17:23:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b1e200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b18071b00 con 0x7f6b180b4250 2024-09-13T17:23:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b1e200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b18071de0 con 0x7f6b1806cfa0 2024-09-13T17:23:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b1806cfa0 0x7f6b1813f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b1806cfa0 0x7f6b1813f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36464/0 (socket says 172.21.15.176:36464) 2024-09-13T17:23:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 -- 172.21.15.176:0/2038377664 learned_addr learned my addr 172.21.15.176:0/2038377664 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:54.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 -- 172.21.15.176:0/2038377664 >> v1:172.21.15.176:6789/0 conn(0x7f6b180b4250 legacy=0x7f6b180cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 -- 172.21.15.176:0/2038377664 >> v1:172.21.15.139:6789/0 conn(0x7f6b180b3e70 legacy=0x7f6b1815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 -- 172.21.15.176:0/2038377664 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180720c0 con 0x7f6b1806cfa0 2024-09-13T17:23:54.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.012+0000 7f6b17e00700 1 --2- 172.21.15.176:0/2038377664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b1806cfa0 0x7f6b1813f780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400bbe0 tx=0x7f6b0400bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=106f4263af226dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b17400700 1 -- 172.21.15.176:0/2038377664 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400dda0 con 0x7f6b1806cfa0 2024-09-13T17:23:54.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b17400700 1 -- 172.21.15.176:0/2038377664 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04010470 con 0x7f6b1806cfa0 2024-09-13T17:23:54.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b17400700 1 -- 172.21.15.176:0/2038377664 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04010800 con 0x7f6b1806cfa0 2024-09-13T17:23:54.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 -- 172.21.15.176:0/2038377664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b1806cfa0 msgr2=0x7f6b1813f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 --2- 172.21.15.176:0/2038377664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b1806cfa0 0x7f6b1813f780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400bbe0 tx=0x7f6b0400bef0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 -- 172.21.15.176:0/2038377664 shutdown_connections 2024-09-13T17:23:54.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 --2- 172.21.15.176:0/2038377664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b1806cfa0 0x7f6b1813f780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.020 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 -- 172.21.15.176:0/2038377664 >> 172.21.15.176:0/2038377664 conn(0x7f6b1806ece0 msgr2=0x7f6b180b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.020 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 -- 172.21.15.176:0/2038377664 shutdown_connections 2024-09-13T17:23:54.020 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 -- 172.21.15.176:0/2038377664 wait complete. 2024-09-13T17:23:54.021 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 Processor -- start 2024-09-13T17:23:54.021 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.016+0000 7f6b1e200700 1 -- start start 2024-09-13T17:23:54.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1806cfa0 0x7f6b18156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.022 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 0x7f6b181597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.023 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b180b4250 0x7f6b18155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.023 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181e22e0 con 0x7f6b1806cfa0 2024-09-13T17:23:54.023 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1813c7a0 con 0x7f6b180b3e70 2024-09-13T17:23:54.023 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181561b0 con 0x7f6b180b4250 2024-09-13T17:23:54.024 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 0x7f6b181597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.024 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 0x7f6b181597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36478/0 (socket says 172.21.15.176:36478) 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 -- 172.21.15.176:0/2781127079 learned_addr learned my addr 172.21.15.176:0/2781127079 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1d800700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b180b4250 0x7f6b18155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1ce00700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1806cfa0 0x7f6b18156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 -- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b180b4250 msgr2=0x7f6b18155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b180b4250 0x7f6b18155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 -- 172.21.15.176:0/2781127079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1806cfa0 msgr2=0x7f6b18156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1806cfa0 0x7f6b18156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 -- 172.21.15.176:0/2781127079 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0400b810 con 0x7f6b180b3e70 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1d800700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b180b4250 0x7f6b18155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b17e00700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 0x7f6b181597d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400bf30 tx=0x7f6b04004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04003d80 con 0x7f6b180b3e70 2024-09-13T17:23:54.025 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b040105e0 con 0x7f6b180b3e70 2024-09-13T17:23:54.026 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1813c9f0 con 0x7f6b180b3e70 2024-09-13T17:23:54.026 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04010990 con 0x7f6b180b3e70 2024-09-13T17:23:54.026 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1813cfb0 con 0x7f6b180b3e70 2024-09-13T17:23:54.026 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6b04019400 con 0x7f6b180b3e70 2024-09-13T17:23:54.026 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.020+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6b04010df0 con 0x7f6b180b3e70 2024-09-13T17:23:54.026 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.024+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1813f780 con 0x7f6b180b3e70 2024-09-13T17:23:54.029 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.024+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6b04026070 con 0x7f6b180b3e70 2024-09-13T17:23:54.107 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.104+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "815c1d2e-00dc-47ad-9f5a-cc9d43550524", "id": 5} v 0) v1 -- 0x7f6b180ce7c0 con 0x7f6b180b3e70 2024-09-13T17:23:54.117 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.112+0000 7f6b14c00700 1 -- 172.21.15.176:0/2781127079 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "815c1d2e-00dc-47ad-9f5a-cc9d43550524", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b04019a10 con 0x7f6b180b3e70 2024-09-13T17:23:54.118 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 msgr2=0x7f6b181597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 0x7f6b181597d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400bf30 tx=0x7f6b04004770 comp rx=0 tx=0).stop 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 shutdown_connections 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b180b4250 0x7f6b18155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b180b3e70 0x7f6b181597d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 --2- 172.21.15.176:0/2781127079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1806cfa0 0x7f6b18156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 >> 172.21.15.176:0/2781127079 conn(0x7f6b1806ece0 msgr2=0x7f6b180cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 shutdown_connections 2024-09-13T17:23:54.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.116+0000 7f6b1e200700 1 -- 172.21.15.176:0/2781127079 wait complete. 2024-09-13T17:23:54.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new a727471b-7468-4014-9f8f-fd407938eb78 6 2024-09-13T17:23:54.306 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7c5000700 1 Processor -- start 2024-09-13T17:23:54.306 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7c5000700 1 -- start start 2024-09-13T17:23:54.308 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7c5000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff7c00ce5f0 0x7ff7c015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.308 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7c5000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c015c160 con 0x7ff7c006d9b0 2024-09-13T17:23:54.308 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7c5000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c015c540 con 0x7ff7c0144770 2024-09-13T17:23:54.308 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7c5000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c00cea20 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.309 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7bde00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff7c0144770 0x7ff7c006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:58296/0 (socket says 172.21.15.176:58296) 2024-09-13T17:23:54.309 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7bde00700 1 -- 172.21.15.176:0/44624179 learned_addr learned my addr 172.21.15.176:0/44624179 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-13T17:23:54.309 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7be800700 1 --2- 172.21.15.176:0/44624179 >> v2:172.21.15.139:3300/0 conn(0x7ff7c00ce5f0 0x7ff7c015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.309 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7bca00700 1 -- 172.21.15.176:0/44624179 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665979193 0 0) 0x7ff7c015c540 con 0x7ff7c0144770 2024-09-13T17:23:54.309 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7bca00700 1 -- 172.21.15.176:0/44624179 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a40035d0 con 0x7ff7c0144770 2024-09-13T17:23:54.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7be800700 1 -- 172.21.15.176:0/44624179 >> v1:172.21.15.176:6789/0 conn(0x7ff7c0144770 legacy=0x7ff7c006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7be800700 1 -- 172.21.15.176:0/44624179 >> v1:172.21.15.139:6789/0 conn(0x7ff7c006d9b0 legacy=0x7ff7c015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.304+0000 7ff7be800700 1 -- 172.21.15.176:0/44624179 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0144b50 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7be800700 1 --2- 172.21.15.176:0/44624179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c015b1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009d90 tx=0x7ff7b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38feb3794f77cb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7bca00700 1 -- 172.21.15.176:0/44624179 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800e070 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.311 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7bca00700 1 -- 172.21.15.176:0/44624179 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b800bb20 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.311 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7bca00700 1 -- 172.21.15.176:0/44624179 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8012430 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.311 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 -- 172.21.15.176:0/44624179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 msgr2=0x7ff7c015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.311 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 --2- 172.21.15.176:0/44624179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c015b1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009d90 tx=0x7ff7b800b330 comp rx=0 tx=0).stop 2024-09-13T17:23:54.312 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 -- 172.21.15.176:0/44624179 shutdown_connections 2024-09-13T17:23:54.312 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 --2- 172.21.15.176:0/44624179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c015b1c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.312 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 -- 172.21.15.176:0/44624179 >> 172.21.15.176:0/44624179 conn(0x7ff7c006b1e0 msgr2=0x7ff7c006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.312 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 -- 172.21.15.176:0/44624179 shutdown_connections 2024-09-13T17:23:54.312 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.308+0000 7ff7c5000700 1 -- 172.21.15.176:0/44624179 wait complete. 2024-09-13T17:23:54.315 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 Processor -- start 2024-09-13T17:23:54.315 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 -- start start 2024-09-13T17:23:54.317 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:54.313+0000 7fb224e2e2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:23:54.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c006d9b0 0x7ff7c00cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c013dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c0144770 0x7ff7c00aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00c46d0 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00c3e60 con 0x7ff7c0144770 2024-09-13T17:23:54.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.312+0000 7ff7c5000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00c4920 con 0x7ff7c006d9b0 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c013dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c013dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.176:43478/0 (socket says 172.21.15.176:43478) 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 -- 172.21.15.176:0/2996552555 learned_addr learned my addr 172.21.15.176:0/2996552555 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bde00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c006d9b0 0x7ff7c00cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7be800700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c0144770 0x7ff7c00aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 -- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c006d9b0 msgr2=0x7ff7c00cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c006d9b0 0x7ff7c00cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 -- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c0144770 msgr2=0x7ff7c00aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c0144770 0x7ff7c00aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 -- 172.21.15.176:0/2996552555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8009a70 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7bd400700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c013dde0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c500 tx=0x7ff7ac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0052d0 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac005430 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0055a0 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c00c4100 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00c4c00 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff7ac003be0 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff7ac011d10 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.316+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c015b1c0 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.324+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff7ac017070 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.404+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a727471b-7468-4014-9f8f-fd407938eb78", "id": 6} v 0) v1 -- 0x7ff7c01f28a0 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7b6000700 1 -- 172.21.15.176:0/2996552555 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a727471b-7468-4014-9f8f-fd407938eb78", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff7ac011590 con 0x7ff7c00ce5f0 2024-09-13T17:23:54.416 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-09-13T17:23:54.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 msgr2=0x7ff7c013dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c013dde0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c500 tx=0x7ff7ac00c810 comp rx=0 tx=0).stop 2024-09-13T17:23:54.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 shutdown_connections 2024-09-13T17:23:54.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c0144770 0x7ff7c00aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7c00ce5f0 0x7ff7c013dde0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 --2- 172.21.15.176:0/2996552555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c006d9b0 0x7ff7c00cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 >> 172.21.15.176:0/2996552555 conn(0x7ff7c006b1e0 msgr2=0x7ff7c00af120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 shutdown_connections 2024-09-13T17:23:54.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.412+0000 7ff7c5000700 1 -- 172.21.15.176:0/2996552555 wait complete. 2024-09-13T17:23:54.440 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 90b4c6d8-d297-40bb-87bf-e922fd88758e 7 2024-09-13T17:23:54.491 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:54.485+0000 7fb224e2e2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:23:54.520 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:54.516+0000 7f92237422c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:23:54.604 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.600+0000 7f3195e00700 1 Processor -- start 2024-09-13T17:23:54.604 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.600+0000 7f3195e00700 1 -- start start 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3195e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f319015ebb0 0x7f31900b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3195e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f319015f5c0 0x7f31901434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3195e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900b41a0 con 0x7f319015ef90 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3195e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900b6370 con 0x7f319015f5c0 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3195e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900b6650 con 0x7f319015ebb0 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f319015ebb0 0x7f31900b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.608 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f319015ebb0 0x7f31900b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36506/0 (socket says 172.21.15.176:36506) 2024-09-13T17:23:54.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 -- 172.21.15.176:0/3733299455 learned_addr learned my addr 172.21.15.176:0/3733299455 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:54.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f318fe00700 1 --2- 172.21.15.176:0/3733299455 >> v2:172.21.15.139:3300/0 conn(0x7f319015f5c0 0x7f31901434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 -- 172.21.15.176:0/3733299455 >> v2:172.21.15.139:3300/0 conn(0x7f319015f5c0 msgr2=0x7f31901434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:54.609 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 --2- 172.21.15.176:0/3733299455 >> v2:172.21.15.139:3300/0 conn(0x7f319015f5c0 0x7f31901434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.610 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 -- 172.21.15.176:0/3733299455 >> v1:172.21.15.139:6789/0 conn(0x7f319015ef90 legacy=0x7f3190143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.610 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 -- 172.21.15.176:0/3733299455 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900b6930 con 0x7f319015ebb0 2024-09-13T17:23:54.610 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.604+0000 7f3194a00700 1 --2- 172.21.15.176:0/3733299455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015ebb0 0x7f31900b3c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3190071870 tx=0x7f3184009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b78d35b0d14de1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.610 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f318f400700 1 -- 172.21.15.176:0/3733299455 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011830 con 0x7f319015ebb0 2024-09-13T17:23:54.610 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f318f400700 1 -- 172.21.15.176:0/3733299455 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184011990 con 0x7f319015ebb0 2024-09-13T17:23:54.611 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f318f400700 1 -- 172.21.15.176:0/3733299455 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011d20 con 0x7f319015ebb0 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 -- 172.21.15.176:0/3733299455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015ebb0 msgr2=0x7f31900b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 --2- 172.21.15.176:0/3733299455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015ebb0 0x7f31900b3c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3190071870 tx=0x7f3184009bf0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 -- 172.21.15.176:0/3733299455 shutdown_connections 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 --2- 172.21.15.176:0/3733299455 >> v2:172.21.15.139:3300/0 conn(0x7f319015f5c0 0x7f31901434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 --2- 172.21.15.176:0/3733299455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015ebb0 0x7f31900b3c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 -- 172.21.15.176:0/3733299455 >> 172.21.15.176:0/3733299455 conn(0x7f3190071fa0 msgr2=0x7f3190072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 -- 172.21.15.176:0/3733299455 shutdown_connections 2024-09-13T17:23:54.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.608+0000 7f3195e00700 1 -- 172.21.15.176:0/3733299455 wait complete. 2024-09-13T17:23:54.614 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 Processor -- start 2024-09-13T17:23:54.614 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 -- start start 2024-09-13T17:23:54.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f319015ebb0 0x7f3190141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f319015ef90 0x7f31901415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 0x7f319015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31901593e0 con 0x7f319015ebb0 2024-09-13T17:23:54.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319015b490 con 0x7f319015f5c0 2024-09-13T17:23:54.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319015b770 con 0x7f319015ef90 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 0x7f319015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f318fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f319015ef90 0x7f31901415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3194a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f319015ebb0 0x7f3190141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 0x7f319015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:36508/0 (socket says 172.21.15.176:36508) 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 -- 172.21.15.176:0/599150053 learned_addr learned my addr 172.21.15.176:0/599150053 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 -- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f319015ef90 msgr2=0x7f31901415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f319015ef90 0x7f31901415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 -- 172.21.15.176:0/599150053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f319015ebb0 msgr2=0x7f3190141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f319015ebb0 0x7f3190141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f3195400700 1 -- 172.21.15.176:0/599150053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009570 con 0x7f319015f5c0 2024-09-13T17:23:54.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.612+0000 7f318fe00700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f319015ef90 0x7f31901415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:23:54.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f3195400700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 0x7f319015d040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f318800cc50 tx=0x7f318800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188003c20 con 0x7f319015f5c0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188003d80 con 0x7f319015f5c0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319015ba50 con 0x7f319015f5c0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800aab0 con 0x7f319015f5c0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319015dc20 con 0x7f319015f5c0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f31880050d0 con 0x7f319015f5c0 2024-09-13T17:23:54.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f31880125b0 con 0x7f319015f5c0 2024-09-13T17:23:54.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.616+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31900677e0 con 0x7f319015f5c0 2024-09-13T17:23:54.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.620+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f31900b41a0 con 0x7f319015f5c0 2024-09-13T17:23:54.692 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:54.688+0000 7f92237422c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:23:54.705 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.700+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "90b4c6d8-d297-40bb-87bf-e922fd88758e", "id": 7} v 0) v1 -- 0x7f319015bf70 con 0x7f319015f5c0 2024-09-13T17:23:54.716 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f318cc00700 1 -- 172.21.15.176:0/599150053 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90b4c6d8-d297-40bb-87bf-e922fd88758e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f319015bf70 con 0x7f319015f5c0 2024-09-13T17:23:54.716 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-09-13T17:23:54.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 msgr2=0x7f319015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f3195e00700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 0x7f319015d040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f318800cc50 tx=0x7f318800cf60 comp rx=0 tx=0).stop 2024-09-13T17:23:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 shutdown_connections 2024-09-13T17:23:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f3195e00700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f319015f5c0 0x7f319015d040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f3195e00700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f319015ef90 0x7f31901415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.712+0000 7f3195e00700 1 --2- 172.21.15.176:0/599150053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f319015ebb0 0x7f3190141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.716+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 >> 172.21.15.176:0/599150053 conn(0x7f3190071fa0 msgr2=0x7f31900b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.716+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 shutdown_connections 2024-09-13T17:23:54.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-13T17:23:54.716+0000 7f3195e00700 1 -- 172.21.15.176:0/599150053 wait complete. 2024-09-13T17:23:54.737 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T17:23:54.737 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T17:23:54.741 INFO:tasks.ceph.osd.0:Started 2024-09-13T17:23:54.741 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T17:23:54.741 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T17:23:54.744 INFO:tasks.ceph.osd.1:Started 2024-09-13T17:23:54.744 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T17:23:54.744 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T17:23:54.747 INFO:tasks.ceph.osd.2:Started 2024-09-13T17:23:54.747 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T17:23:54.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T17:23:54.753 INFO:tasks.ceph.osd.3:Started 2024-09-13T17:23:54.753 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T17:23:54.754 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T17:23:54.759 INFO:tasks.ceph.osd.4:Started 2024-09-13T17:23:54.759 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T17:23:54.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T17:23:54.764 INFO:tasks.ceph.osd.5:Started 2024-09-13T17:23:54.764 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T17:23:54.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T17:23:54.769 INFO:tasks.ceph.osd.6:Started 2024-09-13T17:23:54.769 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T17:23:54.769 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T17:23:54.775 INFO:tasks.ceph.osd.7:Started 2024-09-13T17:23:54.776 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:23:54.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2037e00700 1 Processor -- start 2024-09-13T17:23:54.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2037e00700 1 -- start start 2024-09-13T17:23:54.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2037e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380cbd40 0x7f20380cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2037e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203814aab0 con 0x7f203814a6d0 2024-09-13T17:23:54.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2037e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380cc3b0 con 0x7f20380b3280 2024-09-13T17:23:54.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2037e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380cc1d0 con 0x7f20380cbd40 2024-09-13T17:23:54.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.961+0000 7f2036a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f203814a6d0 0x7f20380b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42730/0 (socket says 172.21.15.139:42730) 2024-09-13T17:23:54.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036a00700 1 -- 172.21.15.139:0/2927381054 learned_addr learned my addr 172.21.15.139:0/2927381054 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:23:54.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037400700 1 --2- 172.21.15.139:0/2927381054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380cbd40 0x7f20380cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394622553 0 0) 0x7f20380cc3b0 con 0x7f20380b3280 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c0035d0 con 0x7f20380b3280 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901522363 0 0) 0x7f203814aab0 con 0x7f203814a6d0 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20380cc3b0 con 0x7f203814a6d0 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037400700 1 -- 172.21.15.139:0/2927381054 >> v1:172.21.15.176:6789/0 conn(0x7f20380b3280 legacy=0x7f2038161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037400700 1 -- 172.21.15.139:0/2927381054 >> v1:172.21.15.139:6789/0 conn(0x7f203814a6d0 legacy=0x7f20380b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037400700 1 -- 172.21.15.139:0/2927381054 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380cc690 con 0x7f20380cbd40 2024-09-13T17:23:54.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037400700 1 --2- 172.21.15.139:0/2927381054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380cbd40 0x7f20380cd450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2030009dc0 tx=0x7f203000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fd43b74adeee53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000e070 con 0x7f20380cbd40 2024-09-13T17:23:54.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203000bb20 con 0x7f20380cbd40 2024-09-13T17:23:54.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2036000700 1 -- 172.21.15.139:0/2927381054 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000be90 con 0x7f20380cbd40 2024-09-13T17:23:54.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 -- 172.21.15.139:0/2927381054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380cbd40 msgr2=0x7f20380cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 --2- 172.21.15.139:0/2927381054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380cbd40 0x7f20380cd450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2030009dc0 tx=0x7f203000b330 comp rx=0 tx=0).stop 2024-09-13T17:23:54.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 -- 172.21.15.139:0/2927381054 shutdown_connections 2024-09-13T17:23:54.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 --2- 172.21.15.139:0/2927381054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380cbd40 0x7f20380cd450 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 -- 172.21.15.139:0/2927381054 >> 172.21.15.139:0/2927381054 conn(0x7f20380ce9d0 msgr2=0x7f20380cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:54.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 -- 172.21.15.139:0/2927381054 shutdown_connections 2024-09-13T17:23:54.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.965+0000 7f2037e00700 1 -- 172.21.15.139:0/2927381054 wait complete. 2024-09-13T17:23:54.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 Processor -- start 2024-09-13T17:23:54.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 -- start start 2024-09-13T17:23:54.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380b3280 0x7f20381f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 0x7f203806c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f203814a6d0 0x7f203806a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203806dae0 con 0x7f20380cbd40 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203806d240 con 0x7f203814a6d0 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.969+0000 7f2037e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203806d520 con 0x7f20380b3280 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 0x7f203806c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 0x7f203806c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:50772/0 (socket says 172.21.15.139:50772) 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 -- 172.21.15.139:0/2493714129 learned_addr learned my addr 172.21.15.139:0/2493714129 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f2036a00700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380b3280 0x7f20381f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f2037400700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f203814a6d0 0x7f203806a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 -- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380b3280 msgr2=0x7f20381f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380b3280 0x7f20381f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 -- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f203814a6d0 msgr2=0x7f203806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:54.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f203814a6d0 0x7f203806a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:54.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 -- 172.21.15.139:0/2493714129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009a70 con 0x7f20380cbd40 2024-09-13T17:23:54.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f2037400700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f203814a6d0 0x7f203806a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:54.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202e000700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 0x7f203806c780 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20200010e0 tx=0x7f202000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200052d0 con 0x7f20380cbd40 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020005430 con 0x7f20380cbd40 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203806d800 con 0x7f20380cbd40 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200055a0 con 0x7f20380cbd40 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20381f6820 con 0x7f20380cbd40 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2020003be0 con 0x7f20380cbd40 2024-09-13T17:23:54.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2020012420 con 0x7f20380cbd40 2024-09-13T17:23:54.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.973+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203815c330 con 0x7f20380cbd40 2024-09-13T17:23:54.981 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:54.973+0000 7fb224e2e2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:23:54.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:54.977+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f203815c330 con 0x7f20380cbd40 2024-09-13T17:23:55.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f203815c710 con 0x7f20380cbd40 2024-09-13T17:23:55.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f202f400700 1 -- 172.21.15.139:0/2493714129 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f203815c710 con 0x7f20380cbd40 2024-09-13T17:23:55.055 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:23:55.055 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":10,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:23:54.706485+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:23:55.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 msgr2=0x7f203806c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:55.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 0x7f203806c780 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20200010e0 tx=0x7f202000ca90 comp rx=0 tx=0).stop 2024-09-13T17:23:55.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 shutdown_connections 2024-09-13T17:23:55.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f203814a6d0 0x7f203806a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:55.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20380cbd40 0x7f203806c780 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:55.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 --2- 172.21.15.139:0/2493714129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380b3280 0x7f20381f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:55.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.049+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 >> 172.21.15.139:0/2493714129 conn(0x7f20380ce9d0 msgr2=0x7f2038145750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:55.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.053+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 shutdown_connections 2024-09-13T17:23:55.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:23:55.053+0000 7f2037e00700 1 -- 172.21.15.139:0/2493714129 wait complete. 2024-09-13T17:23:55.080 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T17:23:55.080 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T17:23:55.169 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:55.164+0000 7f92237422c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:23:55.252 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:55.245+0000 7fb224e2e2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:23:55.356 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:55.349+0000 7fb224e2e2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:23:55.407 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-13T17:23:55.401+0000 7fee870e2880 -1 Falling back to public interface 2024-09-13T17:23:55.413 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-13T17:23:55.408+0000 7fcbcc3f1880 -1 Falling back to public interface 2024-09-13T17:23:55.413 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-13T17:23:55.408+0000 7f768154b880 -1 Falling back to public interface 2024-09-13T17:23:55.417 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:55.412+0000 7f92237422c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:23:55.422 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-09-13T17:23:55.417+0000 7fb193a68880 -1 Falling back to public interface 2024-09-13T17:23:55.434 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-09-13T17:23:55.429+0000 7f2b17faf880 -1 Falling back to public interface 2024-09-13T17:23:55.435 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-09-13T17:23:55.429+0000 7f83e9e6e880 -1 Falling back to public interface 2024-09-13T17:23:55.439 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-13T17:23:55.436+0000 7facef9a4880 -1 Falling back to public interface 2024-09-13T17:23:55.456 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-13T17:23:55.452+0000 7fb4583c2880 -1 Falling back to public interface 2024-09-13T17:23:55.529 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:55.524+0000 7f92237422c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:23:55.578 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:55.573+0000 7fb224e2e2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:23:55.737 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:55.732+0000 7f92237422c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:23:55.887 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:23:56.040 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.033+0000 7f3d17000700 1 Processor -- start 2024-09-13T17:23:56.040 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.033+0000 7f3d17000700 1 -- start start 2024-09-13T17:23:56.041 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d17000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d1015ac90 0x7f3d100b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:56.041 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d17000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d100d0240 con 0x7f3d100b46d0 2024-09-13T17:23:56.041 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d17000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d100d0520 con 0x7f3d10070190 2024-09-13T17:23:56.042 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d17000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1006e980 con 0x7f3d1015ac90 2024-09-13T17:23:56.042 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d1015ac90 0x7f3d100b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:56.042 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d1015ac90 0x7f3d100b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:54446/0 (socket says 172.21.15.139:54446) 2024-09-13T17:23:56.042 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 -- 172.21.15.139:0/3607501985 learned_addr learned my addr 172.21.15.139:0/3607501985 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:23:56.043 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15200700 1 --1- 172.21.15.139:0/3607501985 >> v1:172.21.15.139:6789/0 conn(0x7f3d100b46d0 0x7f3d1015e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42732/0 (socket says 172.21.15.139:42732) 2024-09-13T17:23:56.043 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 -- 172.21.15.139:0/3607501985 >> v1:172.21.15.176:6789/0 conn(0x7f3d10070190 legacy=0x7f3d1015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:56.043 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 -- 172.21.15.139:0/3607501985 >> v1:172.21.15.139:6789/0 conn(0x7f3d100b46d0 legacy=0x7f3d1015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:56.043 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 -- 172.21.15.139:0/3607501985 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1006ec60 con 0x7f3d1015ac90 2024-09-13T17:23:56.043 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d0fe00700 1 -- 172.21.15.139:0/3607501985 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770838480 0 0) 0x7f3d100d0520 con 0x7f3d10070190 2024-09-13T17:23:56.044 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d15c00700 1 --2- 172.21.15.139:0/3607501985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d1015ac90 0x7f3d100b4190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009e50 tx=0x7f3d0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ecc0db45218533 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:56.044 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d0fe00700 1 -- 172.21.15.139:0/3607501985 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400e070 con 0x7f3d1015ac90 2024-09-13T17:23:56.044 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d0fe00700 1 -- 172.21.15.139:0/3607501985 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400b9c0 con 0x7f3d1015ac90 2024-09-13T17:23:56.044 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.037+0000 7f3d0fe00700 1 -- 172.21.15.139:0/3607501985 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400bd70 con 0x7f3d1015ac90 2024-09-13T17:23:56.045 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 -- 172.21.15.139:0/3607501985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d1015ac90 msgr2=0x7f3d100b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:56.045 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 --2- 172.21.15.139:0/3607501985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d1015ac90 0x7f3d100b4190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009e50 tx=0x7f3d0400b330 comp rx=0 tx=0).stop 2024-09-13T17:23:56.045 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 -- 172.21.15.139:0/3607501985 shutdown_connections 2024-09-13T17:23:56.045 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 --2- 172.21.15.139:0/3607501985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d1015ac90 0x7f3d100b4190 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.045 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 -- 172.21.15.139:0/3607501985 >> 172.21.15.139:0/3607501985 conn(0x7f3d100b2880 msgr2=0x7f3d100b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:56.045 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 -- 172.21.15.139:0/3607501985 shutdown_connections 2024-09-13T17:23:56.046 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 -- 172.21.15.139:0/3607501985 wait complete. 2024-09-13T17:23:56.047 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 Processor -- start 2024-09-13T17:23:56.048 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.041+0000 7f3d17000700 1 -- start start 2024-09-13T17:23:56.049 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 0x7f3d101f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:56.049 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d100b46d0 0x7f3d1015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d1015ac90 0x7f3d100b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10147040 con 0x7f3d10070190 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10147290 con 0x7f3d100b46d0 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10147570 con 0x7f3d1015ac90 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 0x7f3d101f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 0x7f3d101f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:50788/0 (socket says 172.21.15.139:50788) 2024-09-13T17:23:56.050 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 -- 172.21.15.139:0/2149555879 learned_addr learned my addr 172.21.15.139:0/2149555879 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15200700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d100b46d0 0x7f3d1015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d16600700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d1015ac90 0x7f3d100b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 -- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d1015ac90 msgr2=0x7f3d100b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d1015ac90 0x7f3d100b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 -- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d100b46d0 msgr2=0x7f3d1015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d100b46d0 0x7f3d1015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 -- 172.21.15.139:0/2149555879 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009b30 con 0x7f3d10070190 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15200700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d100b46d0 0x7f3d1015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:56.052 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d15c00700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 0x7f3d101f0030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400b370 tx=0x7f3d04004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040099b0 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d040092e0 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0401c640 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10147850 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d10147e10 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3d0401caa0 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3d04025ae0 con 0x7f3d10070190 2024-09-13T17:23:56.053 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.045+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d10066570 con 0x7f3d10070190 2024-09-13T17:23:56.055 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.049+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3d04020070 con 0x7f3d10070190 2024-09-13T17:23:56.126 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d10148030 con 0x7f3d10070190 2024-09-13T17:23:56.126 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d0d600700 1 -- 172.21.15.139:0/2149555879 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3d04025450 con 0x7f3d10070190 2024-09-13T17:23:56.127 INFO:teuthology.misc.health.smithi139.stdout: 2024-09-13T17:23:56.127 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":10,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:23:54.706485+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 msgr2=0x7f3d101f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 0x7f3d101f0030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400b370 tx=0x7f3d04004af0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 shutdown_connections 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d1015ac90 0x7f3d100b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d100b46d0 0x7f3d1015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 --2- 172.21.15.139:0/2149555879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d10070190 0x7f3d101f0030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.121+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 >> 172.21.15.139:0/2149555879 conn(0x7f3d100b2880 msgr2=0x7f3d100b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.125+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 shutdown_connections 2024-09-13T17:23:56.129 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:23:56.125+0000 7f3d17000700 1 -- 172.21.15.139:0/2149555879 wait complete. 2024-09-13T17:23:56.146 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:23:56.271 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:56.265+0000 7fb224e2e2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:23:56.357 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:56.353+0000 7fb224e2e2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:23:56.512 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:56.508+0000 7f92237422c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:23:56.548 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:56.541+0000 7fb224e2e2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:23:56.620 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:56.616+0000 7f92237422c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:23:56.640 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:56.633+0000 7fb224e2e2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:23:56.745 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:56.741+0000 7fb224e2e2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:23:56.793 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:56.788+0000 7f92237422c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:23:56.880 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:56.876+0000 7f92237422c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:23:56.983 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:56.980+0000 7f92237422c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:23:57.133 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:57.129+0000 7fb224e2e2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:23:57.233 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:57.229+0000 7fb224e2e2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:23:57.375 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:57.372+0000 7f92237422c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:23:57.471 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:57.468+0000 7f92237422c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:23:58.055 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:58.048+0000 7fb224e2e2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:23:58.313 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:23:58.308+0000 7f92237422c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:23:59.087 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:59.080+0000 7fb20b400700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T17:23:59.089 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:23:59.084+0000 7fb20b400700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:23:59.303 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-09-13T17:23:59.296+0000 7f2b17faf880 -1 osd.3 0 log_to_monitors true 2024-09-13T17:23:59.398 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-13T17:23:59.392+0000 7fee870e2880 -1 osd.0 0 log_to_monitors true 2024-09-13T17:23:59.415 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-13T17:23:59.412+0000 7fcbcc3f1880 -1 osd.4 0 log_to_monitors true 2024-09-13T17:23:59.461 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-09-13T17:23:59.456+0000 7fb193a68880 -1 osd.1 0 log_to_monitors true 2024-09-13T17:23:59.461 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-13T17:23:59.456+0000 7fb4583c2880 -1 osd.6 0 log_to_monitors true 2024-09-13T17:23:59.490 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-13T17:23:59.488+0000 7f768154b880 -1 osd.5 0 log_to_monitors true 2024-09-13T17:23:59.510 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-09-13T17:23:59.504+0000 7f83e9e6e880 -1 osd.2 0 log_to_monitors true 2024-09-13T17:23:59.734 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-13T17:23:59.728+0000 7facef9a4880 -1 osd.7 0 log_to_monitors true 2024-09-13T17:24:02.953 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:03.139 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.132+0000 7fca43e00700 1 Processor -- start 2024-09-13T17:24:03.139 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.132+0000 7fca43e00700 1 -- start start 2024-09-13T17:24:03.140 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.132+0000 7fca43e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fca44150ae0 0x7fca440b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:03.140 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.132+0000 7fca43e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440b2e10 con 0x7fca4406cd50 2024-09-13T17:24:03.140 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.132+0000 7fca43e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca44071c90 con 0x7fca4406c8e0 2024-09-13T17:24:03.140 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.132+0000 7fca43e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca44150ec0 con 0x7fca44150ae0 2024-09-13T17:24:03.141 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42000700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fca4406c8e0 0x7fca44070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:59876/0 (socket says 172.21.15.139:59876) 2024-09-13T17:24:03.141 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42000700 1 -- 172.21.15.139:0/2065680315 learned_addr learned my addr 172.21.15.139:0/2065680315 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:03.141 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42a00700 1 --2- 172.21.15.139:0/2065680315 >> v2:172.21.15.176:3300/0 conn(0x7fca44150ae0 0x7fca440b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:03.142 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850333535 0 0) 0x7fca44071c90 con 0x7fca4406c8e0 2024-09-13T17:24:03.142 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca280035d0 con 0x7fca4406c8e0 2024-09-13T17:24:03.142 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600747210 0 0) 0x7fca440b2e10 con 0x7fca4406cd50 2024-09-13T17:24:03.143 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca44071c90 con 0x7fca4406cd50 2024-09-13T17:24:03.143 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42a00700 1 -- 172.21.15.139:0/2065680315 >> v1:172.21.15.176:6789/0 conn(0x7fca4406c8e0 legacy=0x7fca44070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.143 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42a00700 1 -- 172.21.15.139:0/2065680315 >> v1:172.21.15.139:6789/0 conn(0x7fca4406cd50 legacy=0x7fca44071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.143 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42a00700 1 -- 172.21.15.139:0/2065680315 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4415d660 con 0x7fca44150ae0 2024-09-13T17:24:03.144 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca42a00700 1 --2- 172.21.15.139:0/2065680315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca44150ae0 0x7fca440b55e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca34009850 tx=0x7fca34009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b4c5b31b6beb92c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:03.144 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34011830 con 0x7fca44150ae0 2024-09-13T17:24:03.144 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34011990 con 0x7fca44150ae0 2024-09-13T17:24:03.144 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.136+0000 7fca41600700 1 -- 172.21.15.139:0/2065680315 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34011d40 con 0x7fca44150ae0 2024-09-13T17:24:03.146 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 -- 172.21.15.139:0/2065680315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca44150ae0 msgr2=0x7fca440b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.147 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 --2- 172.21.15.139:0/2065680315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca44150ae0 0x7fca440b55e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca34009850 tx=0x7fca34009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:03.147 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 -- 172.21.15.139:0/2065680315 shutdown_connections 2024-09-13T17:24:03.147 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 --2- 172.21.15.139:0/2065680315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca44150ae0 0x7fca440b55e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.147 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 -- 172.21.15.139:0/2065680315 >> 172.21.15.139:0/2065680315 conn(0x7fca4406b450 msgr2=0x7fca4406b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:03.147 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 -- 172.21.15.139:0/2065680315 shutdown_connections 2024-09-13T17:24:03.148 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.140+0000 7fca43e00700 1 -- 172.21.15.139:0/2065680315 wait complete. 2024-09-13T17:24:03.150 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 Processor -- start 2024-09-13T17:24:03.150 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 -- start start 2024-09-13T17:24:03.151 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca4406c8e0 0x7fca441edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:03.151 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca4406cd50 0x7fca4415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:03.151 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 0x7fca4414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:03.151 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4414cc70 con 0x7fca4406cd50 2024-09-13T17:24:03.151 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4414ce80 con 0x7fca4406c8e0 2024-09-13T17:24:03.152 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4414d160 con 0x7fca44150ae0 2024-09-13T17:24:03.152 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 0x7fca4414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:03.152 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 0x7fca4414e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:56552/0 (socket says 172.21.15.139:56552) 2024-09-13T17:24:03.153 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca43400700 1 -- 172.21.15.139:0/1408436137 learned_addr learned my addr 172.21.15.139:0/1408436137 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:03.153 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.144+0000 7fca42a00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca4406c8e0 0x7fca441edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:03.154 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca42000700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca4406cd50 0x7fca4415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:03.154 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca43400700 1 -- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca4406c8e0 msgr2=0x7fca441edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.154 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca43400700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca4406c8e0 0x7fca441edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.155 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca43400700 1 -- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca4406cd50 msgr2=0x7fca4415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.155 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca43400700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca4406cd50 0x7fca4415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.155 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca43400700 1 -- 172.21.15.139:0/1408436137 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340094b0 con 0x7fca44150ae0 2024-09-13T17:24:03.156 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.148+0000 7fca43400700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 0x7fca4414e6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00cc20 tx=0x7fca3c00cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:03.157 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.152+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c003c20 con 0x7fca44150ae0 2024-09-13T17:24:03.159 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.152+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c003d80 con 0x7fca44150ae0 2024-09-13T17:24:03.159 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.152+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c003c20 con 0x7fca44150ae0 2024-09-13T17:24:03.159 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.152+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4414d440 con 0x7fca44150ae0 2024-09-13T17:24:03.161 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.152+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca441ee0a0 con 0x7fca44150ae0 2024-09-13T17:24:03.164 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.156+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca440cc410 con 0x7fca44150ae0 2024-09-13T17:24:03.165 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.160+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fca3c00a950 con 0x7fca44150ae0 2024-09-13T17:24:03.166 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.160+0000 7fca3aa00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fca20066700 0x7fca20068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:03.166 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.160+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fca3c083030 con 0x7fca44150ae0 2024-09-13T17:24:03.166 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.160+0000 7fca42a00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fca20066700 0x7fca20068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:03.168 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.160+0000 7fca42a00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fca20066700 0x7fca20068bc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca340090b0 tx=0x7fca3401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:03.184 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.176+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca3c0b4db0 con 0x7fca44150ae0 2024-09-13T17:24:03.398 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-13T17:24:03.392+0000 7facea800700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:24:03.403 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-13T17:24:03.400+0000 7face0400700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.415 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-13T17:24:03.408+0000 7f767c400700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:24:03.424 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-13T17:24:03.420+0000 7f7672000700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.496 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-13T17:24:03.488+0000 7fee82000700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:24:03.515 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-13T17:24:03.508+0000 7fee77c00700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.544+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca4406d160 con 0x7fca44150ae0 2024-09-13T17:24:03.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.548+0000 7fca3aa00700 1 -- 172.21.15.139:0/1408436137 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fca3c0511f0 con 0x7fca44150ae0 2024-09-13T17:24:03.554 INFO:teuthology.misc.health.smithi139.stdout: 2024-09-13T17:24:03.555 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":12,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:01.133490+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:03.558 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-13T17:24:03.556+0000 7fb453200700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:24:03.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.552+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fca20066700 msgr2=0x7fca20068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.552+0000 7fca43e00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fca20066700 0x7fca20068bc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca340090b0 tx=0x7fca3401c040 comp rx=0 tx=0).stop 2024-09-13T17:24:03.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.552+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 msgr2=0x7fca4414e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:03.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.552+0000 7fca43e00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 0x7fca4414e6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00cc20 tx=0x7fca3c00cf30 comp rx=0 tx=0).stop 2024-09-13T17:24:03.561 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-09-13T17:24:03.556+0000 7fb18ea00700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:24:03.565 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-13T17:24:03.560+0000 7fb448e00700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 shutdown_connections 2024-09-13T17:24:03.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fca20066700 0x7fca20068bc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca44150ae0 0x7fca4414e6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca4406cd50 0x7fca4415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 --2- 172.21.15.139:0/1408436137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca4406c8e0 0x7fca441edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:03.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 >> 172.21.15.139:0/1408436137 conn(0x7fca4406b450 msgr2=0x7fca44159010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:03.566 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 shutdown_connections 2024-09-13T17:24:03.566 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:03.560+0000 7fca43e00700 1 -- 172.21.15.139:0/1408436137 wait complete. 2024-09-13T17:24:03.572 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-09-13T17:24:03.564+0000 7fb184600700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.589 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:24:03.604 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-09-13T17:24:03.596+0000 7f2b12e00700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:24:03.612 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-09-13T17:24:03.604+0000 7f2b08a00700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.624 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-13T17:24:03.620+0000 7fcbc7200700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:24:03.633 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-13T17:24:03.628+0000 7fcbbce00700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:03.727 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-09-13T17:24:03.720+0000 7f83e4e00700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:24:03.737 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-09-13T17:24:03.728+0000 7f83daa00700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:24:10.394 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:10.548 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.540+0000 7f5281c00700 1 Processor -- start 2024-09-13T17:24:10.549 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 -- start start 2024-09-13T17:24:10.552 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f527c15cd60 0x7f527c06b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.552 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f527c0ac890 0x7f527c06b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.552 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c1608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.552 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c15d140 con 0x7f527c15cd60 2024-09-13T17:24:10.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0acd20 con 0x7f527c0ac890 2024-09-13T17:24:10.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f5281c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0ad000 con 0x7f527c0cb870 2024-09-13T17:24:10.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f527aa00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f527c15cd60 0x7f527c06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f527aa00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f527c15cd60 0x7f527c06b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39568/0 (socket says 172.21.15.139:39568) 2024-09-13T17:24:10.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f527aa00700 1 -- 172.21.15.139:0/2281498942 learned_addr learned my addr 172.21.15.139:0/2281498942 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:10.553 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.544+0000 7f527a000700 1 --2- 172.21.15.139:0/2281498942 >> v2:172.21.15.176:3300/0 conn(0x7f527c0ac890 0x7f527c06b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f527aa00700 1 -- 172.21.15.139:0/2281498942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 msgr2=0x7f527c1608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f527aa00700 1 --2- 172.21.15.139:0/2281498942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c1608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f527aa00700 1 -- 172.21.15.139:0/2281498942 >> v2:172.21.15.176:3300/0 conn(0x7f527c0ac890 msgr2=0x7f527c06b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f527aa00700 1 --2- 172.21.15.139:0/2281498942 >> v2:172.21.15.176:3300/0 conn(0x7f527c0ac890 0x7f527c06b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f527aa00700 1 -- 172.21.15.139:0/2281498942 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0ad2e0 con 0x7f527c15cd60 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f527aa00700 1 --2- 172.21.15.139:0/2281498942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c15cd60 0x7f527c06b350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f527c071790 tx=0x7f526c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0459a11120a330 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.554 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5279600700 1 -- 172.21.15.139:0/2281498942 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011830 con 0x7f527c15cd60 2024-09-13T17:24:10.555 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5279600700 1 -- 172.21.15.139:0/2281498942 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c011990 con 0x7f527c15cd60 2024-09-13T17:24:10.555 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5279600700 1 -- 172.21.15.139:0/2281498942 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011d20 con 0x7f527c15cd60 2024-09-13T17:24:10.555 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 -- 172.21.15.139:0/2281498942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c15cd60 msgr2=0x7f527c06b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.555 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 --2- 172.21.15.139:0/2281498942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c15cd60 0x7f527c06b350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f527c071790 tx=0x7f526c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 -- 172.21.15.139:0/2281498942 shutdown_connections 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 --2- 172.21.15.139:0/2281498942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c1608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 --2- 172.21.15.139:0/2281498942 >> v2:172.21.15.176:3300/0 conn(0x7f527c0ac890 0x7f527c06b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 --2- 172.21.15.139:0/2281498942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c15cd60 0x7f527c06b350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 -- 172.21.15.139:0/2281498942 >> 172.21.15.139:0/2281498942 conn(0x7f527c070860 msgr2=0x7f527c070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 -- 172.21.15.139:0/2281498942 shutdown_connections 2024-09-13T17:24:10.556 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.548+0000 7f5281c00700 1 -- 172.21.15.139:0/2281498942 wait complete. 2024-09-13T17:24:10.557 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 Processor -- start 2024-09-13T17:24:10.557 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 -- start start 2024-09-13T17:24:10.558 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.558 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 0x7f527c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.558 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f527c14cfd0 0x7f527c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.558 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c15e3a0 con 0x7f527c14ca80 2024-09-13T17:24:10.559 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c15b6f0 con 0x7f527c14cfd0 2024-09-13T17:24:10.559 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0b13f0 con 0x7f527c0cb870 2024-09-13T17:24:10.559 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 0x7f527c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.559 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 0x7f527c150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39576/0 (socket says 172.21.15.139:39576) 2024-09-13T17:24:10.559 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 -- 172.21.15.139:0/1339826855 learned_addr learned my addr 172.21.15.139:0/1339826855 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:10.559 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527aa00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527b400700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f527c14cfd0 0x7f527c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 -- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 msgr2=0x7f527c15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 -- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f527c14cfd0 msgr2=0x7f527c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f527c14cfd0 0x7f527c151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.560 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 -- 172.21.15.139:0/1339826855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009570 con 0x7f527c14ca80 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527b400700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f527c14cfd0 0x7f527c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f527a000700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 0x7f527c150f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f526800ea00 tx=0x7f526800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268009720 con 0x7f527c14ca80 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526800c850 con 0x7f527c14ca80 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800cbc0 con 0x7f527c14ca80 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c0b16d0 con 0x7f527c14ca80 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.552+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c15dce0 con 0x7f527c14ca80 2024-09-13T17:24:10.561 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.556+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c0b04e0 con 0x7f527c14ca80 2024-09-13T17:24:10.562 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.556+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f526800cd20 con 0x7f527c14ca80 2024-09-13T17:24:10.563 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.556+0000 7f5272a00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f525c0666d0 0x7f525c068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.563 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.556+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5268083dc0 con 0x7f527c14ca80 2024-09-13T17:24:10.564 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.556+0000 7f527aa00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f525c0666d0 0x7f525c068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.565 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.560+0000 7f527aa00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f525c0666d0 0x7f525c068b90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f527c066360 tx=0x7f526c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.572 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.564+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5268051560 con 0x7f527c14ca80 2024-09-13T17:24:10.755 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.748+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5268051930 con 0x7f527c14ca80 2024-09-13T17:24:10.766 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.760+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f527c15e610 con 0x7f527c14ca80 2024-09-13T17:24:10.767 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.760+0000 7f5272a00700 1 -- 172.21.15.139:0/1339826855 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f526807f8e0 con 0x7f527c14ca80 2024-09-13T17:24:10.768 INFO:teuthology.misc.health.smithi139.stdout: 2024-09-13T17:24:10.768 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":17,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:08.454067+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f525c0666d0 msgr2=0x7f525c068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f525c0666d0 0x7f525c068b90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f527c066360 tx=0x7f526c008030 comp rx=0 tx=0).stop 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 msgr2=0x7f527c150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 0x7f527c150f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f526800ea00 tx=0x7f526800edc0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 shutdown_connections 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f525c0666d0 0x7f525c068b90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f527c14cfd0 0x7f527c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527c14ca80 0x7f527c150f00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 --2- 172.21.15.139:0/1339826855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f527c0cb870 0x7f527c15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 >> 172.21.15.139:0/1339826855 conn(0x7f527c070860 msgr2=0x7f527c0b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 shutdown_connections 2024-09-13T17:24:10.773 INFO:teuthology.misc.health.smithi139.stderr:2024-09-13T17:24:10.764+0000 7f5281c00700 1 -- 172.21.15.139:0/1339826855 wait complete. 2024-09-13T17:24:10.788 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T17:24:10.789 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T17:24:10.789 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:24:10.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:24:10.792 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:24:10.792 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:24:10.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:24:10.796 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:24:10.796 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:24:10.796 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:24:10.802 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:24:10.802 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:24:10.803 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:24:10.807 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:24:10.808 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T17:24:10.808 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:10.908 INFO:tasks.ceph.mds.a.smithi139.stdout:starting mds.a at 2024-09-13T17:24:10.913 INFO:tasks.ceph.mds.c.smithi139.stdout:starting mds.c at 2024-09-13T17:24:10.926 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-13T17:24:10.927 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-13T17:24:10.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.976+0000 7f0d2e000700 1 Processor -- start 2024-09-13T17:24:10.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.976+0000 7f0d2e000700 1 -- start start 2024-09-13T17:24:10.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d2e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d280ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d2e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0d2806d9b0 0x7f0d2815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d2e000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2815c160 con 0x7f0d2815b1c0 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d2e000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2815c540 con 0x7f0d2806d9b0 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d2e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28144b50 con 0x7f0d28144770 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d1ea00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0d2815b1c0 0x7f0d2806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56428/0 (socket says 172.21.15.139:56428) 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d1ea00700 1 -- 172.21.15.139:0/4155625178 learned_addr learned my addr 172.21.15.139:0/4155625178 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d27e00700 1 --2- 172.21.15.139:0/4155625178 >> v2:172.21.15.139:3300/0 conn(0x7f0d2806d9b0 0x7f0d2815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.980+0000 7f0d27400700 1 --2- 172.21.15.139:0/4155625178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d280ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d26a00700 1 -- 172.21.15.139:0/4155625178 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703443046 0 0) 0x7f0d2815c160 con 0x7f0d2815b1c0 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d26a00700 1 -- 172.21.15.139:0/4155625178 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c0035d0 con 0x7f0d2815b1c0 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d27e00700 1 -- 172.21.15.139:0/4155625178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 msgr2=0x7f0d280ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d27e00700 1 --2- 172.21.15.139:0/4155625178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d280ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d27e00700 1 -- 172.21.15.139:0/4155625178 >> v1:172.21.15.139:6789/0 conn(0x7f0d2815b1c0 legacy=0x7f0d2806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d27e00700 1 -- 172.21.15.139:0/4155625178 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2815b620 con 0x7f0d2806d9b0 2024-09-13T17:24:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d27e00700 1 --2- 172.21.15.139:0/4155625178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2806d9b0 0x7f0d2815c9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009d90 tx=0x7f0d2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d114b502089fbf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d26a00700 1 -- 172.21.15.139:0/4155625178 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000e070 con 0x7f0d2806d9b0 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d26a00700 1 -- 172.21.15.139:0/4155625178 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000bb20 con 0x7f0d2806d9b0 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d26a00700 1 -- 172.21.15.139:0/4155625178 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000be90 con 0x7f0d2806d9b0 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 -- 172.21.15.139:0/4155625178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2806d9b0 msgr2=0x7f0d2815c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 --2- 172.21.15.139:0/4155625178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2806d9b0 0x7f0d2815c9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009d90 tx=0x7f0d2000b330 comp rx=0 tx=0).stop 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 -- 172.21.15.139:0/4155625178 shutdown_connections 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 --2- 172.21.15.139:0/4155625178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2806d9b0 0x7f0d2815c9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 --2- 172.21.15.139:0/4155625178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d280ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 -- 172.21.15.139:0/4155625178 >> 172.21.15.139:0/4155625178 conn(0x7f0d2806b1e0 msgr2=0x7f0d2806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 -- 172.21.15.139:0/4155625178 shutdown_connections 2024-09-13T17:24:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.984+0000 7f0d2e000700 1 -- 172.21.15.139:0/4155625178 wait complete. 2024-09-13T17:24:10.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.988+0000 7f0d2e000700 1 Processor -- start 2024-09-13T17:24:10.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.988+0000 7f0d2e000700 1 -- start start 2024-09-13T17:24:10.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d2806d9b0 0x7f0d28132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d281f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 0x7f0d28141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d281f20a0 con 0x7f0d2815b1c0 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28141850 con 0x7f0d2806d9b0 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28141b20 con 0x7f0d28144770 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 0x7f0d28141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 0x7f0d28141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39622/0 (socket says 172.21.15.139:39622) 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 -- 172.21.15.139:0/548134577 learned_addr learned my addr 172.21.15.139:0/548134577 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d1ea00700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d281f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27400700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d2806d9b0 0x7f0d28132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 -- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 msgr2=0x7f0d281f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d281f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 -- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d2806d9b0 msgr2=0x7f0d28132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d2806d9b0 0x7f0d28132880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 -- 172.21.15.139:0/548134577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009a70 con 0x7f0d2815b1c0 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d27e00700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 0x7f0d28141310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d20014040 tx=0x7f0d20004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20004800 con 0x7f0d2815b1c0 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d20020070 con 0x7f0d2815b1c0 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d28141e00 con 0x7f0d2815b1c0 2024-09-13T17:24:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200276c0 con 0x7f0d2815b1c0 2024-09-13T17:24:11.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.992+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d281423c0 con 0x7f0d2815b1c0 2024-09-13T17:24:11.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.996+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280ce5f0 con 0x7f0d2815b1c0 2024-09-13T17:24:11.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.996+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d20012430 con 0x7f0d2815b1c0 2024-09-13T17:24:11.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:10.996+0000 7f0d1fe00700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0d04066730 0x7f0d04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.000+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d20022070 con 0x7f0d2815b1c0 2024-09-13T17:24:11.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.000+0000 7f0d27400700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0d04066730 0x7f0d04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.000+0000 7f0d27400700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0d04066730 0x7f0d04068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009bf0 tx=0x7f0d18009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.004+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d20053410 con 0x7f0d2815b1c0 2024-09-13T17:24:11.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.192+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d280b3d80 con 0x7f0d2815b1c0 2024-09-13T17:24:11.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.196+0000 7f0d1fe00700 1 -- 172.21.15.139:0/548134577 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f0d20056a30 con 0x7f0d2815b1c0 2024-09-13T17:24:11.203 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:11.203 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":17,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:08.454067+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:11.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0d04066730 msgr2=0x7f0d04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0d04066730 0x7f0d04068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009bf0 tx=0x7f0d18009240 comp rx=0 tx=0).stop 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 msgr2=0x7f0d28141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 0x7f0d28141310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d20014040 tx=0x7f0d20004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 shutdown_connections 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0d04066730 0x7f0d04068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2815b1c0 0x7f0d28141310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d28144770 0x7f0d281f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 --2- 172.21.15.139:0/548134577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d2806d9b0 0x7f0d28132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 >> 172.21.15.139:0/548134577 conn(0x7f0d2806b1e0 msgr2=0x7f0d2806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 shutdown_connections 2024-09-13T17:24:11.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.200+0000 7f0d2e000700 1 -- 172.21.15.139:0/548134577 wait complete. 2024-09-13T17:24:11.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:24:11.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:11.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:11.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:11.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.376+0000 7feb41000700 1 Processor -- start 2024-09-13T17:24:11.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb41000700 1 -- start start 2024-09-13T17:24:11.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb41000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feb3c15ebb0 0x7feb3c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb41000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb41000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c0b41a0 con 0x7feb3c15ef90 2024-09-13T17:24:11.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb41000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0b6370 con 0x7feb3c15ebb0 2024-09-13T17:24:11.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb41000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0b6650 con 0x7feb3c15f5c0 2024-09-13T17:24:11.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb3b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feb3c15ebb0 0x7feb3c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb3b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feb3c15ebb0 0x7feb3c0b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39636/0 (socket says 172.21.15.139:39636) 2024-09-13T17:24:11.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.380+0000 7feb3b400700 1 -- 172.21.15.139:0/3937323701 learned_addr learned my addr 172.21.15.139:0/3937323701 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:11.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3aa00700 1 --2- 172.21.15.139:0/3937323701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3b400700 1 -- 172.21.15.139:0/3937323701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 msgr2=0x7feb3c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:11.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3b400700 1 --2- 172.21.15.139:0/3937323701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3b400700 1 -- 172.21.15.139:0/3937323701 >> v1:172.21.15.139:6789/0 conn(0x7feb3c15ef90 legacy=0x7feb3c143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3b400700 1 -- 172.21.15.139:0/3937323701 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0b6930 con 0x7feb3c15ebb0 2024-09-13T17:24:11.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3b400700 1 --2- 172.21.15.139:0/3937323701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c0b3c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009910 tx=0x7feb2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d5b6e136601103 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3a000700 1 -- 172.21.15.139:0/3937323701 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00ba60 con 0x7feb3c15ebb0 2024-09-13T17:24:11.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3a000700 1 -- 172.21.15.139:0/3937323701 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c00bbc0 con 0x7feb3c15ebb0 2024-09-13T17:24:11.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb3a000700 1 -- 172.21.15.139:0/3937323701 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c009e60 con 0x7feb3c15ebb0 2024-09-13T17:24:11.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 -- 172.21.15.139:0/3937323701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 msgr2=0x7feb3c0b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 --2- 172.21.15.139:0/3937323701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c0b3c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009910 tx=0x7feb2c009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:11.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 -- 172.21.15.139:0/3937323701 shutdown_connections 2024-09-13T17:24:11.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 --2- 172.21.15.139:0/3937323701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 --2- 172.21.15.139:0/3937323701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c0b3c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 -- 172.21.15.139:0/3937323701 >> 172.21.15.139:0/3937323701 conn(0x7feb3c071fa0 msgr2=0x7feb3c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:11.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 -- 172.21.15.139:0/3937323701 shutdown_connections 2024-09-13T17:24:11.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.384+0000 7feb41000700 1 -- 172.21.15.139:0/3937323701 wait complete. 2024-09-13T17:24:11.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 Processor -- start 2024-09-13T17:24:11.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 -- start start 2024-09-13T17:24:11.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c15ef90 0x7feb3c15c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c13e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c15b890 con 0x7feb3c15ebb0 2024-09-13T17:24:11.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c15cda0 con 0x7feb3c15ef90 2024-09-13T17:24:11.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c15baa0 con 0x7feb3c15f5c0 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39640/0 (socket says 172.21.15.139:39640) 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 -- 172.21.15.139:0/2890869135 learned_addr learned my addr 172.21.15.139:0/2890869135 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3aa00700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c15ef90 0x7feb3c15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3be00700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c13e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 -- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 msgr2=0x7feb3c13e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c13e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 -- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c15ef90 msgr2=0x7feb3c15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c15ef90 0x7feb3c15c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 -- 172.21.15.139:0/2890869135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009570 con 0x7feb3c15ebb0 2024-09-13T17:24:11.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb3b400700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c159320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0b34b0 tx=0x7feb2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c004610 con 0x7feb3c15ebb0 2024-09-13T17:24:11.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c01f070 con 0x7feb3c15ebb0 2024-09-13T17:24:11.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.388+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c15bd80 con 0x7feb3c15ebb0 2024-09-13T17:24:11.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.392+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c003900 con 0x7feb3c15ebb0 2024-09-13T17:24:11.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.392+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c15c340 con 0x7feb3c15ebb0 2024-09-13T17:24:11.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.392+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c0677e0 con 0x7feb3c15ebb0 2024-09-13T17:24:11.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.392+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb2c003a60 con 0x7feb3c15ebb0 2024-09-13T17:24:11.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.396+0000 7feb33400700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb1c066730 0x7feb1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.396+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb2c021070 con 0x7feb3c15ebb0 2024-09-13T17:24:11.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.396+0000 7feb3aa00700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb1c066730 0x7feb1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.396+0000 7feb3aa00700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb1c066730 0x7feb1c068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb3c13f200 tx=0x7feb28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.404+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb2c052dc0 con 0x7feb3c15ebb0 2024-09-13T17:24:11.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.584+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb3c0b3c60 con 0x7feb3c15ebb0 2024-09-13T17:24:11.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.584+0000 7feb33400700 1 -- 172.21.15.139:0/2890869135 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb2c0563e0 con 0x7feb3c15ebb0 2024-09-13T17:24:11.593 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:24:11.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb1c066730 msgr2=0x7feb1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb1c066730 0x7feb1c068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb3c13f200 tx=0x7feb28008040 comp rx=0 tx=0).stop 2024-09-13T17:24:11.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 msgr2=0x7feb3c159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c159320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0b34b0 tx=0x7feb2c004770 comp rx=0 tx=0).stop 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 shutdown_connections 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb1c066730 0x7feb1c068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb3c15f5c0 0x7feb3c13e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c15ef90 0x7feb3c15c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 --2- 172.21.15.139:0/2890869135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb3c15ebb0 0x7feb3c159320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 >> 172.21.15.139:0/2890869135 conn(0x7feb3c071fa0 msgr2=0x7feb3c0b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 shutdown_connections 2024-09-13T17:24:11.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.588+0000 7feb41000700 1 -- 172.21.15.139:0/2890869135 wait complete. 2024-09-13T17:24:11.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:11.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.820+0000 7faf89a00700 1 Processor -- start 2024-09-13T17:24:11.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.820+0000 7faf89a00700 1 -- start start 2024-09-13T17:24:11.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf841574d0 0x7faf8415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf840cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faf840cd440 0x7faf840cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840b3050 con 0x7faf840cd440 2024-09-13T17:24:11.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840cf9f0 con 0x7faf841574d0 2024-09-13T17:24:11.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840ce180 con 0x7faf840cd000 2024-09-13T17:24:11.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faf840cd440 0x7faf840cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faf840cd440 0x7faf840cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39648/0 (socket says 172.21.15.139:39648) 2024-09-13T17:24:11.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf83400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf840cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf89000700 1 -- 172.21.15.139:0/2815123347 learned_addr learned my addr 172.21.15.139:0/2815123347 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.824+0000 7faf83e00700 1 --2- 172.21.15.139:0/2815123347 >> v2:172.21.15.176:3300/0 conn(0x7faf841574d0 0x7faf8415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89000700 1 -- 172.21.15.139:0/2815123347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 msgr2=0x7faf840cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89000700 1 --2- 172.21.15.139:0/2815123347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf840cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89000700 1 -- 172.21.15.139:0/2815123347 >> v2:172.21.15.176:3300/0 conn(0x7faf841574d0 msgr2=0x7faf8415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89000700 1 --2- 172.21.15.139:0/2815123347 >> v2:172.21.15.176:3300/0 conn(0x7faf841574d0 0x7faf8415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89000700 1 -- 172.21.15.139:0/2815123347 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840cd8e0 con 0x7faf840cd440 2024-09-13T17:24:11.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89000700 1 --2- 172.21.15.139:0/2815123347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840cd440 0x7faf840cf4b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf84072610 tx=0x7faf7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b30b3c1c844a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf82a00700 1 -- 172.21.15.139:0/2815123347 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00e070 con 0x7faf840cd440 2024-09-13T17:24:11.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf82a00700 1 -- 172.21.15.139:0/2815123347 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00b8d0 con 0x7faf840cd440 2024-09-13T17:24:11.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf82a00700 1 -- 172.21.15.139:0/2815123347 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00bc80 con 0x7faf840cd440 2024-09-13T17:24:11.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 -- 172.21.15.139:0/2815123347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840cd440 msgr2=0x7faf840cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 --2- 172.21.15.139:0/2815123347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840cd440 0x7faf840cf4b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf84072610 tx=0x7faf7c00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:11.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 -- 172.21.15.139:0/2815123347 shutdown_connections 2024-09-13T17:24:11.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 --2- 172.21.15.139:0/2815123347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840cd440 0x7faf840cf4b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 --2- 172.21.15.139:0/2815123347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf840cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 --2- 172.21.15.139:0/2815123347 >> v2:172.21.15.176:3300/0 conn(0x7faf841574d0 0x7faf8415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 -- 172.21.15.139:0/2815123347 >> 172.21.15.139:0/2815123347 conn(0x7faf840b1bb0 msgr2=0x7faf840b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:11.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 -- 172.21.15.139:0/2815123347 shutdown_connections 2024-09-13T17:24:11.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.828+0000 7faf89a00700 1 -- 172.21.15.139:0/2815123347 wait complete. 2024-09-13T17:24:11.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.832+0000 7faf89a00700 1 Processor -- start 2024-09-13T17:24:11.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.832+0000 7faf89a00700 1 -- start start 2024-09-13T17:24:11.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf841f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840cd440 0x7faf8415b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 0x7faf84143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840cb4e0 con 0x7faf841574d0 2024-09-13T17:24:11.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf841f4780 con 0x7faf840cd440 2024-09-13T17:24:11.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840ca8d0 con 0x7faf840cd000 2024-09-13T17:24:11.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 0x7faf84143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 0x7faf84143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39662/0 (socket says 172.21.15.139:39662) 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 -- 172.21.15.139:0/3304999183 learned_addr learned my addr 172.21.15.139:0/3304999183 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf83400700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840cd440 0x7faf8415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf83e00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf841f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 -- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 msgr2=0x7faf841f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf841f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 -- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840cd440 msgr2=0x7faf8415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840cd440 0x7faf8415b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 -- 172.21.15.139:0/3304999183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009b30 con 0x7faf841574d0 2024-09-13T17:24:11.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89000700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 0x7faf84143220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00b680 tx=0x7faf7c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c004450 con 0x7faf841574d0 2024-09-13T17:24:11.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c0045b0 con 0x7faf841574d0 2024-09-13T17:24:11.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840cabb0 con 0x7faf841574d0 2024-09-13T17:24:11.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.836+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c004960 con 0x7faf841574d0 2024-09-13T17:24:11.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.840+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840cb170 con 0x7faf841574d0 2024-09-13T17:24:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.840+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf840cb690 con 0x7faf841574d0 2024-09-13T17:24:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.840+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf7c01c440 con 0x7faf841574d0 2024-09-13T17:24:11.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.844+0000 7faf7be00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7faf64066730 0x7faf64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.844+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faf7c0853d0 con 0x7faf841574d0 2024-09-13T17:24:11.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.844+0000 7faf83e00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7faf64066730 0x7faf64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.844+0000 7faf83e00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7faf64066730 0x7faf64068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf74009b50 tx=0x7faf74009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:11.852+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf840cb690 con 0x7faf841574d0 2024-09-13T17:24:12.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.084+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf840cb690 con 0x7faf841574d0 2024-09-13T17:24:12.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf7be00700 1 -- 172.21.15.139:0/3304999183 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7faf840cb690 con 0x7faf841574d0 2024-09-13T17:24:12.147 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:12.147 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7faf64066730 msgr2=0x7faf64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7faf64066730 0x7faf64068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf74009b50 tx=0x7faf74009240 comp rx=0 tx=0).stop 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 msgr2=0x7faf84143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 0x7faf84143220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00b680 tx=0x7faf7c004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 shutdown_connections 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7faf64066730 0x7faf64068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf841574d0 0x7faf84143220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840cd440 0x7faf8415b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 --2- 172.21.15.139:0/3304999183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf840cd000 0x7faf841f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 >> 172.21.15.139:0/3304999183 conn(0x7faf840b1bb0 msgr2=0x7faf84066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 shutdown_connections 2024-09-13T17:24:12.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.088+0000 7faf89a00700 1 -- 172.21.15.139:0/3304999183 wait complete. 2024-09-13T17:24:12.150 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 3 2024-09-13T17:24:12.151 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:12.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.312+0000 7efc4f200700 1 Processor -- start 2024-09-13T17:24:12.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.312+0000 7efc4f200700 1 -- start start 2024-09-13T17:24:12.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4f200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 0x7efc500d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4f200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4f200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc500d19c0 con 0x7efc500d1570 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4f200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500d08c0 con 0x7efc50146690 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4f200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b1740 con 0x7efc5015e030 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4de00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 0x7efc500d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4d400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4de00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 0x7efc500d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:51262/0 (socket says 172.21.15.139:51262) 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4de00700 1 -- 172.21.15.139:0/759822600 learned_addr learned my addr 172.21.15.139:0/759822600 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:12.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4e800700 1 --1- 172.21.15.139:0/759822600 >> v1:172.21.15.139:6789/0 conn(0x7efc500d1570 0x7efc500ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56442/0 (socket says 172.21.15.139:56442) 2024-09-13T17:24:12.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4ca00700 1 -- 172.21.15.139:0/759822600 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675251193 0 0) 0x7efc48001110 con 0x7efc500d1570 2024-09-13T17:24:12.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4ca00700 1 -- 172.21.15.139:0/759822600 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc340035d0 con 0x7efc500d1570 2024-09-13T17:24:12.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4d400700 1 -- 172.21.15.139:0/759822600 >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 msgr2=0x7efc500d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:12.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4d400700 1 --2- 172.21.15.139:0/759822600 >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 0x7efc500d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4d400700 1 -- 172.21.15.139:0/759822600 >> v1:172.21.15.139:6789/0 conn(0x7efc500d1570 legacy=0x7efc500ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4d400700 1 -- 172.21.15.139:0/759822600 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500b3760 con 0x7efc5015e030 2024-09-13T17:24:12.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.316+0000 7efc4de00700 1 --2- 172.21.15.139:0/759822600 >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 0x7efc500d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:12.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4d400700 1 --2- 172.21.15.139:0/759822600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500d1030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009850 tx=0x7efc3c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=686f7ffc3ebaa636 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4ca00700 1 -- 172.21.15.139:0/759822600 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c011830 con 0x7efc5015e030 2024-09-13T17:24:12.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4ca00700 1 -- 172.21.15.139:0/759822600 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c011990 con 0x7efc5015e030 2024-09-13T17:24:12.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4ca00700 1 -- 172.21.15.139:0/759822600 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c011d00 con 0x7efc5015e030 2024-09-13T17:24:12.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 -- 172.21.15.139:0/759822600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 msgr2=0x7efc500d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 --2- 172.21.15.139:0/759822600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500d1030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009850 tx=0x7efc3c009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:12.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 -- 172.21.15.139:0/759822600 shutdown_connections 2024-09-13T17:24:12.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 --2- 172.21.15.139:0/759822600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500d1030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 --2- 172.21.15.139:0/759822600 >> v2:172.21.15.176:3300/0 conn(0x7efc50146690 0x7efc500d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 -- 172.21.15.139:0/759822600 >> 172.21.15.139:0/759822600 conn(0x7efc50071fa0 msgr2=0x7efc50072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 -- 172.21.15.139:0/759822600 shutdown_connections 2024-09-13T17:24:12.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.320+0000 7efc4f200700 1 -- 172.21.15.139:0/759822600 wait complete. 2024-09-13T17:24:12.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 Processor -- start 2024-09-13T17:24:12.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 -- start start 2024-09-13T17:24:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 0x7efc5015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50146690 0x7efc50144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50143bb0 con 0x7efc500d1570 2024-09-13T17:24:12.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5015abf0 con 0x7efc50146690 2024-09-13T17:24:12.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4f200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc50143e00 con 0x7efc5015e030 2024-09-13T17:24:12.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 0x7efc5015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 0x7efc5015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39676/0 (socket says 172.21.15.139:39676) 2024-09-13T17:24:12.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 -- 172.21.15.139:0/2517729823 learned_addr learned my addr 172.21.15.139:0/2517729823 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4d400700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50146690 0x7efc50144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 -- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 msgr2=0x7efc500cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 -- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50146690 msgr2=0x7efc50144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50146690 0x7efc50144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 -- 172.21.15.139:0/2517729823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009b30 con 0x7efc500d1570 2024-09-13T17:24:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4d400700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50146690 0x7efc50144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc4de00700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 0x7efc5015a6b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc4000efc0 tx=0x7efc4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.324+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000cc70 con 0x7efc500d1570 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.328+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4000f040 con 0x7efc500d1570 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.328+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0094b0 con 0x7efc500d1570 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.328+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40014480 con 0x7efc500d1570 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.328+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc501443c0 con 0x7efc500d1570 2024-09-13T17:24:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.328+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc500677e0 con 0x7efc500d1570 2024-09-13T17:24:12.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.332+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc400145e0 con 0x7efc500d1570 2024-09-13T17:24:12.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.332+0000 7efc46000700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc30066730 0x7efc30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.332+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc40084560 con 0x7efc500d1570 2024-09-13T17:24:12.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.332+0000 7efc4d400700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc30066730 0x7efc30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.336+0000 7efc4d400700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc30066730 0x7efc30068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc500ccc80 tx=0x7efc3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.340+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc40051b90 con 0x7efc500d1570 2024-09-13T17:24:12.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.528+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc500b2230 con 0x7efc500d1570 2024-09-13T17:24:12.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.528+0000 7efc46000700 1 -- 172.21.15.139:0/2517729823 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12898 (secure 0 0 0) 0x7efc400551b0 con 0x7efc500d1570 2024-09-13T17:24:12.535 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:12.536 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":17,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:08.454067+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:12.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc30066730 msgr2=0x7efc30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc30066730 0x7efc30068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc500ccc80 tx=0x7efc3c008030 comp rx=0 tx=0).stop 2024-09-13T17:24:12.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 msgr2=0x7efc5015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 0x7efc5015a6b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc4000efc0 tx=0x7efc4000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 shutdown_connections 2024-09-13T17:24:12.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc30066730 0x7efc30068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5015e030 0x7efc500cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50146690 0x7efc50144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 --2- 172.21.15.139:0/2517729823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc500d1570 0x7efc5015a6b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 >> 172.21.15.139:0/2517729823 conn(0x7efc50071fa0 msgr2=0x7efc5006e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 shutdown_connections 2024-09-13T17:24:12.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.532+0000 7efc4f200700 1 -- 172.21.15.139:0/2517729823 wait complete. 2024-09-13T17:24:12.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:24:12.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:12.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 Processor -- start 2024-09-13T17:24:12.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 -- start start 2024-09-13T17:24:12.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f19c015aff0 0x7f19c00cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c00711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c0070140 con 0x7f19c0144300 2024-09-13T17:24:12.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c00ce0b0 con 0x7f19c015aff0 2024-09-13T17:24:12.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0070420 con 0x7f19c00cdc00 2024-09-13T17:24:12.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bde00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f19c0144300 0x7f19c006d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56448/0 (socket says 172.21.15.139:56448) 2024-09-13T17:24:12.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bd400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f19c015aff0 0x7f19c00cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19bde00700 1 -- 172.21.15.139:0/4011609929 learned_addr learned my addr 172.21.15.139:0/4011609929 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:12.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.732+0000 7f19be800700 1 --2- 172.21.15.139:0/4011609929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c00711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bca00700 1 -- 172.21.15.139:0/4011609929 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209340669 0 0) 0x7f19c0070140 con 0x7f19c0144300 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bca00700 1 -- 172.21.15.139:0/4011609929 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a40035d0 con 0x7f19c0144300 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bd400700 1 -- 172.21.15.139:0/4011609929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 msgr2=0x7f19c00711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bd400700 1 --2- 172.21.15.139:0/4011609929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c00711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bd400700 1 -- 172.21.15.139:0/4011609929 >> v1:172.21.15.139:6789/0 conn(0x7f19c0144300 legacy=0x7f19c006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bd400700 1 -- 172.21.15.139:0/4011609929 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0070700 con 0x7f19c015aff0 2024-09-13T17:24:12.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bd400700 1 --2- 172.21.15.139:0/4011609929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c015aff0 0x7f19c00cd6c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009880 tx=0x7f19ac009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d302836947fc61ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bca00700 1 -- 172.21.15.139:0/4011609929 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac011830 con 0x7f19c015aff0 2024-09-13T17:24:12.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bca00700 1 -- 172.21.15.139:0/4011609929 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac011990 con 0x7f19c015aff0 2024-09-13T17:24:12.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bca00700 1 -- 172.21.15.139:0/4011609929 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac011d20 con 0x7f19c015aff0 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 -- 172.21.15.139:0/4011609929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c015aff0 msgr2=0x7f19c00cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 --2- 172.21.15.139:0/4011609929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c015aff0 0x7f19c00cd6c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009880 tx=0x7f19ac009b90 comp rx=0 tx=0).stop 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 -- 172.21.15.139:0/4011609929 shutdown_connections 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 --2- 172.21.15.139:0/4011609929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c00711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 --2- 172.21.15.139:0/4011609929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c015aff0 0x7f19c00cd6c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 -- 172.21.15.139:0/4011609929 >> 172.21.15.139:0/4011609929 conn(0x7f19c00ce9d0 msgr2=0x7f19c00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 -- 172.21.15.139:0/4011609929 shutdown_connections 2024-09-13T17:24:12.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.736+0000 7f19bf200700 1 -- 172.21.15.139:0/4011609929 wait complete. 2024-09-13T17:24:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 Processor -- start 2024-09-13T17:24:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 -- start start 2024-09-13T17:24:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c013d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 0x7f19c00ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c015aff0 0x7f19c013e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01414c0 con 0x7f19c0144300 2024-09-13T17:24:12.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00ae1b0 con 0x7f19c015aff0 2024-09-13T17:24:12.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00ad910 con 0x7f19c00cdc00 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bd400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 0x7f19c00ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bd400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 0x7f19c00ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39696/0 (socket says 172.21.15.139:39696) 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bd400700 1 -- 172.21.15.139:0/1312500829 learned_addr learned my addr 172.21.15.139:0/1312500829 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19bde00700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c013d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.740+0000 7f19be800700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c015aff0 0x7f19c013e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bd400700 1 -- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 msgr2=0x7f19c013d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bd400700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c013d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bd400700 1 -- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c015aff0 msgr2=0x7f19c013e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bd400700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c015aff0 0x7f19c013e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bd400700 1 -- 172.21.15.139:0/1312500829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0094b0 con 0x7f19c0144300 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bd400700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 0x7f19c00ad2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009bd0 tx=0x7f19ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac004400 con 0x7f19c0144300 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac01f070 con 0x7f19c0144300 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0036c0 con 0x7f19c0144300 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c00adbf0 con 0x7f19c0144300 2024-09-13T17:24:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c00cba60 con 0x7f19c0144300 2024-09-13T17:24:12.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.744+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c006dce0 con 0x7f19c0144300 2024-09-13T17:24:12.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.748+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19ac021030 con 0x7f19c0144300 2024-09-13T17:24:12.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.748+0000 7f19b6000700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f19a0066760 0x7f19a0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.748+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19ac084ff0 con 0x7f19c0144300 2024-09-13T17:24:12.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.748+0000 7f19bde00700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f19a0066760 0x7f19a0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.748+0000 7f19bde00700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f19a0066760 0x7f19a0068c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19b0007fd0 tx=0x7f19b0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.752+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19ac052820 con 0x7f19c0144300 2024-09-13T17:24:12.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.932+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19c006a390 con 0x7f19c0144300 2024-09-13T17:24:12.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.932+0000 7f19b6000700 1 -- 172.21.15.139:0/1312500829 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19ac055e40 con 0x7f19c0144300 2024-09-13T17:24:12.940 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:24:12.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f19a0066760 msgr2=0x7f19a0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f19a0066760 0x7f19a0068c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19b0007fd0 tx=0x7f19b0007de0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 msgr2=0x7f19c00ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 0x7f19c00ad2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009bd0 tx=0x7f19ac004770 comp rx=0 tx=0).stop 2024-09-13T17:24:12.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 shutdown_connections 2024-09-13T17:24:12.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f19a0066760 0x7f19a0068c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c015aff0 0x7f19c013e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19c0144300 0x7f19c00ad2a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 --2- 172.21.15.139:0/1312500829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c00cdc00 0x7f19c013d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 >> 172.21.15.139:0/1312500829 conn(0x7f19c00ce9d0 msgr2=0x7f19c00aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 shutdown_connections 2024-09-13T17:24:12.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:12.936+0000 7f19bf200700 1 -- 172.21.15.139:0/1312500829 wait complete. 2024-09-13T17:24:12.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:24:13.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.136+0000 7f6a27e00700 1 Processor -- start 2024-09-13T17:24:13.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27e00700 1 -- start start 2024-09-13T17:24:13.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6a28071570 0x7f6a2815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a2813f810 0x7f6a2813fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2813f0c0 con 0x7f6a28071190 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2815a720 con 0x7f6a28071570 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2815aa00 con 0x7f6a2813f810 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a26000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6a28071570 0x7f6a2815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a2813f810 0x7f6a2813fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a26a00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6a28071190 0x7f6a28159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:57524/0 (socket says 172.21.15.139:57524) 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a26000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6a28071570 0x7f6a2815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39712/0 (socket says 172.21.15.139:39712) 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a26a00700 1 -- 172.21.15.139:0/826819277 learned_addr learned my addr 172.21.15.139:0/826819277 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27400700 1 -- 172.21.15.139:0/826819277 >> v2:172.21.15.139:3300/0 conn(0x7f6a28071570 msgr2=0x7f6a2815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27400700 1 --2- 172.21.15.139:0/826819277 >> v2:172.21.15.139:3300/0 conn(0x7f6a28071570 0x7f6a2815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27400700 1 -- 172.21.15.139:0/826819277 >> v1:172.21.15.176:6789/0 conn(0x7f6a28071190 legacy=0x7f6a28159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.140+0000 7f6a27400700 1 -- 172.21.15.139:0/826819277 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2815ace0 con 0x7f6a2813f810 2024-09-13T17:24:13.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27400700 1 --2- 172.21.15.139:0/826819277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a2813fbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6a2813ced0 tx=0x7f6a20009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=108c3bb70b183a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a25600700 1 -- 172.21.15.139:0/826819277 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000f8a0 con 0x7f6a2813f810 2024-09-13T17:24:13.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a25600700 1 -- 172.21.15.139:0/826819277 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000fa00 con 0x7f6a2813f810 2024-09-13T17:24:13.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a25600700 1 -- 172.21.15.139:0/826819277 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000fd90 con 0x7f6a2813f810 2024-09-13T17:24:13.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 -- 172.21.15.139:0/826819277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 msgr2=0x7f6a2813fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 --2- 172.21.15.139:0/826819277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a2813fbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6a2813ced0 tx=0x7f6a20009b30 comp rx=0 tx=0).stop 2024-09-13T17:24:13.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 -- 172.21.15.139:0/826819277 shutdown_connections 2024-09-13T17:24:13.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 --2- 172.21.15.139:0/826819277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a2813fbf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 --2- 172.21.15.139:0/826819277 >> v2:172.21.15.139:3300/0 conn(0x7f6a28071570 0x7f6a2815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 -- 172.21.15.139:0/826819277 >> 172.21.15.139:0/826819277 conn(0x7f6a280ce9d0 msgr2=0x7f6a280cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:13.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 -- 172.21.15.139:0/826819277 shutdown_connections 2024-09-13T17:24:13.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.144+0000 7f6a27e00700 1 -- 172.21.15.139:0/826819277 wait complete. 2024-09-13T17:24:13.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.148+0000 7f6a27e00700 1 Processor -- start 2024-09-13T17:24:13.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.148+0000 7f6a27e00700 1 -- start start 2024-09-13T17:24:13.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 0x7f6a2813c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a28071570 0x7f6a280cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a280cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28142510 con 0x7f6a28071190 2024-09-13T17:24:13.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2813c730 con 0x7f6a2813f810 2024-09-13T17:24:13.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28141890 con 0x7f6a28071570 2024-09-13T17:24:13.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 0x7f6a2813c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 0x7f6a2813c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39718/0 (socket says 172.21.15.139:39718) 2024-09-13T17:24:13.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 -- 172.21.15.139:0/1371374907 learned_addr learned my addr 172.21.15.139:0/1371374907 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:13.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26000700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a28071570 0x7f6a280cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27400700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a280cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 -- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a28071570 msgr2=0x7f6a280cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a28071570 0x7f6a280cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 -- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 msgr2=0x7f6a280cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a280cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 -- 172.21.15.139:0/1371374907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200094b0 con 0x7f6a28071190 2024-09-13T17:24:13.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a26a00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 0x7f6a2813c1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800cba0 tx=0x7f6a1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800a9e0 con 0x7f6a28071190 2024-09-13T17:24:13.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800ab40 con 0x7f6a28071190 2024-09-13T17:24:13.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a28141b70 con 0x7f6a28071190 2024-09-13T17:24:13.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18012400 con 0x7f6a28071190 2024-09-13T17:24:13.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.152+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a28142130 con 0x7f6a28071190 2024-09-13T17:24:13.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.156+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2813d6f0 con 0x7f6a28071190 2024-09-13T17:24:13.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.156+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a1801b3b0 con 0x7f6a28071190 2024-09-13T17:24:13.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.160+0000 7f6a1ea00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6a08066760 0x7f6a08068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.160+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a180838a0 con 0x7f6a28071190 2024-09-13T17:24:13.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.160+0000 7f6a26000700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6a08066760 0x7f6a08068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.160+0000 7f6a26000700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6a08066760 0x7f6a08068c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a2813cb30 tx=0x7f6a14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.164+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6a18050f70 con 0x7f6a28071190 2024-09-13T17:24:13.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.356+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6a280742b0 con 0x7f6a28071190 2024-09-13T17:24:13.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.356+0000 7f6a1ea00700 1 -- 172.21.15.139:0/1371374907 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6a18017060 con 0x7f6a28071190 2024-09-13T17:24:13.363 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:13.364 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2024-09-13T17:24:13.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:24:13.364 INFO:teuthology.orchestra.run.smithi139.stdout: "poolnum": 1, 2024-09-13T17:24:13.364 INFO:teuthology.orchestra.run.smithi139.stdout: "poolname": ".mgr" 2024-09-13T17:24:13.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:24:13.364 INFO:teuthology.orchestra.run.smithi139.stdout:] 2024-09-13T17:24:13.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6a08066760 msgr2=0x7f6a08068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6a08066760 0x7f6a08068c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a2813cb30 tx=0x7f6a14008040 comp rx=0 tx=0).stop 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 msgr2=0x7f6a2813c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 0x7f6a2813c1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800cba0 tx=0x7f6a1800cc80 comp rx=0 tx=0).stop 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 shutdown_connections 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6a08066760 0x7f6a08068c20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2813f810 0x7f6a280cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a28071570 0x7f6a280cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 --2- 172.21.15.139:0/1371374907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a28071190 0x7f6a2813c1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 >> 172.21.15.139:0/1371374907 conn(0x7f6a280ce9d0 msgr2=0x7f6a2815b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:13.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 shutdown_connections 2024-09-13T17:24:13.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.360+0000 7f6a27e00700 1 -- 172.21.15.139:0/1371374907 wait complete. 2024-09-13T17:24:13.385 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:24:13.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 Processor -- start 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 -- start start 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74b406c440 0x7f74b4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b4144f40 0x7f74b40ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b4145730 con 0x7f74b40d0480 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b4145a10 con 0x7f74b406c440 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.556+0000 7f74b9800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4145cf0 con 0x7f74b4144f40 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74b406c440 0x7f74b4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74b406c440 0x7f74b4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39730/0 (socket says 172.21.15.139:39730) 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 -- 172.21.15.139:0/543738270 learned_addr learned my addr 172.21.15.139:0/543738270 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b8e00700 1 --2- 172.21.15.139:0/543738270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b4144f40 0x7f74b40ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 -- 172.21.15.139:0/543738270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b4144f40 msgr2=0x7f74b40ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 --2- 172.21.15.139:0/543738270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b4144f40 0x7f74b40ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 -- 172.21.15.139:0/543738270 >> v1:172.21.15.176:6789/0 conn(0x7f74b40d0480 legacy=0x7f74b406bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 -- 172.21.15.139:0/543738270 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4145fd0 con 0x7f74b406c440 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b3400700 1 --2- 172.21.15.139:0/543738270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b406c440 0x7f74b4144a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009910 tx=0x7f74a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c020003bedaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b2a00700 1 -- 172.21.15.139:0/543738270 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000ba60 con 0x7f74b406c440 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b2a00700 1 -- 172.21.15.139:0/543738270 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000bbc0 con 0x7f74b406c440 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b2a00700 1 -- 172.21.15.139:0/543738270 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0009e60 con 0x7f74b406c440 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 -- 172.21.15.139:0/543738270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b406c440 msgr2=0x7f74b4144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 --2- 172.21.15.139:0/543738270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b406c440 0x7f74b4144a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009910 tx=0x7f74a0009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 -- 172.21.15.139:0/543738270 shutdown_connections 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 --2- 172.21.15.139:0/543738270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b4144f40 0x7f74b40ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 --2- 172.21.15.139:0/543738270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b406c440 0x7f74b4144a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 -- 172.21.15.139:0/543738270 >> 172.21.15.139:0/543738270 conn(0x7f74b406a390 msgr2=0x7f74b406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 -- 172.21.15.139:0/543738270 shutdown_connections 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.560+0000 7f74b9800700 1 -- 172.21.15.139:0/543738270 wait complete. 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 Processor -- start 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 -- start start 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b406c440 0x7f74b41fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b40d0480 0x7f74b4143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 0x7f74b415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41fb130 con 0x7f74b4144f40 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b415e150 con 0x7f74b406c440 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b9800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40c6f40 con 0x7f74b40d0480 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b8e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 0x7f74b415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b8e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 0x7f74b415fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39738/0 (socket says 172.21.15.139:39738) 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b8e00700 1 -- 172.21.15.139:0/294348608 learned_addr learned my addr 172.21.15.139:0/294348608 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b3400700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b40d0480 0x7f74b4143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.564+0000 7f74b3e00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b406c440 0x7f74b41fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b8e00700 1 -- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b40d0480 msgr2=0x7f74b4143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b8e00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b40d0480 0x7f74b4143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b8e00700 1 -- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b406c440 msgr2=0x7f74b41fabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b8e00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b406c440 0x7f74b41fabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b8e00700 1 -- 172.21.15.139:0/294348608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0009570 con 0x7f74b4144f40 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b8e00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 0x7f74b415fbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007e90 tx=0x7f74ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00ed30 con 0x7f74b4144f40 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac00ee90 con 0x7f74b4144f40 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b4144200 con 0x7f74b4144f40 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac014660 con 0x7f74b4144f40 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b41f7490 con 0x7f74b4144f40 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74ac0147c0 con 0x7f74b4144f40 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.568+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b41464f0 con 0x7f74b4144f40 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.572+0000 7f74abe00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7494066730 0x7f7494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.572+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74ac084400 con 0x7f74b4144f40 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.572+0000 7f74b3e00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7494066730 0x7f7494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.572+0000 7f74b3e00700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7494066730 0x7f7494068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000f60 tx=0x7f74a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.580+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74ac051b60 con 0x7f74b4144f40 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.764+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f74b40b1ba0 con 0x7f74b4144f40 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.944+0000 7f74abe00700 1 -- 172.21.15.139:0/294348608 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f74ac055180 con 0x7f74b4144f40 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7494066730 msgr2=0x7f7494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7494066730 0x7f7494068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000f60 tx=0x7f74a4009040 comp rx=0 tx=0).stop 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 msgr2=0x7f74b415fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 0x7f74b415fbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007e90 tx=0x7f74ac00e3c0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 shutdown_connections 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7494066730 0x7f7494068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74b4144f40 0x7f74b415fbe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74b40d0480 0x7f74b4143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 --2- 172.21.15.139:0/294348608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74b406c440 0x7f74b41fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 >> 172.21.15.139:0/294348608 conn(0x7f74b406a390 msgr2=0x7f74b40b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 shutdown_connections 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:13.952+0000 7f74b9800700 1 -- 172.21.15.139:0/294348608 wait complete. 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' created 2024-09-13T17:24:13.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.164+0000 7f0045000700 1 Processor -- start 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.164+0000 7f0045000700 1 -- start start 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f0045000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00400cfaa0 0x7f00400d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f0045000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400d0230 con 0x7f00400d1810 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f0045000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400d0510 con 0x7f004006bd30 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f0045000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400d07f0 con 0x7f00400cfaa0 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003e800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f00400d1810 0x7f00400b3d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56450/0 (socket says 172.21.15.139:56450) 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003e800700 1 -- 172.21.15.139:0/363977918 learned_addr learned my addr 172.21.15.139:0/363977918 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00400cfaa0 0x7f00400d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822336945 0 0) 0x7f00400d0230 con 0x7f00400d1810 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00240035d0 con 0x7f00400d1810 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3481925860 0 0) 0x7f00240035d0 con 0x7f00400d1810 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00400cfaa0 msgr2=0x7f00400d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00400cfaa0 0x7f00400d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 >> v1:172.21.15.176:6789/0 conn(0x7f004006bd30 legacy=0x7f004006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400d0ad0 con 0x7f00400d1810 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f00380019f0 con 0x7f00400d1810 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 >> v1:172.21.15.139:6789/0 conn(0x7f00400d1810 legacy=0x7f00400b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0024003a50 0x7f0024003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0024004440 0x7f0024004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00240051b0 0x7f002400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400d07f0 con 0x7f0024004440 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002400c0d0 con 0x7f00240051b0 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002400c290 con 0x7f0024003a50 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0024004440 0x7f0024004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003de00700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0024003a50 0x7f0024003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003e800700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00240051b0 0x7f002400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 -- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0024003a50 msgr2=0x7f0024003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0024003a50 0x7f0024003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 -- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00240051b0 msgr2=0x7f002400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00240051b0 0x7f002400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003d400700 1 -- 172.21.15.139:0/363977918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240035d0 con 0x7f0024004440 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.168+0000 7f003de00700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0024003a50 0x7f0024003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f003d400700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0024004440 0x7f0024004910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f002c009a30 tx=0x7f00240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d817715275c7677e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c009da0 con 0x7f0024004440 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00e6c0 con 0x7f0024004440 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f003ca00700 1 -- 172.21.15.139:0/363977918 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00ea30 con 0x7f0024004440 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f0045000700 1 -- 172.21.15.139:0/363977918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0024004440 msgr2=0x7f0024004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f0045000700 1 --2- 172.21.15.139:0/363977918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0024004440 0x7f0024004910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f002c009a30 tx=0x7f00240058a0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f003e800700 1 -- 172.21.15.139:0/363977918 reap_dead start 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f0045000700 1 -- 172.21.15.139:0/363977918 shutdown_connections 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f0045000700 1 -- 172.21.15.139:0/363977918 >> 172.21.15.139:0/363977918 conn(0x7f004006a390 msgr2=0x7f004006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f0045000700 1 -- 172.21.15.139:0/363977918 shutdown_connections 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.172+0000 7f0045000700 1 -- 172.21.15.139:0/363977918 wait complete. 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 Processor -- start 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 -- start start 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 0x7f004014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00401f6ae0 0x7f004013f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f004014d120 0x7f004013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004015a2d0 con 0x7f004014ae20 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004014dc60 con 0x7f004014d120 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f0045000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004014d6a0 con 0x7f00401f6ae0 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f003de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 0x7f004014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f003de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 0x7f004014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39760/0 (socket says 172.21.15.139:39760) 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f003de00700 1 -- 172.21.15.139:0/1125755359 learned_addr learned my addr 172.21.15.139:0/1125755359 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.176+0000 7f003d400700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00401f6ae0 0x7f004013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003e800700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f004014d120 0x7f004013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003de00700 1 -- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00401f6ae0 msgr2=0x7f004013f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003de00700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00401f6ae0 0x7f004013f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003de00700 1 -- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f004014d120 msgr2=0x7f004013f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003de00700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f004014d120 0x7f004013f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003de00700 1 -- 172.21.15.139:0/1125755359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004014d980 con 0x7f004014ae20 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f003de00700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 0x7f004014cbe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f003000e7b0 tx=0x7f003000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00300052e0 con 0x7f004014ae20 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030005440 con 0x7f004014ae20 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004015e6c0 con 0x7f004014ae20 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00300038c0 con 0x7f004014ae20 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004014b200 con 0x7f004014ae20 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.180+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00400d12d0 con 0x7f004014ae20 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.184+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0030003a20 con 0x7f004014ae20 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.184+0000 7f0036000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0020066730 0x7f0020068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.184+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0030083ef0 con 0x7f004014ae20 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.188+0000 7f003d400700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0020066730 0x7f0020068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.188+0000 7f003d400700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0020066730 0x7f0020068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0040067970 tx=0x7f002c01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.188+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00300514e0 con 0x7f004014ae20 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.364+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f00400b1c90 con 0x7f004014ae20 2024-09-13T17:24:14.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.964+0000 7f0036000700 1 -- 172.21.15.139:0/1125755359 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f00300190d0 con 0x7f004014ae20 2024-09-13T17:24:14.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.968+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0020066730 msgr2=0x7f0020068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.968+0000 7f0045000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0020066730 0x7f0020068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0040067970 tx=0x7f002c01f040 comp rx=0 tx=0).stop 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.968+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 msgr2=0x7f004014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.968+0000 7f0045000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 0x7f004014cbe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f003000e7b0 tx=0x7f003000eac0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 shutdown_connections 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0020066730 0x7f0020068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f004014d120 0x7f004013f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00401f6ae0 0x7f004013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 --2- 172.21.15.139:0/1125755359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f004014ae20 0x7f004014cbe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 >> 172.21.15.139:0/1125755359 conn(0x7f004006a390 msgr2=0x7f00400b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 shutdown_connections 2024-09-13T17:24:14.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:14.972+0000 7f0045000700 1 -- 172.21.15.139:0/1125755359 wait complete. 2024-09-13T17:24:14.984 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' created 2024-09-13T17:24:15.012 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:24:15.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 Processor -- start 2024-09-13T17:24:15.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 -- start start 2024-09-13T17:24:15.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1d700ca970 0x7f1d700cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700b2ae0 0x7f1d700b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700b3470 con 0x7f1d70160440 2024-09-13T17:24:15.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700cf180 con 0x7f1d700ca970 2024-09-13T17:24:15.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.172+0000 7f1d75600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700cf460 con 0x7f1d700b2ae0 2024-09-13T17:24:15.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1d700ca970 0x7f1d700cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1d700ca970 0x7f1d700cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45926/0 (socket says 172.21.15.139:45926) 2024-09-13T17:24:15.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6f400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700b2ae0 0x7f1d700b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 -- 172.21.15.139:0/1147971408 learned_addr learned my addr 172.21.15.139:0/1147971408 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:15.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 -- 172.21.15.139:0/1147971408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700b2ae0 msgr2=0x7f1d700b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:15.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 --2- 172.21.15.139:0/1147971408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700b2ae0 0x7f1d700b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 -- 172.21.15.139:0/1147971408 >> v1:172.21.15.176:6789/0 conn(0x7f1d70160440 legacy=0x7f1d700ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 -- 172.21.15.139:0/1147971408 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700cf740 con 0x7f1d700ca970 2024-09-13T17:24:15.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6e000700 1 --2- 172.21.15.139:0/1147971408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700ca970 0x7f1d700cadc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009910 tx=0x7f1d5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900a865f05d2a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:15.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6d600700 1 -- 172.21.15.139:0/1147971408 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011830 con 0x7f1d700ca970 2024-09-13T17:24:15.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6d600700 1 -- 172.21.15.139:0/1147971408 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c011990 con 0x7f1d700ca970 2024-09-13T17:24:15.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d6d600700 1 -- 172.21.15.139:0/1147971408 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011d40 con 0x7f1d700ca970 2024-09-13T17:24:15.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 -- 172.21.15.139:0/1147971408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700ca970 msgr2=0x7f1d700cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 --2- 172.21.15.139:0/1147971408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700ca970 0x7f1d700cadc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009910 tx=0x7f1d5c009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:15.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 -- 172.21.15.139:0/1147971408 shutdown_connections 2024-09-13T17:24:15.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 --2- 172.21.15.139:0/1147971408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700b2ae0 0x7f1d700b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 --2- 172.21.15.139:0/1147971408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700ca970 0x7f1d700cadc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 -- 172.21.15.139:0/1147971408 >> 172.21.15.139:0/1147971408 conn(0x7f1d7006a390 msgr2=0x7f1d7006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:15.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.176+0000 7f1d75600700 1 -- 172.21.15.139:0/1147971408 shutdown_connections 2024-09-13T17:24:15.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 -- 172.21.15.139:0/1147971408 wait complete. 2024-09-13T17:24:15.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 Processor -- start 2024-09-13T17:24:15.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 -- start start 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 0x7f1d701539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700ca970 0x7f1d70152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d70160440 0x7f1d701f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70152ba0 con 0x7f1d700b2ae0 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701f3a50 con 0x7f1d70160440 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d75600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701552b0 con 0x7f1d700ca970 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.180+0000 7f1d6ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 0x7f1d701539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 0x7f1d701539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45930/0 (socket says 172.21.15.139:45930) 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 -- 172.21.15.139:0/2365056603 learned_addr learned my addr 172.21.15.139:0/2365056603 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6f400700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d70160440 0x7f1d701f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6e000700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700ca970 0x7f1d70152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 -- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700ca970 msgr2=0x7f1d70152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700ca970 0x7f1d70152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 -- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d70160440 msgr2=0x7f1d701f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d70160440 0x7f1d701f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 -- 172.21.15.139:0/2365056603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c009570 con 0x7f1d700b2ae0 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d6ea00700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 0x7f1d701539b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c510 tx=0x7f1d6000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600052d0 con 0x7f1d700b2ae0 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60005430 con 0x7f1d700b2ae0 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600055a0 con 0x7f1d700b2ae0 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d70153f90 con 0x7f1d700b2ae0 2024-09-13T17:24:15.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d70154550 con 0x7f1d700b2ae0 2024-09-13T17:24:15.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.184+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d700b4b00 con 0x7f1d700b2ae0 2024-09-13T17:24:15.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.188+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d60003900 con 0x7f1d700b2ae0 2024-09-13T17:24:15.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.188+0000 7f1d66a00700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d50066730 0x7f1d50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.188+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1d60083360 con 0x7f1d700b2ae0 2024-09-13T17:24:15.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.188+0000 7f1d6e000700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d50066730 0x7f1d50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.192+0000 7f1d6e000700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d50066730 0x7f1d50068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:15.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.196+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d60050690 con 0x7f1d700b2ae0 2024-09-13T17:24:15.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.412+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1d700b3420 con 0x7f1d700b2ae0 2024-09-13T17:24:15.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.428+0000 7f1d66a00700 1 -- 172.21.15.139:0/2365056603 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1d60053cb0 con 0x7f1d700b2ae0 2024-09-13T17:24:15.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d50066730 msgr2=0x7f1d50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d50066730 0x7f1d50068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c008030 comp rx=0 tx=0).stop 2024-09-13T17:24:15.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 msgr2=0x7f1d701539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 0x7f1d701539b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c510 tx=0x7f1d6000c820 comp rx=0 tx=0).stop 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 shutdown_connections 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d50066730 0x7f1d50068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d70160440 0x7f1d701f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d700ca970 0x7f1d70152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 --2- 172.21.15.139:0/2365056603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d700b2ae0 0x7f1d701539b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.432+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 >> 172.21.15.139:0/2365056603 conn(0x7f1d7006a390 msgr2=0x7f1d7006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:15.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.436+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 shutdown_connections 2024-09-13T17:24:15.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.436+0000 7f1d75600700 1 -- 172.21.15.139:0/2365056603 wait complete. 2024-09-13T17:24:15.443 INFO:teuthology.orchestra.run.smithi139.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T17:24:15.469 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T17:24:15.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T17:24:15.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.628+0000 7f899fe00700 1 Processor -- start 2024-09-13T17:24:15.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.628+0000 7f899fe00700 1 -- start start 2024-09-13T17:24:15.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a00b5190 0x7f89a01607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f89a006d140 0x7f89a00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899fe00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a0161150 con 0x7f89a0160d10 2024-09-13T17:24:15.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899fe00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00b5570 con 0x7f89a006d140 2024-09-13T17:24:15.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a006d6b0 con 0x7f89a00b5190 2024-09-13T17:24:15.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899f400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f89a006d140 0x7f89a00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899f400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f89a006d140 0x7f89a00b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45946/0 (socket says 172.21.15.139:45946) 2024-09-13T17:24:15.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899f400700 1 -- 172.21.15.139:0/1485060149 learned_addr learned my addr 172.21.15.139:0/1485060149 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:15.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.632+0000 7f899ea00700 1 --2- 172.21.15.139:0/1485060149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a00b5190 0x7f89a01607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899f400700 1 -- 172.21.15.139:0/1485060149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a00b5190 msgr2=0x7f89a01607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899f400700 1 --2- 172.21.15.139:0/1485060149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a00b5190 0x7f89a01607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899f400700 1 -- 172.21.15.139:0/1485060149 >> v1:172.21.15.176:6789/0 conn(0x7f89a0160d10 legacy=0x7f89a006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899f400700 1 -- 172.21.15.139:0/1485060149 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a006d990 con 0x7f89a006d140 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899d600700 1 -- 172.21.15.139:0/1485060149 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864768774 0 0) 0x7f89a0161150 con 0x7f89a0160d10 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899f400700 1 --2- 172.21.15.139:0/1485060149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a006d140 0x7f89a00b1510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8998009e50 tx=0x7f899800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ada01e6922fbe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:15.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899d600700 1 -- 172.21.15.139:0/1485060149 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800e070 con 0x7f89a006d140 2024-09-13T17:24:15.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899d600700 1 -- 172.21.15.139:0/1485060149 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800b910 con 0x7f89a006d140 2024-09-13T17:24:15.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899d600700 1 -- 172.21.15.139:0/1485060149 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800bcc0 con 0x7f89a006d140 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 -- 172.21.15.139:0/1485060149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a006d140 msgr2=0x7f89a00b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 --2- 172.21.15.139:0/1485060149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a006d140 0x7f89a00b1510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8998009e50 tx=0x7f899800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 -- 172.21.15.139:0/1485060149 shutdown_connections 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 --2- 172.21.15.139:0/1485060149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a006d140 0x7f89a00b1510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 --2- 172.21.15.139:0/1485060149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a00b5190 0x7f89a01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 -- 172.21.15.139:0/1485060149 >> 172.21.15.139:0/1485060149 conn(0x7f89a0072030 msgr2=0x7f89a0072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 -- 172.21.15.139:0/1485060149 shutdown_connections 2024-09-13T17:24:15.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.636+0000 7f899fe00700 1 -- 172.21.15.139:0/1485060149 wait complete. 2024-09-13T17:24:15.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.640+0000 7f899fe00700 1 Processor -- start 2024-09-13T17:24:15.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.640+0000 7f899fe00700 1 -- start start 2024-09-13T17:24:15.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a006d140 0x7f89a01efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89a00b5190 0x7f89a01f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 0x7f89a00cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a014cc70 con 0x7f89a0160d10 2024-09-13T17:24:15.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01f2f00 con 0x7f89a00b5190 2024-09-13T17:24:15.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00ca1a0 con 0x7f89a006d140 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 0x7f89a00cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899ea00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a006d140 0x7f89a01efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 0x7f89a00cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45958/0 (socket says 172.21.15.139:45958) 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 -- 172.21.15.139:0/2672036036 learned_addr learned my addr 172.21.15.139:0/2672036036 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899e000700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89a00b5190 0x7f89a01f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 -- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a006d140 msgr2=0x7f89a01efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a006d140 0x7f89a01efb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 -- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89a00b5190 msgr2=0x7f89a01f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89a00b5190 0x7f89a01f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:15.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 -- 172.21.15.139:0/2672036036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998009b30 con 0x7f89a0160d10 2024-09-13T17:24:15.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899f400700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 0x7f89a00cf1d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f899800b680 tx=0x7f8998004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:15.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980048b0 con 0x7f89a0160d10 2024-09-13T17:24:15.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980099b0 con 0x7f89a0160d10 2024-09-13T17:24:15.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899801c680 con 0x7f89a0160d10 2024-09-13T17:24:15.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a00ca480 con 0x7f89a0160d10 2024-09-13T17:24:15.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.644+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a00cc180 con 0x7f89a0160d10 2024-09-13T17:24:15.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.648+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a00b1510 con 0x7f89a0160d10 2024-09-13T17:24:15.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.648+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f899801c7e0 con 0x7f89a0160d10 2024-09-13T17:24:15.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.652+0000 7f8996a00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8980066730 0x7f8980068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:15.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.652+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8998085d40 con 0x7f89a0160d10 2024-09-13T17:24:15.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.652+0000 7f899ea00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8980066730 0x7f8980068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:15.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.652+0000 7f899ea00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8980066730 0x7f8980068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8990009bf0 tx=0x7f8990009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:15.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.660+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89980530a0 con 0x7f89a0160d10 2024-09-13T17:24:15.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:15.848+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f89a00cc340 con 0x7f89a0160d10 2024-09-13T17:24:16.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.428+0000 7f8996a00700 1 -- 172.21.15.139:0/2672036036 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f89980566c0 con 0x7f89a0160d10 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8980066730 msgr2=0x7f8980068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8980066730 0x7f8980068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8990009bf0 tx=0x7f8990009240 comp rx=0 tx=0).stop 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 msgr2=0x7f89a00cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 0x7f89a00cf1d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f899800b680 tx=0x7f8998004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 shutdown_connections 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8980066730 0x7f8980068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89a0160d10 0x7f89a00cf1d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89a00b5190 0x7f89a01f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 --2- 172.21.15.139:0/2672036036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89a006d140 0x7f89a01efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 >> 172.21.15.139:0/2672036036 conn(0x7f89a0072030 msgr2=0x7f89a015fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:16.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 shutdown_connections 2024-09-13T17:24:16.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.432+0000 7f899fe00700 1 -- 172.21.15.139:0/2672036036 wait complete. 2024-09-13T17:24:16.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:24:16.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.632+0000 7f7ac1e00700 1 Processor -- start 2024-09-13T17:24:16.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac1e00700 1 -- start start 2024-09-13T17:24:16.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac1e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:16.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac1e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc06d860 con 0x7f7abc1466f0 2024-09-13T17:24:16.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac1e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0d14a0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac1e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc06c9f0 con 0x7f7abc0d0b20 2024-09-13T17:24:16.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac0a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7abc1466f0 0x7f7abc0cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50458/0 (socket says 172.21.15.139:50458) 2024-09-13T17:24:16.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.636+0000 7f7ac0a00700 1 -- 172.21.15.139:0/3795326192 learned_addr learned my addr 172.21.15.139:0/3795326192 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:16.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abbe00700 1 --2- 172.21.15.139:0/3795326192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:16.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abb400700 1 -- 172.21.15.139:0/3795326192 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509400039 0 0) 0x7f7abc06d860 con 0x7f7abc1466f0 2024-09-13T17:24:16.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abb400700 1 -- 172.21.15.139:0/3795326192 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa40035d0 con 0x7f7abc1466f0 2024-09-13T17:24:16.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abbe00700 1 -- 172.21.15.139:0/3795326192 >> v1:172.21.15.176:6789/0 conn(0x7f7abc0b0bc0 legacy=0x7f7abc0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abbe00700 1 -- 172.21.15.139:0/3795326192 >> v1:172.21.15.139:6789/0 conn(0x7f7abc1466f0 legacy=0x7f7abc0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abbe00700 1 -- 172.21.15.139:0/3795326192 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc06dcf0 con 0x7f7abc0d0b20 2024-09-13T17:24:16.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abbe00700 1 --2- 172.21.15.139:0/3795326192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0d0f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80098b0 tx=0x7f7aa8009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4d7d9281ac16bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:16.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abb400700 1 -- 172.21.15.139:0/3795326192 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8011830 con 0x7f7abc0d0b20 2024-09-13T17:24:16.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abb400700 1 -- 172.21.15.139:0/3795326192 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8011990 con 0x7f7abc0d0b20 2024-09-13T17:24:16.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7abb400700 1 -- 172.21.15.139:0/3795326192 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8011d20 con 0x7f7abc0d0b20 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 -- 172.21.15.139:0/3795326192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 msgr2=0x7f7abc0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/3795326192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0d0f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80098b0 tx=0x7f7aa8009bc0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 -- 172.21.15.139:0/3795326192 shutdown_connections 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/3795326192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0d0f60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 -- 172.21.15.139:0/3795326192 >> 172.21.15.139:0/3795326192 conn(0x7f7abc071fc0 msgr2=0x7f7abc0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 -- 172.21.15.139:0/3795326192 shutdown_connections 2024-09-13T17:24:16.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.640+0000 7f7ac1e00700 1 -- 172.21.15.139:0/3795326192 wait complete. 2024-09-13T17:24:16.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 Processor -- start 2024-09-13T17:24:16.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 -- start start 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 0x7f7abc15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7abc1466f0 0x7f7abc143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b1d90 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc15ce80 con 0x7f7abc1466f0 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b1110 con 0x7f7abc0d0b20 2024-09-13T17:24:16.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 0x7f7abc15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7abbe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 0x7f7abc15c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45966/0 (socket says 172.21.15.139:45966) 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 -- 172.21.15.139:0/2354857474 learned_addr learned my addr 172.21.15.139:0/2354857474 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1400700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7abc1466f0 0x7f7abc143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 -- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 msgr2=0x7f7abc0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 -- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7abc1466f0 msgr2=0x7f7abc143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:16.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7abc1466f0 0x7f7abc143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:16.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac0a00700 1 -- 172.21.15.139:0/2354857474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80094b0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7ac1400700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7abc1466f0 0x7f7abc143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.644+0000 7f7abbe00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ac0a00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 0x7f7abc15c940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c4d0 tx=0x7f7ab000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0005d90 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab00070d0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc0b13f0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0007480 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc0b19b0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0677e0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.648+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ab00075e0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.652+0000 7f7ab8c00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7a9c066730 0x7f7a9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:16.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.652+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7ab00836c0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.652+0000 7f7abbe00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7a9c066730 0x7f7a9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:16.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.652+0000 7f7abbe00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7a9c066730 0x7f7a9c068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80098b0 tx=0x7f7aa8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:16.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.660+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ab00508b0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:16.840+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7abc146ad0 con 0x7f7abc0b0bc0 2024-09-13T17:24:16.937 INFO:tasks.ceph.mds.b.smithi176.stderr:2024-09-13T17:24:16.932+0000 7f07d0800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:24:18.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.444+0000 7f7ab8c00700 1 -- 172.21.15.139:0/2354857474 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7ab0053ed0 con 0x7f7abc0b0bc0 2024-09-13T17:24:18.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7a9c066730 msgr2=0x7f7a9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:18.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7a9c066730 0x7f7a9c068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80098b0 tx=0x7f7aa8008030 comp rx=0 tx=0).stop 2024-09-13T17:24:18.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 msgr2=0x7f7abc15c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:18.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 0x7f7abc15c940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c4d0 tx=0x7f7ab000c7e0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 shutdown_connections 2024-09-13T17:24:18.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7a9c066730 0x7f7a9c068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7abc1466f0 0x7f7abc143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7abc0d0b20 0x7f7abc0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 --2- 172.21.15.139:0/2354857474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7abc0b0bc0 0x7f7abc15c940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.456+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 >> 172.21.15.139:0/2354857474 conn(0x7f7abc071fc0 msgr2=0x7f7abc15f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:18.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.460+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 shutdown_connections 2024-09-13T17:24:18.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.460+0000 7f7ac1e00700 1 -- 172.21.15.139:0/2354857474 wait complete. 2024-09-13T17:24:18.471 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data_ec' created 2024-09-13T17:24:18.489 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T17:24:18.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.656+0000 7fdaa3000700 1 Processor -- start 2024-09-13T17:24:18.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.656+0000 7fdaa3000700 1 -- start start 2024-09-13T17:24:18.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa3000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda9c0ce0d0 0x7fda9c06fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:18.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa3000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0b3960 0x7fda9c06b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:18.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa3000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c070480 con 0x7fda9c14ab50 2024-09-13T17:24:18.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa3000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c070760 con 0x7fda9c0ce0d0 2024-09-13T17:24:18.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa3000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c070a40 con 0x7fda9c0b3960 2024-09-13T17:24:18.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa1c00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fda9c14ab50 0x7fda9c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50470/0 (socket says 172.21.15.139:50470) 2024-09-13T17:24:18.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa1c00700 1 -- 172.21.15.139:0/2447329213 learned_addr learned my addr 172.21.15.139:0/2447329213 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:18.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa1200700 1 --2- 172.21.15.139:0/2447329213 >> v2:172.21.15.176:3300/0 conn(0x7fda9c0ce0d0 0x7fda9c06fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:18.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa2600700 1 --2- 172.21.15.139:0/2447329213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0b3960 0x7fda9c06b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:18.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fda9be00700 1 -- 172.21.15.139:0/2447329213 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488453396 0 0) 0x7fda9c070480 con 0x7fda9c14ab50 2024-09-13T17:24:18.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa2600700 1 -- 172.21.15.139:0/2447329213 >> v2:172.21.15.176:3300/0 conn(0x7fda9c0ce0d0 msgr2=0x7fda9c06fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa2600700 1 --2- 172.21.15.139:0/2447329213 >> v2:172.21.15.176:3300/0 conn(0x7fda9c0ce0d0 0x7fda9c06fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa2600700 1 -- 172.21.15.139:0/2447329213 >> v1:172.21.15.139:6789/0 conn(0x7fda9c14ab50 legacy=0x7fda9c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa2600700 1 -- 172.21.15.139:0/2447329213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c070d20 con 0x7fda9c0b3960 2024-09-13T17:24:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fdaa2600700 1 --2- 172.21.15.139:0/2447329213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0b3960 0x7fda9c06b820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda94009dc0 tx=0x7fda9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48af8998d65d360 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fda9be00700 1 -- 172.21.15.139:0/2447329213 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400e070 con 0x7fda9c0b3960 2024-09-13T17:24:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fda9be00700 1 -- 172.21.15.139:0/2447329213 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400bae0 con 0x7fda9c0b3960 2024-09-13T17:24:18.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.660+0000 7fda9be00700 1 -- 172.21.15.139:0/2447329213 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400be90 con 0x7fda9c0b3960 2024-09-13T17:24:18.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 -- 172.21.15.139:0/2447329213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0b3960 msgr2=0x7fda9c06b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:18.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 --2- 172.21.15.139:0/2447329213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0b3960 0x7fda9c06b820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda94009dc0 tx=0x7fda9400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:18.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 -- 172.21.15.139:0/2447329213 shutdown_connections 2024-09-13T17:24:18.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 --2- 172.21.15.139:0/2447329213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0b3960 0x7fda9c06b820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 --2- 172.21.15.139:0/2447329213 >> v2:172.21.15.176:3300/0 conn(0x7fda9c0ce0d0 0x7fda9c06fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 -- 172.21.15.139:0/2447329213 >> 172.21.15.139:0/2447329213 conn(0x7fda9c0cb5b0 msgr2=0x7fda9c0cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:18.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 -- 172.21.15.139:0/2447329213 shutdown_connections 2024-09-13T17:24:18.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.664+0000 7fdaa3000700 1 -- 172.21.15.139:0/2447329213 wait complete. 2024-09-13T17:24:18.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 Processor -- start 2024-09-13T17:24:18.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 -- start start 2024-09-13T17:24:18.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 0x7fda9c145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0ce0d0 0x7fda9c142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda9c14ab50 0x7fda9c138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c142b90 con 0x7fda9c0b3960 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c139000 con 0x7fda9c14ab50 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa3000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1450f0 con 0x7fda9c0ce0d0 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 0x7fda9c145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 0x7fda9c145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45972/0 (socket says 172.21.15.139:45972) 2024-09-13T17:24:18.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 -- 172.21.15.139:0/417736162 learned_addr learned my addr 172.21.15.139:0/417736162 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:18.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1200700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0ce0d0 0x7fda9c142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 -- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0ce0d0 msgr2=0x7fda9c142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0ce0d0 0x7fda9c142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 -- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda9c14ab50 msgr2=0x7fda9c138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda9c14ab50 0x7fda9c138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1c00700 1 -- 172.21.15.139:0/417736162 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009a70 con 0x7fda9c0b3960 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.668+0000 7fdaa1200700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0ce0d0 0x7fda9c142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fdaa1c00700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 0x7fda9c145580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c4e0 tx=0x7fda9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90004ca0 con 0x7fda9c0b3960 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90004e20 con 0x7fda9c0b3960 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90007310 con 0x7fda9c0b3960 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c164610 con 0x7fda9c0b3960 2024-09-13T17:24:18.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c144aa0 con 0x7fda9c0b3960 2024-09-13T17:24:18.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.672+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c06bd40 con 0x7fda9c0b3960 2024-09-13T17:24:18.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.676+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda90007470 con 0x7fda9c0b3960 2024-09-13T17:24:18.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.676+0000 7fda99600700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fda7c066760 0x7fda7c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:18.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.676+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fda90084670 con 0x7fda9c0b3960 2024-09-13T17:24:18.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.676+0000 7fdaa1200700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fda7c066760 0x7fda7c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:18.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.680+0000 7fdaa1200700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fda7c066760 0x7fda7c068c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06dc80 tx=0x7fda88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:18.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.680+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda900516f0 con 0x7fda9c0b3960 2024-09-13T17:24:18.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:18.860+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fda9c06bd40 con 0x7fda9c0b3960 2024-09-13T17:24:19.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.456+0000 7fda99600700 1 -- 172.21.15.139:0/417736162 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fda9c06bd40 con 0x7fda9c0b3960 2024-09-13T17:24:19.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fda7c066760 msgr2=0x7fda7c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fda7c066760 0x7fda7c068c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06dc80 tx=0x7fda88008040 comp rx=0 tx=0).stop 2024-09-13T17:24:19.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 msgr2=0x7fda9c145580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 0x7fda9c145580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c4e0 tx=0x7fda9000c8a0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 shutdown_connections 2024-09-13T17:24:19.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fda7c066760 0x7fda7c068c20 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06dc80 tx=0x7fda88008040 comp rx=0 tx=0).stop 2024-09-13T17:24:19.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda9c14ab50 0x7fda9c138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda9c0ce0d0 0x7fda9c142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 --2- 172.21.15.139:0/417736162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda9c0b3960 0x7fda9c145580 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c4e0 tx=0x7fda9000c8a0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.468+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 >> 172.21.15.139:0/417736162 conn(0x7fda9c0cb5b0 msgr2=0x7fda9c071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:19.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.472+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 shutdown_connections 2024-09-13T17:24:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.472+0000 7fdaa3000700 1 -- 172.21.15.139:0/417736162 wait complete. 2024-09-13T17:24:19.487 INFO:teuthology.orchestra.run.smithi139.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T17:24:19.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T17:24:19.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.668+0000 7fcdd1a00700 1 Processor -- start 2024-09-13T17:24:19.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.668+0000 7fcdd1a00700 1 -- start start 2024-09-13T17:24:19.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.668+0000 7fcdd1a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcdcc15dfd0 0x7fcdcc13d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:19.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.668+0000 7fcdd1a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc13f0c0 con 0x7fcdcc071570 2024-09-13T17:24:19.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.668+0000 7fcdd1a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc15a720 con 0x7fcdcc071190 2024-09-13T17:24:19.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.668+0000 7fcdd1a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc15aa00 con 0x7fcdcc15dfd0 2024-09-13T17:24:19.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdc3400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcdcc071570 0x7fcdcc13f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50474/0 (socket says 172.21.15.139:50474) 2024-09-13T17:24:19.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdc3400700 1 -- 172.21.15.139:0/2939481016 learned_addr learned my addr 172.21.15.139:0/2939481016 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:19.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1000700 1 --2- 172.21.15.139:0/2939481016 >> v2:172.21.15.176:3300/0 conn(0x7fcdcc15dfd0 0x7fcdcc13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:19.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdcb400700 1 -- 172.21.15.139:0/2939481016 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321237975 0 0) 0x7fcdcc13f0c0 con 0x7fcdcc071570 2024-09-13T17:24:19.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdcb400700 1 -- 172.21.15.139:0/2939481016 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb00035d0 con 0x7fcdcc071570 2024-09-13T17:24:19.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1000700 1 -- 172.21.15.139:0/2939481016 >> v1:172.21.15.176:6789/0 conn(0x7fcdcc071190 legacy=0x7fcdcc159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdcb400700 1 -- 172.21.15.139:0/2939481016 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450061577 0 0) 0x7fcdcc15a720 con 0x7fcdcc071190 2024-09-13T17:24:19.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1000700 1 -- 172.21.15.139:0/2939481016 >> v1:172.21.15.139:6789/0 conn(0x7fcdcc071570 legacy=0x7fcdcc13f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1000700 1 -- 172.21.15.139:0/2939481016 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc15ace0 con 0x7fcdcc15dfd0 2024-09-13T17:24:19.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1000700 1 --2- 172.21.15.139:0/2939481016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc15dfd0 0x7fcdcc13d030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009d90 tx=0x7fcdc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2beb37a40fa5573 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:19.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdcb400700 1 -- 172.21.15.139:0/2939481016 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400e070 con 0x7fcdcc15dfd0 2024-09-13T17:24:19.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdcb400700 1 -- 172.21.15.139:0/2939481016 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400bb20 con 0x7fcdcc15dfd0 2024-09-13T17:24:19.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdcb400700 1 -- 172.21.15.139:0/2939481016 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400bed0 con 0x7fcdcc15dfd0 2024-09-13T17:24:19.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1a00700 1 -- 172.21.15.139:0/2939481016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc15dfd0 msgr2=0x7fcdcc13d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.672+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/2939481016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc15dfd0 0x7fcdcc13d030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009d90 tx=0x7fcdc400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:19.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 -- 172.21.15.139:0/2939481016 shutdown_connections 2024-09-13T17:24:19.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/2939481016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc15dfd0 0x7fcdcc13d030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 -- 172.21.15.139:0/2939481016 >> 172.21.15.139:0/2939481016 conn(0x7fcdcc0ce9d0 msgr2=0x7fcdcc0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:19.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 -- 172.21.15.139:0/2939481016 shutdown_connections 2024-09-13T17:24:19.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 -- 172.21.15.139:0/2939481016 wait complete. 2024-09-13T17:24:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 Processor -- start 2024-09-13T17:24:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.676+0000 7fcdd1a00700 1 -- start start 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc071190 0x7fcdcc0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 0x7fcdcc152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdcc15dfd0 0x7fcdcc0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc153060 con 0x7fcdcc071570 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc1f23d0 con 0x7fcdcc071190 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc1f2620 con 0x7fcdcc15dfd0 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 0x7fcdcc152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 0x7fcdcc152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45986/0 (socket says 172.21.15.139:45986) 2024-09-13T17:24:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 -- 172.21.15.139:0/1962902393 learned_addr learned my addr 172.21.15.139:0/1962902393 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1000700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdcc15dfd0 0x7fcdcc0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdcbe00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc071190 0x7fcdcc0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 -- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdcc15dfd0 msgr2=0x7fcdcc0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdcc15dfd0 0x7fcdcc0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 -- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc071190 msgr2=0x7fcdcc0c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc071190 0x7fcdcc0c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 -- 172.21.15.139:0/1962902393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc4009a70 con 0x7fcdcc071570 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc3400700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 0x7fcdcc152b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400c4f0 tx=0x7fcdb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4005d90 con 0x7fcdcc071570 2024-09-13T17:24:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb40070d0 con 0x7fcdcc071570 2024-09-13T17:24:19.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc1f2900 con 0x7fcdcc071570 2024-09-13T17:24:19.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4007440 con 0x7fcdcc071570 2024-09-13T17:24:19.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.680+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc1f2ec0 con 0x7fcdcc071570 2024-09-13T17:24:19.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.684+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc13d900 con 0x7fcdcc071570 2024-09-13T17:24:19.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.684+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcdb40075a0 con 0x7fcdcc071570 2024-09-13T17:24:19.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.688+0000 7fcdc8c00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcda8066730 0x7fcda8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:19.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.688+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fcdb40837c0 con 0x7fcdcc071570 2024-09-13T17:24:19.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.688+0000 7fcdcbe00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcda8066730 0x7fcda8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:19.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.688+0000 7fcdcbe00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcda8066730 0x7fcda8068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc000f60 tx=0x7fcdbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:19.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.692+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcdb40509a0 con 0x7fcdcc071570 2024-09-13T17:24:19.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.916+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fcdcc06d920 con 0x7fcdcc071570 2024-09-13T17:24:19.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.928+0000 7fcdc8c00700 1 -- 172.21.15.139:0/1962902393 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fcdb4053fc0 con 0x7fcdcc071570 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcda8066730 msgr2=0x7fcda8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcda8066730 0x7fcda8068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc000f60 tx=0x7fcdbc009040 comp rx=0 tx=0).stop 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 msgr2=0x7fcdcc152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 0x7fcdcc152b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400c4f0 tx=0x7fcdb400c8b0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 shutdown_connections 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcda8066730 0x7fcda8068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdcc15dfd0 0x7fcdcc0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdcc071570 0x7fcdcc152b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 --2- 172.21.15.139:0/1962902393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdcc071190 0x7fcdcc0c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 >> 172.21.15.139:0/1962902393 conn(0x7fcdcc0ce9d0 msgr2=0x7fcdcc159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 shutdown_connections 2024-09-13T17:24:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:19.932+0000 7fcdd1a00700 1 -- 172.21.15.139:0/1962902393 wait complete. 2024-09-13T17:24:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:added data pool 4 to fsmap 2024-09-13T17:24:19.961 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:20.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 Processor -- start 2024-09-13T17:24:20.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 -- start start 2024-09-13T17:24:20.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2f98144770 0x7f2f980ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2f9806d9b0 0x7f2f9815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9815c160 con 0x7f2f9815b1c0 2024-09-13T17:24:20.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9815c540 con 0x7f2f98144770 2024-09-13T17:24:20.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9f000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f98144b50 con 0x7f2f9806d9b0 2024-09-13T17:24:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f97e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2f98144770 0x7f2f980ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f97e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2f98144770 0x7f2f980ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45990/0 (socket says 172.21.15.139:45990) 2024-09-13T17:24:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f97e00700 1 -- 172.21.15.139:0/730220736 learned_addr learned my addr 172.21.15.139:0/730220736 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.128+0000 7f2f9d000700 1 --2- 172.21.15.139:0/730220736 >> v2:172.21.15.176:3300/0 conn(0x7f2f9806d9b0 0x7f2f9815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f96a00700 1 -- 172.21.15.139:0/730220736 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37440989 0 0) 0x7f2f9815c160 con 0x7f2f9815b1c0 2024-09-13T17:24:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f97e00700 1 -- 172.21.15.139:0/730220736 >> v2:172.21.15.176:3300/0 conn(0x7f2f9806d9b0 msgr2=0x7f2f9815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f97e00700 1 --2- 172.21.15.139:0/730220736 >> v2:172.21.15.176:3300/0 conn(0x7f2f9806d9b0 0x7f2f9815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f97e00700 1 -- 172.21.15.139:0/730220736 >> v1:172.21.15.176:6789/0 conn(0x7f2f9815b1c0 legacy=0x7f2f9806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f97e00700 1 -- 172.21.15.139:0/730220736 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9815b620 con 0x7f2f98144770 2024-09-13T17:24:20.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f97e00700 1 --2- 172.21.15.139:0/730220736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f98144770 0x7f2f980ce5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f980cbbd0 tx=0x7f2f8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536e06866b26128e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:20.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f96a00700 1 -- 172.21.15.139:0/730220736 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800e070 con 0x7f2f98144770 2024-09-13T17:24:20.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f96a00700 1 -- 172.21.15.139:0/730220736 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800b910 con 0x7f2f98144770 2024-09-13T17:24:20.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f96a00700 1 -- 172.21.15.139:0/730220736 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800bcc0 con 0x7f2f98144770 2024-09-13T17:24:20.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 -- 172.21.15.139:0/730220736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f98144770 msgr2=0x7f2f980ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 --2- 172.21.15.139:0/730220736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f98144770 0x7f2f980ce5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f980cbbd0 tx=0x7f2f8800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:20.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 -- 172.21.15.139:0/730220736 shutdown_connections 2024-09-13T17:24:20.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 --2- 172.21.15.139:0/730220736 >> v2:172.21.15.176:3300/0 conn(0x7f2f9806d9b0 0x7f2f9815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 --2- 172.21.15.139:0/730220736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f98144770 0x7f2f980ce5f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 -- 172.21.15.139:0/730220736 >> 172.21.15.139:0/730220736 conn(0x7f2f9806b1e0 msgr2=0x7f2f9806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 -- 172.21.15.139:0/730220736 shutdown_connections 2024-09-13T17:24:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.132+0000 7f2f9f000700 1 -- 172.21.15.139:0/730220736 wait complete. 2024-09-13T17:24:20.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 Processor -- start 2024-09-13T17:24:20.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 -- start start 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 0x7f2f9815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f98144770 0x7f2f98070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f9815b1c0 0x7f2f98071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ae200 con 0x7f2f9806d9b0 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ad580 con 0x7f2f9815b1c0 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9f000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ad860 con 0x7f2f98144770 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 0x7f2f9815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 0x7f2f9815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45992/0 (socket says 172.21.15.139:45992) 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 -- 172.21.15.139:0/4220111106 learned_addr learned my addr 172.21.15.139:0/4220111106 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f9d000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f9815b1c0 0x7f2f98071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97400700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f98144770 0x7f2f98070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 -- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f98144770 msgr2=0x7f2f98070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f98144770 0x7f2f98070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 -- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f9815b1c0 msgr2=0x7f2f98071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f9815b1c0 0x7f2f98071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97e00700 1 -- 172.21.15.139:0/4220111106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88009b30 con 0x7f2f9806d9b0 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.136+0000 7f2f97400700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f98144770 0x7f2f98070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:20.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f97e00700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 0x7f2f9815a6f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806fd20 tx=0x7f2f88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:20.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880092e0 con 0x7f2f9806d9b0 2024-09-13T17:24:20.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f880099b0 con 0x7f2f9806d9b0 2024-09-13T17:24:20.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f980adb40 con 0x7f2f9806d9b0 2024-09-13T17:24:20.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8801c680 con 0x7f2f9806d9b0 2024-09-13T17:24:20.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9815ac30 con 0x7f2f9806d9b0 2024-09-13T17:24:20.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.140+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f981f2900 con 0x7f2f9806d9b0 2024-09-13T17:24:20.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.144+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f8801c7e0 con 0x7f2f9806d9b0 2024-09-13T17:24:20.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.144+0000 7f2f8fe00700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2f78066730 0x7f2f78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.144+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f88085e10 con 0x7f2f9806d9b0 2024-09-13T17:24:20.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.144+0000 7f2f97400700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2f78066730 0x7f2f78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.144+0000 7f2f97400700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2f78066730 0x7f2f78068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f9813d4b0 tx=0x7f2f84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:20.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.152+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f88052f20 con 0x7f2f9806d9b0 2024-09-13T17:24:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.376+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f980ce5f0 con 0x7f2f9806d9b0 2024-09-13T17:24:20.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f8fe00700 1 -- 172.21.15.139:0/4220111106 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f2f88056540 con 0x7f2f9806d9b0 2024-09-13T17:24:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:20.387 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:19.923907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2f78066730 msgr2=0x7f2f78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2f78066730 0x7f2f78068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f9813d4b0 tx=0x7f2f84009040 comp rx=0 tx=0).stop 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 msgr2=0x7f2f9815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 0x7f2f9815a6f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806fd20 tx=0x7f2f88004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 shutdown_connections 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2f78066730 0x7f2f78068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f9815b1c0 0x7f2f98071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f98144770 0x7f2f98070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 --2- 172.21.15.139:0/4220111106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f9806d9b0 0x7f2f9815a6f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 >> 172.21.15.139:0/4220111106 conn(0x7f2f9806b1e0 msgr2=0x7f2f9806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:20.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 shutdown_connections 2024-09-13T17:24:20.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.380+0000 7f2f9f000700 1 -- 172.21.15.139:0/4220111106 wait complete. 2024-09-13T17:24:20.403 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 6 2024-09-13T17:24:20.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:20.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.572+0000 7fb483600700 1 Processor -- start 2024-09-13T17:24:20.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.572+0000 7fb483600700 1 -- start start 2024-09-13T17:24:20.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb483600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb47c146770 0x7fb47c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb483600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb47c0adc20 0x7fb47c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb483600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0ae570 con 0x7fb47c0ac890 2024-09-13T17:24:20.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb483600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0ad8a0 con 0x7fb47c146770 2024-09-13T17:24:20.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb483600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c146b50 con 0x7fb47c0adc20 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb473e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb47c0ac890 0x7fb47c0b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50478/0 (socket says 172.21.15.139:50478) 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb480c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb47c146770 0x7fb47c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb473e00700 1 -- 172.21.15.139:0/1793784004 learned_addr learned my addr 172.21.15.139:0/1793784004 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb481600700 1 --2- 172.21.15.139:0/1793784004 >> v2:172.21.15.176:3300/0 conn(0x7fb47c0adc20 0x7fb47c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb480c00700 1 -- 172.21.15.139:0/1793784004 >> v2:172.21.15.176:3300/0 conn(0x7fb47c0adc20 msgr2=0x7fb47c0ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb480c00700 1 --2- 172.21.15.139:0/1793784004 >> v2:172.21.15.176:3300/0 conn(0x7fb47c0adc20 0x7fb47c0ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb480c00700 1 -- 172.21.15.139:0/1793784004 >> v1:172.21.15.139:6789/0 conn(0x7fb47c0ac890 legacy=0x7fb47c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb480c00700 1 -- 172.21.15.139:0/1793784004 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c071190 con 0x7fb47c146770 2024-09-13T17:24:20.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb480c00700 1 --2- 172.21.15.139:0/1793784004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c06d9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb47c1609a0 tx=0x7fb464009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123ecad6e7f2fb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:20.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb47be00700 1 -- 172.21.15.139:0/1793784004 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464011830 con 0x7fb47c146770 2024-09-13T17:24:20.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb47be00700 1 -- 172.21.15.139:0/1793784004 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464011990 con 0x7fb47c146770 2024-09-13T17:24:20.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.576+0000 7fb47be00700 1 -- 172.21.15.139:0/1793784004 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464011d40 con 0x7fb47c146770 2024-09-13T17:24:20.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 -- 172.21.15.139:0/1793784004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 msgr2=0x7fb47c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 --2- 172.21.15.139:0/1793784004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c06d9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb47c1609a0 tx=0x7fb464009b30 comp rx=0 tx=0).stop 2024-09-13T17:24:20.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 -- 172.21.15.139:0/1793784004 shutdown_connections 2024-09-13T17:24:20.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 --2- 172.21.15.139:0/1793784004 >> v2:172.21.15.176:3300/0 conn(0x7fb47c0adc20 0x7fb47c0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 --2- 172.21.15.139:0/1793784004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c06d9e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 -- 172.21.15.139:0/1793784004 >> 172.21.15.139:0/1793784004 conn(0x7fb47c06b1e0 msgr2=0x7fb47c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:20.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 -- 172.21.15.139:0/1793784004 shutdown_connections 2024-09-13T17:24:20.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.580+0000 7fb483600700 1 -- 172.21.15.139:0/1793784004 wait complete. 2024-09-13T17:24:20.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 Processor -- start 2024-09-13T17:24:20.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 -- start start 2024-09-13T17:24:20.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb47c0ac890 0x7fb47c0ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb47c0adc20 0x7fb47c1f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0ab040 con 0x7fb47c146770 2024-09-13T17:24:20.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0ab320 con 0x7fb47c0ac890 2024-09-13T17:24:20.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb483600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0ab600 con 0x7fb47c0adc20 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb481600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb481600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c0aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46002/0 (socket says 172.21.15.139:46002) 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb481600700 1 -- 172.21.15.139:0/3177241 learned_addr learned my addr 172.21.15.139:0/3177241 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb473e00700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb47c0adc20 0x7fb47c1f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.584+0000 7fb480c00700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb47c0ac890 0x7fb47c0ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb481600700 1 -- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb47c0adc20 msgr2=0x7fb47c1f9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb481600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb47c0adc20 0x7fb47c1f9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb481600700 1 -- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb47c0ac890 msgr2=0x7fb47c0ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb481600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb47c0ac890 0x7fb47c0ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb481600700 1 -- 172.21.15.139:0/3177241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640094b0 con 0x7fb47c146770 2024-09-13T17:24:20.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb480c00700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb47c0ac890 0x7fb47c0ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:20.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb481600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c0aa470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb474007e40 tx=0x7fb47400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:20.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400ede0 con 0x7fb47c146770 2024-09-13T17:24:20.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c0ab8e0 con 0x7fb47c146770 2024-09-13T17:24:20.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb474014420 con 0x7fb47c146770 2024-09-13T17:24:20.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740147d0 con 0x7fb47c146770 2024-09-13T17:24:20.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c13ab10 con 0x7fb47c146770 2024-09-13T17:24:20.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.588+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c0acd00 con 0x7fb47c146770 2024-09-13T17:24:20.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.592+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb474014930 con 0x7fb47c146770 2024-09-13T17:24:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.592+0000 7fb479600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb458066730 0x7fb458068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.592+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb474084bf0 con 0x7fb47c146770 2024-09-13T17:24:20.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.592+0000 7fb480c00700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb458066730 0x7fb458068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:20.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.596+0000 7fb480c00700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb458066730 0x7fb458068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4640090b0 tx=0x7fb464008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:20.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.596+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb474051c60 con 0x7fb47c146770 2024-09-13T17:24:20.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.788+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb47c0afe50 con 0x7fb47c146770 2024-09-13T17:24:20.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.792+0000 7fb479600700 1 -- 172.21.15.139:0/3177241 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7fb474055280 con 0x7fb47c146770 2024-09-13T17:24:20.800 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:20.800 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:20.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb458066730 msgr2=0x7fb458068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb458066730 0x7fb458068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4640090b0 tx=0x7fb464008030 comp rx=0 tx=0).stop 2024-09-13T17:24:20.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 msgr2=0x7fb47c0aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:20.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c0aa470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb474007e40 tx=0x7fb47400e3c0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 shutdown_connections 2024-09-13T17:24:20.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb458066730 0x7fb458068bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb47c146770 0x7fb47c0aa470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb47c0adc20 0x7fb47c1f9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 --2- 172.21.15.139:0/3177241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb47c0ac890 0x7fb47c0ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 >> 172.21.15.139:0/3177241 conn(0x7fb47c06b1e0 msgr2=0x7fb47c15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 shutdown_connections 2024-09-13T17:24:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.796+0000 7fb483600700 1 -- 172.21.15.139:0/3177241 wait complete. 2024-09-13T17:24:20.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:20.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.988+0000 7f4204800700 1 Processor -- start 2024-09-13T17:24:20.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.988+0000 7f4204800700 1 -- start start 2024-09-13T17:24:20.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4204800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41fc06d9b0 0x7f41fc0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4204800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 0x7f41fc070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:20.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4204800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc0cb580 con 0x7f41fc0702c0 2024-09-13T17:24:20.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4204800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc071e30 con 0x7f41fc162550 2024-09-13T17:24:20.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4204800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc0712b0 con 0x7f41fc06d9b0 2024-09-13T17:24:20.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4202800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 0x7f41fc070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4202800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 0x7f41fc070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46012/0 (socket says 172.21.15.139:46012) 2024-09-13T17:24:21.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4202800700 1 -- 172.21.15.139:0/2406866762 learned_addr learned my addr 172.21.15.139:0/2406866762 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:21.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4201400700 1 --2- 172.21.15.139:0/2406866762 >> v2:172.21.15.176:3300/0 conn(0x7f41fc06d9b0 0x7f41fc0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4201e00700 1 --1- 172.21.15.139:0/2406866762 >> v1:172.21.15.176:6789/0 conn(0x7f41fc0702c0 0x7f41fc06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:45302/0 (socket says 172.21.15.139:45302) 2024-09-13T17:24:21.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4201400700 1 -- 172.21.15.139:0/2406866762 >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 msgr2=0x7f41fc070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:21.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4201400700 1 --2- 172.21.15.139:0/2406866762 >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 0x7f41fc070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4201400700 1 -- 172.21.15.139:0/2406866762 >> v1:172.21.15.176:6789/0 conn(0x7f41fc0702c0 legacy=0x7f41fc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4201400700 1 -- 172.21.15.139:0/2406866762 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc071590 con 0x7f41fc06d9b0 2024-09-13T17:24:21.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.992+0000 7f4202800700 1 --2- 172.21.15.139:0/2406866762 >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 0x7f41fc070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:21.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4201400700 1 --2- 172.21.15.139:0/2406866762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc0706a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0726d0 tx=0x7f41ec009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17115f668f0e414 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4200a00700 1 -- 172.21.15.139:0/2406866762 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec011830 con 0x7f41fc06d9b0 2024-09-13T17:24:21.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4200a00700 1 -- 172.21.15.139:0/2406866762 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec011990 con 0x7f41fc06d9b0 2024-09-13T17:24:21.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4200a00700 1 -- 172.21.15.139:0/2406866762 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec011d20 con 0x7f41fc06d9b0 2024-09-13T17:24:21.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 -- 172.21.15.139:0/2406866762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 msgr2=0x7f41fc0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 --2- 172.21.15.139:0/2406866762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc0706a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0726d0 tx=0x7f41ec009b30 comp rx=0 tx=0).stop 2024-09-13T17:24:21.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 -- 172.21.15.139:0/2406866762 shutdown_connections 2024-09-13T17:24:21.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 --2- 172.21.15.139:0/2406866762 >> v2:172.21.15.139:3300/0 conn(0x7f41fc162550 0x7f41fc070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 --2- 172.21.15.139:0/2406866762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc0706a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 -- 172.21.15.139:0/2406866762 >> 172.21.15.139:0/2406866762 conn(0x7f41fc06b1e0 msgr2=0x7f41fc06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:21.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 -- 172.21.15.139:0/2406866762 shutdown_connections 2024-09-13T17:24:21.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 -- 172.21.15.139:0/2406866762 wait complete. 2024-09-13T17:24:21.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:20.996+0000 7f4204800700 1 Processor -- start 2024-09-13T17:24:21.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 -- start start 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc1f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41fc0702c0 0x7f41fc0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 0x7f41fc1f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc1f7ec0 con 0x7f41fc162550 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc0b39b0 con 0x7f41fc06d9b0 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc1f7620 con 0x7f41fc0702c0 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 0x7f41fc1f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 0x7f41fc1f42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46028/0 (socket says 172.21.15.139:46028) 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 -- 172.21.15.139:0/1391342688 learned_addr learned my addr 172.21.15.139:0/1391342688 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:21.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4201e00700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc1f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4201400700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41fc0702c0 0x7f41fc0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 -- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41fc0702c0 msgr2=0x7f41fc0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41fc0702c0 0x7f41fc0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 -- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 msgr2=0x7f41fc1f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc1f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 -- 172.21.15.139:0/1391342688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009b30 con 0x7f41fc162550 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4202800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 0x7f41fc1f42b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41f800efc0 tx=0x7f41f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8018070 con 0x7f41fc162550 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800f040 con 0x7f41fc162550 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8003c60 con 0x7f41fc162550 2024-09-13T17:24:21.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.000+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec0094b0 con 0x7f41fc162550 2024-09-13T17:24:21.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.004+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc1f7be0 con 0x7f41fc162550 2024-09-13T17:24:21.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.004+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc06d2a0 con 0x7f41fc162550 2024-09-13T17:24:21.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.004+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41f800c930 con 0x7f41fc162550 2024-09-13T17:24:21.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.008+0000 7f41f6000700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f41e0066730 0x7f41e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.008+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41f80845f0 con 0x7f41fc162550 2024-09-13T17:24:21.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.008+0000 7f4201e00700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f41e0066730 0x7f41e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.008+0000 7f4201e00700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f41e0066730 0x7f41e0068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41f0000f60 tx=0x7f41f0007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.012+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41f8051660 con 0x7f41fc162550 2024-09-13T17:24:21.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.200+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41fc15f240 con 0x7f41fc162550 2024-09-13T17:24:21.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.204+0000 7f41f6000700 1 -- 172.21.15.139:0/1391342688 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f41f8009ce0 con 0x7f41fc162550 2024-09-13T17:24:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:21.212 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:21.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f41e0066730 msgr2=0x7f41e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f41e0066730 0x7f41e0068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41f0000f60 tx=0x7f41f0007ef0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 msgr2=0x7f41fc1f42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 0x7f41fc1f42b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41f800efc0 tx=0x7f41f800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 shutdown_connections 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f41e0066730 0x7f41e0068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41fc162550 0x7f41fc1f42b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41fc0702c0 0x7f41fc0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 --2- 172.21.15.139:0/1391342688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41fc06d9b0 0x7f41fc1f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 >> 172.21.15.139:0/1391342688 conn(0x7f41fc06b1e0 msgr2=0x7f41fc15f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 shutdown_connections 2024-09-13T17:24:21.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.208+0000 7f4204800700 1 -- 172.21.15.139:0/1391342688 wait complete. 2024-09-13T17:24:21.257 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.424+0000 7f7611800700 1 Processor -- start 2024-09-13T17:24:21.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.424+0000 7f7611800700 1 -- start start 2024-09-13T17:24:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f7611800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c0cf760 0x7f760c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f7611800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0b48a0 con 0x7f760c0b2e40 2024-09-13T17:24:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f7611800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c06c7e0 con 0x7f760c15dd30 2024-09-13T17:24:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f7611800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c06cac0 con 0x7f760c0cf760 2024-09-13T17:24:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760b400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f760c0b2e40 0x7f760c15d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50488/0 (socket says 172.21.15.139:50488) 2024-09-13T17:24:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760b400700 1 -- 172.21.15.139:0/2854703577 learned_addr learned my addr 172.21.15.139:0/2854703577 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:21.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760be00700 1 --2- 172.21.15.139:0/2854703577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c0cf760 0x7f760c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760aa00700 1 -- 172.21.15.139:0/2854703577 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559915930 0 0) 0x7f760c0b48a0 con 0x7f760c0b2e40 2024-09-13T17:24:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760aa00700 1 -- 172.21.15.139:0/2854703577 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f00057e0 con 0x7f760c0b2e40 2024-09-13T17:24:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760be00700 1 -- 172.21.15.139:0/2854703577 >> v1:172.21.15.176:6789/0 conn(0x7f760c15dd30 legacy=0x7f760c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760be00700 1 -- 172.21.15.139:0/2854703577 >> v1:172.21.15.139:6789/0 conn(0x7f760c0b2e40 legacy=0x7f760c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760aa00700 1 -- 172.21.15.139:0/2854703577 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485453391 0 0) 0x7f75f00057e0 con 0x7f760c0b2e40 2024-09-13T17:24:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760be00700 1 -- 172.21.15.139:0/2854703577 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c06cda0 con 0x7f760c0cf760 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760be00700 1 --2- 172.21.15.139:0/2854703577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c0cf760 0x7f760c06c200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009dc0 tx=0x7f75fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a6c4793ac05300 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.428+0000 7f760aa00700 1 -- 172.21.15.139:0/2854703577 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00e070 con 0x7f760c0cf760 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f760aa00700 1 -- 172.21.15.139:0/2854703577 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc003a40 con 0x7f760c0cf760 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f760aa00700 1 -- 172.21.15.139:0/2854703577 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8001810 con 0x7f760c0cf760 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 -- 172.21.15.139:0/2854703577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c0cf760 msgr2=0x7f760c06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 --2- 172.21.15.139:0/2854703577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c0cf760 0x7f760c06c200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009dc0 tx=0x7f75fc00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 -- 172.21.15.139:0/2854703577 shutdown_connections 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 --2- 172.21.15.139:0/2854703577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c0cf760 0x7f760c06c200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 -- 172.21.15.139:0/2854703577 >> 172.21.15.139:0/2854703577 conn(0x7f760c0cc890 msgr2=0x7f760c0ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 -- 172.21.15.139:0/2854703577 shutdown_connections 2024-09-13T17:24:21.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.432+0000 7f7611800700 1 -- 172.21.15.139:0/2854703577 wait complete. 2024-09-13T17:24:21.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 Processor -- start 2024-09-13T17:24:21.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 -- start start 2024-09-13T17:24:21.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f760c0b2e40 0x7f760c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 0x7f760c152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c15dd30 0x7f760c1ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c155c50 con 0x7f760c0cf760 2024-09-13T17:24:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c155040 con 0x7f760c0b2e40 2024-09-13T17:24:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7611800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c155320 con 0x7f760c15dd30 2024-09-13T17:24:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 0x7f760c152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 0x7f760c152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46040/0 (socket says 172.21.15.139:46040) 2024-09-13T17:24:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 -- 172.21.15.139:0/3179170231 learned_addr learned my addr 172.21.15.139:0/3179170231 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f7610e00700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c15dd30 0x7f760c1ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760be00700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f760c0b2e40 0x7f760c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 -- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c15dd30 msgr2=0x7f760c1ef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c15dd30 0x7f760c1ef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 -- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f760c0b2e40 msgr2=0x7f760c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f760c0b2e40 0x7f760c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 -- 172.21.15.139:0/3179170231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009a70 con 0x7f760c0cf760 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760be00700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f760c0b2e40 0x7f760c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.436+0000 7f760b400700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 0x7f760c152330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f75f800c750 tx=0x7f75f800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80074e0 con 0x7f760c0cf760 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8007640 con 0x7f760c0cf760 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c155600 con 0x7f760c0cf760 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8005a70 con 0x7f760c0cf760 2024-09-13T17:24:21.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c142710 con 0x7f760c0cf760 2024-09-13T17:24:21.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0677e0 con 0x7f760c0cf760 2024-09-13T17:24:21.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75f8005bd0 con 0x7f760c0cf760 2024-09-13T17:24:21.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.440+0000 7f7603e00700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75ec066730 0x7f75ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.444+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75f80838a0 con 0x7f760c0cf760 2024-09-13T17:24:21.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.444+0000 7f760be00700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75ec066730 0x7f75ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.444+0000 7f760be00700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75ec066730 0x7f75ec068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009dc0 tx=0x7f75fc011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.448+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75f8050930 con 0x7f760c0cf760 2024-09-13T17:24:21.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.684+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f760c0b3240 con 0x7f760c0cf760 2024-09-13T17:24:21.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7603e00700 1 -- 172.21.15.139:0/3179170231 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f760c0b3240 con 0x7f760c0cf760 2024-09-13T17:24:21.693 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:21.693 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:19.923907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:24:21.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75ec066730 msgr2=0x7f75ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75ec066730 0x7f75ec068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009dc0 tx=0x7f75fc011000 comp rx=0 tx=0).stop 2024-09-13T17:24:21.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 msgr2=0x7f760c152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 0x7f760c152330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f75f800c750 tx=0x7f75f800ca60 comp rx=0 tx=0).stop 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 shutdown_connections 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75ec066730 0x7f75ec068bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f760c15dd30 0x7f760c1ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f760c0cf760 0x7f760c152330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 --2- 172.21.15.139:0/3179170231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f760c0b2e40 0x7f760c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 >> 172.21.15.139:0/3179170231 conn(0x7f760c0cc890 msgr2=0x7f760c0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 shutdown_connections 2024-09-13T17:24:21.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.688+0000 7f7611800700 1 -- 172.21.15.139:0/3179170231 wait complete. 2024-09-13T17:24:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 6 2024-09-13T17:24:21.722 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:21.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.880+0000 7f56dda00700 1 Processor -- start 2024-09-13T17:24:21.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.880+0000 7f56dda00700 1 -- start start 2024-09-13T17:24:21.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dda00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d80b5690 0x7f56d806be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dda00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80cec10 con 0x7f56d80b3e20 2024-09-13T17:24:21.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dda00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80b5de0 con 0x7f56d8161330 2024-09-13T17:24:21.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dda00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80cf7b0 con 0x7f56d80b5690 2024-09-13T17:24:21.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56d7400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f56d80b3e20 0x7f56d80b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50498/0 (socket says 172.21.15.139:50498) 2024-09-13T17:24:21.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56d7400700 1 -- 172.21.15.139:0/392485982 learned_addr learned my addr 172.21.15.139:0/392485982 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:21.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dd000700 1 --2- 172.21.15.139:0/392485982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d80b5690 0x7f56d806be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56d6a00700 1 -- 172.21.15.139:0/392485982 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138027585 0 0) 0x7f56d80cec10 con 0x7f56d80b3e20 2024-09-13T17:24:21.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56d6a00700 1 -- 172.21.15.139:0/392485982 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56bc0035d0 con 0x7f56d80b3e20 2024-09-13T17:24:21.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dd000700 1 -- 172.21.15.139:0/392485982 >> v1:172.21.15.176:6789/0 conn(0x7f56d8161330 legacy=0x7f56d80cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dd000700 1 -- 172.21.15.139:0/392485982 >> v1:172.21.15.139:6789/0 conn(0x7f56d80b3e20 legacy=0x7f56d80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dd000700 1 -- 172.21.15.139:0/392485982 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8161710 con 0x7f56d80b5690 2024-09-13T17:24:21.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.884+0000 7f56dd000700 1 --2- 172.21.15.139:0/392485982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d80b5690 0x7f56d806be80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009dc0 tx=0x7f56d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08d033f516f8335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56d6a00700 1 -- 172.21.15.139:0/392485982 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000e070 con 0x7f56d80b5690 2024-09-13T17:24:21.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56d6a00700 1 -- 172.21.15.139:0/392485982 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000bb20 con 0x7f56d80b5690 2024-09-13T17:24:21.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56d6a00700 1 -- 172.21.15.139:0/392485982 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0012430 con 0x7f56d80b5690 2024-09-13T17:24:21.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 -- 172.21.15.139:0/392485982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d80b5690 msgr2=0x7f56d806be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 --2- 172.21.15.139:0/392485982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d80b5690 0x7f56d806be80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009dc0 tx=0x7f56d000b330 comp rx=0 tx=0).stop 2024-09-13T17:24:21.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 -- 172.21.15.139:0/392485982 shutdown_connections 2024-09-13T17:24:21.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 --2- 172.21.15.139:0/392485982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d80b5690 0x7f56d806be80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 -- 172.21.15.139:0/392485982 >> 172.21.15.139:0/392485982 conn(0x7f56d80cc890 msgr2=0x7f56d80ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:21.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 -- 172.21.15.139:0/392485982 shutdown_connections 2024-09-13T17:24:21.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.888+0000 7f56dda00700 1 -- 172.21.15.139:0/392485982 wait complete. 2024-09-13T17:24:21.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 Processor -- start 2024-09-13T17:24:21.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 -- start start 2024-09-13T17:24:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 0x7f56d81f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d80b5690 0x7f56d815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d8161330 0x7f56d815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d81573f0 con 0x7f56d80b3e20 2024-09-13T17:24:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8160760 con 0x7f56d80b5690 2024-09-13T17:24:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dda00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8160a40 con 0x7f56d8161330 2024-09-13T17:24:21.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56d7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 0x7f56d81f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56d7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 0x7f56d81f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46054/0 (socket says 172.21.15.139:46054) 2024-09-13T17:24:21.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56d7e00700 1 -- 172.21.15.139:0/805163281 learned_addr learned my addr 172.21.15.139:0/805163281 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:21.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56d7400700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d80b5690 0x7f56d815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.892+0000 7f56dd000700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d8161330 0x7f56d815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56d7e00700 1 -- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d8161330 msgr2=0x7f56d815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56d7e00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d8161330 0x7f56d815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56d7e00700 1 -- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d80b5690 msgr2=0x7f56d815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56d7e00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d80b5690 0x7f56d815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56d7e00700 1 -- 172.21.15.139:0/805163281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009a70 con 0x7f56d80b3e20 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56dd000700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d8161330 0x7f56d815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56d7e00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 0x7f56d81f6320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c500 tx=0x7f56c800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80052d0 con 0x7f56d80b3e20 2024-09-13T17:24:21.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8005430 con 0x7f56d80b3e20 2024-09-13T17:24:21.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d8156da0 con 0x7f56d80b3e20 2024-09-13T17:24:21.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80055a0 con 0x7f56d80b3e20 2024-09-13T17:24:21.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d81f6860 con 0x7f56d80b3e20 2024-09-13T17:24:21.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.896+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d80677e0 con 0x7f56d80b3e20 2024-09-13T17:24:21.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.900+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56c80038e0 con 0x7f56d80b3e20 2024-09-13T17:24:21.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.904+0000 7f56cfe00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f56b8066730 0x7f56b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:21.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.904+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56c80838a0 con 0x7f56d80b3e20 2024-09-13T17:24:21.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.904+0000 7f56d7400700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f56b8066730 0x7f56b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:21.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.904+0000 7f56d7400700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f56b8066730 0x7f56b8068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f56c4007b10 tx=0x7f56c4007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:21.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:21.908+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56c8050880 con 0x7f56d80b3e20 2024-09-13T17:24:22.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.100+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56d80cdc90 con 0x7f56d80b3e20 2024-09-13T17:24:22.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.100+0000 7f56cfe00700 1 -- 172.21.15.139:0/805163281 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f56c8081e60 con 0x7f56d80b3e20 2024-09-13T17:24:22.109 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:22.109 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f56b8066730 msgr2=0x7f56b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f56b8066730 0x7f56b8068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f56c4007b10 tx=0x7f56c4007a60 comp rx=0 tx=0).stop 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 msgr2=0x7f56d81f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 0x7f56d81f6320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c500 tx=0x7f56c800c810 comp rx=0 tx=0).stop 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 shutdown_connections 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f56b8066730 0x7f56b8068bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d8161330 0x7f56d815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d80b5690 0x7f56d815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 --2- 172.21.15.139:0/805163281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56d80b3e20 0x7f56d81f6320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 >> 172.21.15.139:0/805163281 conn(0x7f56d80cc890 msgr2=0x7f56d806bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 shutdown_connections 2024-09-13T17:24:22.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.104+0000 7f56dda00700 1 -- 172.21.15.139:0/805163281 wait complete. 2024-09-13T17:24:22.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:24:15.421146+0000', 'modified': '2024-09-13T17:24:19.923907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6834/4065509262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 4065509262}, {'type': 'v1', 'addr': '172.21.15.176:6834', 'nonce': 4065509262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T17:24:22.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:24:22.539 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:24:22.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.712+0000 7fa3b2600700 1 Processor -- start 2024-09-13T17:24:22.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.712+0000 7fa3b2600700 1 -- start start 2024-09-13T17:24:22.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3b2600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3ac145d40 0x7fa3ac06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3b2600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06d7e0 0x7fa3ac0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3b2600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3ac0b3a30 0x7fa3ac160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3b2600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac06dc20 con 0x7fa3ac0b3a30 2024-09-13T17:24:22.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3b2600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac0b3ec0 con 0x7fa3ac145d40 2024-09-13T17:24:22.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3b2600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0b4170 con 0x7fa3ac06d7e0 2024-09-13T17:24:22.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3ac0b3a30 0x7fa3ac160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3ac0b3a30 0x7fa3ac160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46064/0 (socket says 172.21.15.139:46064) 2024-09-13T17:24:22.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 -- 172.21.15.139:0/1888589842 learned_addr learned my addr 172.21.15.139:0/1888589842 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3ab400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3ac145d40 0x7fa3ac06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/1888589842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06d7e0 0x7fa3ac0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 -- 172.21.15.139:0/1888589842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06d7e0 msgr2=0x7fa3ac0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1888589842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06d7e0 0x7fa3ac0b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 -- 172.21.15.139:0/1888589842 >> v2:172.21.15.176:3300/0 conn(0x7fa3ac145d40 msgr2=0x7fa3ac06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1888589842 >> v2:172.21.15.176:3300/0 conn(0x7fa3ac145d40 0x7fa3ac06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 -- 172.21.15.139:0/1888589842 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0aca30 con 0x7fa3ac0b3a30 2024-09-13T17:24:22.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1888589842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0b3a30 0x7fa3ac160ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0748f0 tx=0x7fa3a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343852c7eaa4fead server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3aa000700 1 -- 172.21.15.139:0/1888589842 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400e070 con 0x7fa3ac0b3a30 2024-09-13T17:24:22.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3aa000700 1 -- 172.21.15.139:0/1888589842 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400b910 con 0x7fa3ac0b3a30 2024-09-13T17:24:22.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.716+0000 7fa3aa000700 1 -- 172.21.15.139:0/1888589842 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400bcc0 con 0x7fa3ac0b3a30 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 -- 172.21.15.139:0/1888589842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0b3a30 msgr2=0x7fa3ac160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1888589842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0b3a30 0x7fa3ac160ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0748f0 tx=0x7fa3a400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 -- 172.21.15.139:0/1888589842 shutdown_connections 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1888589842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0b3a30 0x7fa3ac160ae0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1888589842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06d7e0 0x7fa3ac0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1888589842 >> v2:172.21.15.176:3300/0 conn(0x7fa3ac145d40 0x7fa3ac06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 -- 172.21.15.139:0/1888589842 >> 172.21.15.139:0/1888589842 conn(0x7fa3ac06b1e0 msgr2=0x7fa3ac06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 -- 172.21.15.139:0/1888589842 shutdown_connections 2024-09-13T17:24:22.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 -- 172.21.15.139:0/1888589842 wait complete. 2024-09-13T17:24:22.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 Processor -- start 2024-09-13T17:24:22.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.720+0000 7fa3b2600700 1 -- start start 2024-09-13T17:24:22.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac06d7e0 0x7fa3ac15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac0b3a30 0x7fa3ac15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 0x7fa3ac13f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac15dca0 con 0x7fa3ac145d40 2024-09-13T17:24:22.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac15df80 con 0x7fa3ac06d7e0 2024-09-13T17:24:22.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac15e260 con 0x7fa3ac0b3a30 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 0x7fa3ac13f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 0x7fa3ac13f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46080/0 (socket says 172.21.15.139:46080) 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 -- 172.21.15.139:0/1079376134 learned_addr learned my addr 172.21.15.139:0/1079376134 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac0b3a30 0x7fa3ac15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3ab400700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac06d7e0 0x7fa3ac15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 -- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac0b3a30 msgr2=0x7fa3ac15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac0b3a30 0x7fa3ac15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 -- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac06d7e0 msgr2=0x7fa3ac15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac06d7e0 0x7fa3ac15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 -- 172.21.15.139:0/1079376134 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009b30 con 0x7fa3ac145d40 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac0b3a30 0x7fa3ac15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 0x7fa3ac13f220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0726d0 tx=0x7fa3a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3a3400700 1 -- 172.21.15.139:0/1079376134 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40099b0 con 0x7fa3ac145d40 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac15e540 con 0x7fa3ac145d40 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3a3400700 1 -- 172.21.15.139:0/1079376134 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400ce80 con 0x7fa3ac145d40 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3a3400700 1 -- 172.21.15.139:0/1079376134 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4004470 con 0x7fa3ac145d40 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.724+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac13f760 con 0x7fa3ac145d40 2024-09-13T17:24:22.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.728+0000 7fa3a3400700 1 -- 172.21.15.139:0/1079376134 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3a40045d0 con 0x7fa3ac145d40 2024-09-13T17:24:22.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3a3400700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3a3400700 1 -- 172.21.15.139:0/1079376134 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3a4085950 con 0x7fa3ac145d40 2024-09-13T17:24:22.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3ab400700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 Processor -- start 2024-09-13T17:24:22.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 -- start start 2024-09-13T17:24:22.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3ab400700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009b50 tx=0x7fa39c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29054da0 0x29055180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 0x2901d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x290556c0 0x2901ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f7cd80 con 0x29033d00 2024-09-13T17:24:22.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f7a510 con 0x29054da0 2024-09-13T17:24:22.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x28f75e00 con 0x290556c0 2024-09-13T17:24:22.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3aaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 0x2901d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3aaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 0x2901d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46092/0 (socket says 172.21.15.139:46092) 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3aaa00700 1 -- 172.21.15.139:0/3323085665 learned_addr learned my addr 172.21.15.139:0/3323085665 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3ab400700 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29054da0 0x29055180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.732+0000 7fa3abe00700 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x290556c0 0x2901ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3aaa00700 1 -- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x290556c0 msgr2=0x2901ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x290556c0 0x2901ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3aaa00700 1 -- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29054da0 msgr2=0x29055180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29054da0 0x29055180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3aaa00700 1 -- 172.21.15.139:0/3323085665 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28de8960 con 0x29033d00 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 0x2901d890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa398009c50 tx=0x7fa398009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dcd0e77abf7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa397e00700 1 -- 172.21.15.139:0/3323085665 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011a60 con 0x29033d00 2024-09-13T17:24:22.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa397e00700 1 -- 172.21.15.139:0/3323085665 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398011bc0 con 0x29033d00 2024-09-13T17:24:22.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa397e00700 1 -- 172.21.15.139:0/3323085665 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398015460 con 0x29033d00 2024-09-13T17:24:22.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 -- 172.21.15.139:0/3323085665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 msgr2=0x2901d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 0x2901d890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa398009c50 tx=0x7fa398009240 comp rx=0 tx=0).stop 2024-09-13T17:24:22.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 -- 172.21.15.139:0/3323085665 shutdown_connections 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x290556c0 0x2901ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x29033d00 0x2901d890 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 --2- 172.21.15.139:0/3323085665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29054da0 0x29055180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 -- 172.21.15.139:0/3323085665 >> 172.21.15.139:0/3323085665 conn(0x28d9d4d0 msgr2=0x29036c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 -- 172.21.15.139:0/3323085665 shutdown_connections 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 -- 172.21.15.139:0/3323085665 wait complete. 2024-09-13T17:24:22.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.736+0000 7fa3b591e740 1 -- start start 2024-09-13T17:24:22.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 Processor -- start 2024-09-13T17:24:22.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2900b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29009700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29009c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f33730 con 0x290556c0 2024-09-13T17:24:22.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f395b0 con 0x29033d00 2024-09-13T17:24:22.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x28e21aa0 con 0x29054da0 2024-09-13T17:24:22.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 10 client.0 _ll_register_callbacks cb 0x28f6f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:22.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29009c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29009c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46096/0 (socket says 172.21.15.139:46096) 2024-09-13T17:24:22.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 -- 172.21.15.139:0/633426692 learned_addr learned my addr 172.21.15.139:0/633426692 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29009700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3ab400700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2900b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 -- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 msgr2=0x29009700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29009700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 -- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 msgr2=0x2900b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2900b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 -- 172.21.15.139:0/633426692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa398009880 con 0x290556c0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3abe00700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29009c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4056300 tx=0x7fa3a40566b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0904f4422654ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa394c00700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa394c00700 1 -- 172.21.15.139:0/633426692 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a405a0d0 con 0x290556c0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28daa1e0 con 0x290556c0 2024-09-13T17:24:22.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa394c00700 1 -- 172.21.15.139:0/633426692 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3a4013d90 con 0x290556c0 2024-09-13T17:24:22.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa394c00700 1 -- 172.21.15.139:0/633426692 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3a405a230 con 0x290556c0 2024-09-13T17:24:22.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 10 client.4416 fetch_fsmap learned FSMap version 6 2024-09-13T17:24:22.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.740+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x28f3c220 con 0x290556c0 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa394c00700 1 -- 172.21.15.139:0/633426692 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4081020 con 0x290556c0 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa394c00700 1 -- 172.21.15.139:0/633426692 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa3a4056860 con 0x290556c0 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3b591e740 10 client.4416 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3b591e740 10 client.4416 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3b591e740 20 client.4416 populate_metadata read hostname 'smithi139' 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3b591e740 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x29030400 0x2905ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3b591e740 4 client.4416 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 --> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28df4460 con 0x29030400 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3ab400700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x29030400 0x2905ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa394c00700 10 client.4416 ms_handle_connect on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:22.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.744+0000 7fa3ab400700 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x29030400 0x2905ed10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259bda691fd1873a server_cookie=8801f843529e636b in_seq=0 out_seq=0 2024-09-13T17:24:22.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa394c00700 1 -- 172.21.15.139:0/633426692 <== mds.0 v2:172.21.15.176:6832/4065509262 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x28df4460 con 0x29030400 2024-09-13T17:24:22.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa394c00700 10 client.4416 handle_command_reply: tid=0 2024-09-13T17:24:22.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 client.4416 shutdown 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 msgr2=0x29009c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29009c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4056300 tx=0x7fa3a40566b0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 shutdown_connections 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x29030400 0x2905ed10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29009c40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa394c00700 0 client.4416 ms_handle_reset on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29009700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 --2- 172.21.15.139:0/633426692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2900b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 >> 172.21.15.139:0/633426692 conn(0x28d9d4d0 msgr2=0x290308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 shutdown_connections 2024-09-13T17:24:22.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 1 -- 172.21.15.139:0/633426692 wait complete. 2024-09-13T17:24:22.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.748+0000 7fa3b591e740 20 client.4416 trim_cache size 0 max 16384 2024-09-13T17:24:22.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.768+0000 7fa3b591e740 1 Processor -- start 2024-09-13T17:24:22.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.768+0000 7fa3b591e740 1 -- start start 2024-09-13T17:24:22.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x290682d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3b591e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x28fa4ec0 con 0x290556c0 2024-09-13T17:24:22.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2902f5a0 con 0x29033d00 2024-09-13T17:24:22.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x28f33730 con 0x29054da0 2024-09-13T17:24:22.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46098/0 (socket says 172.21.15.139:46098) 2024-09-13T17:24:22.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3abe00700 1 -- 172.21.15.139:0/824495289 learned_addr learned my addr 172.21.15.139:0/824495289 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x290682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 -- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 msgr2=0x29068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 -- 172.21.15.139:0/824495289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 msgr2=0x29068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 -- 172.21.15.139:0/824495289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28f22450 con 0x29033d00 2024-09-13T17:24:22.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3abe00700 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:22.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3ab400700 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x290682d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x2900a340 tx=0x7fa39c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1879022cff1802c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3a0c00700 1 -- 172.21.15.139:0/824495289 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c01c040 con 0x29033d00 2024-09-13T17:24:22.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3a0c00700 1 -- 172.21.15.139:0/824495289 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c011bf0 con 0x29033d00 2024-09-13T17:24:22.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.772+0000 7fa3a0c00700 1 -- 172.21.15.139:0/824495289 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c02ab00 con 0x29033d00 2024-09-13T17:24:22.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 msgr2=0x290682d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x290682d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x2900a340 tx=0x7fa39c018000 comp rx=0 tx=0).stop 2024-09-13T17:24:22.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- 172.21.15.139:0/824495289 shutdown_connections 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x29068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x29068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- 172.21.15.139:0/824495289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x290682d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- 172.21.15.139:0/824495289 >> 172.21.15.139:0/824495289 conn(0x28d9d4d0 msgr2=0x29033100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- 172.21.15.139:0/824495289 shutdown_connections 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- 172.21.15.139:0/824495289 wait complete. 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- start start 2024-09-13T17:24:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 Processor -- start 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2906dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x290b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x290b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x290548a0 con 0x290556c0 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x29073930 con 0x29033d00 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x29054ad0 con 0x29054da0 2024-09-13T17:24:22.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3b591e740 10 client.0 _ll_register_callbacks cb 0x28fcc710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:22.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x290b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x290b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46108/0 (socket says 172.21.15.139:46108) 2024-09-13T17:24:22.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.776+0000 7fa3abe00700 1 -- 172.21.15.139:0/1439378516 learned_addr learned my addr 172.21.15.139:0/1439378516 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3aaa00700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x290b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3ab400700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2906dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3abe00700 1 -- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 msgr2=0x290b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x290b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3abe00700 1 -- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 msgr2=0x2906dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2906dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3abe00700 1 -- 172.21.15.139:0/1439378516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x28f3c220 con 0x290556c0 2024-09-13T17:24:22.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3abe00700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x290b6720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40097e0 tx=0x7fa3a4083a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6aa4240cd20e04a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa394c00700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T17:24:22.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa394c00700 1 -- 172.21.15.139:0/1439378516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a405a430 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa394c00700 1 -- 172.21.15.139:0/1439378516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3a4082080 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa398011bc0 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa394c00700 1 -- 172.21.15.139:0/1439378516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3a4056d00 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 10 client.4422 fetch_fsmap learned FSMap version 6 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x7fa39c004400 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa394c00700 1 -- 172.21.15.139:0/1439378516 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398011bc0 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa394c00700 1 -- 172.21.15.139:0/1439378516 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa3a4055af0 con 0x290556c0 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 10 client.4422 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 10 client.4422 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 20 client.4422 populate_metadata read hostname 'smithi139' 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x2906b860 0x2906bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 4 client.4422 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:24:22.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 --> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] -- command(tid 0: {"prefix": "status"}) v1 -- 0x28e191e0 con 0x2906b860 2024-09-13T17:24:22.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.780+0000 7fa3ab400700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x2906b860 0x2906bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3ab400700 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x2906b860 0x2906bc40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95745a7dbdf30745 server_cookie=2da4f6711bcbc1c8 in_seq=0 out_seq=0 2024-09-13T17:24:22.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa394c00700 10 client.4422 ms_handle_connect on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:22.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa394c00700 1 -- 172.21.15.139:0/1439378516 <== mds.0 v2:172.21.15.176:6832/4065509262 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x28e191e0 con 0x2906b860 2024-09-13T17:24:22.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa394c00700 10 client.4422 handle_command_reply: tid=0 2024-09-13T17:24:22.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 client.4422 shutdown 2024-09-13T17:24:22.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 msgr2=0x290b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x290b6720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40097e0 tx=0x7fa3a4083a50 comp rx=0 tx=0).stop 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 shutdown_connections 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x2906b860 0x2906bc40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x290556c0 0x290b6720 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29054da0 0x290b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa394c00700 0 client.4422 ms_handle_reset on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 --2- 172.21.15.139:0/1439378516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29033d00 0x2906dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 >> 172.21.15.139:0/1439378516 conn(0x28d9d4d0 msgr2=0x290328e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 shutdown_connections 2024-09-13T17:24:22.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 1 -- 172.21.15.139:0/1439378516 wait complete. 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b591e740 20 client.4422 trim_cache size 0 max 16384 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "a6cff629-1d3c-470e-abc7-14e2fbc4e0ad", 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4294, 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2024-09-13T17:24:22.792 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 7.3609266050000004, 2024-09-13T17:24:22.793 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 6, 2024-09-13T17:24:22.793 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 25, 2024-09-13T17:24:22.793 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T17:24:22.793 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 11.859972197999999 2024-09-13T17:24:22.793 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 msgr2=0x7fa38c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009b50 tx=0x7fa39c009240 comp rx=0 tx=0).stop 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 msgr2=0x7fa3ac13f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 0x7fa3ac13f220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0726d0 tx=0x7fa3a4004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 shutdown_connections 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac145d40 0x7fa3ac13f220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac0b3a30 0x7fa3ac15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 --2- 172.21.15.139:0/1079376134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac06d7e0 0x7fa3ac15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 >> 172.21.15.139:0/1079376134 conn(0x7fa3ac06b1e0 msgr2=0x7fa3ac0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 shutdown_connections 2024-09-13T17:24:22.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.784+0000 7fa3b2600700 1 -- 172.21.15.139:0/1079376134 wait complete. 2024-09-13T17:24:22.815 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:24:22.815 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:22.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:24:22.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.984+0000 7f1e10000700 1 Processor -- start 2024-09-13T17:24:22.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.984+0000 7f1e10000700 1 -- start start 2024-09-13T17:24:22.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e10000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1e08142fc0 0x7f1e0806f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e10000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e0806f570 0x7f1e0815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:22.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e10000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08161940 con 0x7f1e080cc630 2024-09-13T17:24:22.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e10000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0806fa20 con 0x7f1e08142fc0 2024-09-13T17:24:22.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e10000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081402a0 con 0x7f1e0806f570 2024-09-13T17:24:22.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1e08142fc0 0x7f1e0806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1e08142fc0 0x7f1e0806f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46124/0 (socket says 172.21.15.139:46124) 2024-09-13T17:24:22.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 -- 172.21.15.139:0/3084732881 learned_addr learned my addr 172.21.15.139:0/3084732881 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:22.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0d600700 1 --1- 172.21.15.139:0/3084732881 >> v1:172.21.15.176:6789/0 conn(0x7f1e080cc630 0x7f1e08140520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:45332/0 (socket says 172.21.15.139:45332) 2024-09-13T17:24:22.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0e000700 1 --2- 172.21.15.139:0/3084732881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e0806f570 0x7f1e0815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:22.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 -- 172.21.15.139:0/3084732881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e0806f570 msgr2=0x7f1e0815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:22.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 --2- 172.21.15.139:0/3084732881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e0806f570 0x7f1e0815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 -- 172.21.15.139:0/3084732881 >> v1:172.21.15.176:6789/0 conn(0x7f1e080cc630 legacy=0x7f1e08140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.988+0000 7f1e0cc00700 1 -- 172.21.15.139:0/3084732881 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080cca10 con 0x7f1e08142fc0 2024-09-13T17:24:22.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e0cc00700 1 --2- 172.21.15.139:0/3084732881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e08142fc0 0x7f1e0806f030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009940 tx=0x7f1df4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff2aad109900e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:22.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e07e00700 1 -- 172.21.15.139:0/3084732881 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400ba20 con 0x7f1e08142fc0 2024-09-13T17:24:22.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e07e00700 1 -- 172.21.15.139:0/3084732881 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4009e90 con 0x7f1e08142fc0 2024-09-13T17:24:22.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e07e00700 1 -- 172.21.15.139:0/3084732881 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400bda0 con 0x7f1e08142fc0 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 -- 172.21.15.139:0/3084732881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e08142fc0 msgr2=0x7f1e0806f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 --2- 172.21.15.139:0/3084732881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e08142fc0 0x7f1e0806f030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009940 tx=0x7f1df4009c50 comp rx=0 tx=0).stop 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 -- 172.21.15.139:0/3084732881 shutdown_connections 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 --2- 172.21.15.139:0/3084732881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e0806f570 0x7f1e0815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 --2- 172.21.15.139:0/3084732881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e08142fc0 0x7f1e0806f030 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009940 tx=0x7f1df4009c50 comp rx=0 tx=0).stop 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 -- 172.21.15.139:0/3084732881 >> 172.21.15.139:0/3084732881 conn(0x7f1e08071170 msgr2=0x7f1e08071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 -- 172.21.15.139:0/3084732881 shutdown_connections 2024-09-13T17:24:22.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.992+0000 7f1e10000700 1 -- 172.21.15.139:0/3084732881 wait complete. 2024-09-13T17:24:23.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 Processor -- start 2024-09-13T17:24:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 -- start start 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 0x7f1e0813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e080cc630 0x7f1e080ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e081f2a70 0x7f1e0815fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081f3b10 con 0x7f1e0806f570 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080abdc0 con 0x7f1e080cc630 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e10000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0813f460 con 0x7f1e081f2a70 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 0x7f1e0813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 0x7f1e0813ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46138/0 (socket says 172.21.15.139:46138) 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 -- 172.21.15.139:0/213756787 learned_addr learned my addr 172.21.15.139:0/213756787 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:23.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0e000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e081f2a70 0x7f1e0815fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:23.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0cc00700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e080cc630 0x7f1e080ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 -- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e081f2a70 msgr2=0x7f1e0815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e081f2a70 0x7f1e0815fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 -- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e080cc630 msgr2=0x7f1e080ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e080cc630 0x7f1e080ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:22.996+0000 7f1e0d600700 1 -- 172.21.15.139:0/213756787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4009570 con 0x7f1e0806f570 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e0d600700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 0x7f1e0813ef20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c4d0 tx=0x7f1dfc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00cea0 con 0x7f1e0806f570 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc005cd0 con 0x7f1e0806f570 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0072d0 con 0x7f1e0806f570 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e080ae820 con 0x7f1e0806f570 2024-09-13T17:24:23.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e080aede0 con 0x7f1e0806f570 2024-09-13T17:24:23.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e080a8a10 con 0x7f1e0806f570 2024-09-13T17:24:23.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.000+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dfc007430 con 0x7f1e0806f570 2024-09-13T17:24:23.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.004+0000 7f1e05600700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1de8066730 0x7f1de8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:23.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.004+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dfc083640 con 0x7f1e0806f570 2024-09-13T17:24:23.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.004+0000 7f1e0cc00700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1de8066730 0x7f1de8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:23.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.004+0000 7f1e0cc00700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1de8066730 0x7f1de8068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e081433a0 tx=0x7f1df4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:23.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.008+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1dfc050760 con 0x7f1e0806f570 2024-09-13T17:24:23.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.328+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e08143450 con 0x7f1e0806f570 2024-09-13T17:24:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e05600700 1 -- 172.21.15.139:0/213756787 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1dfc017070 con 0x7f1e0806f570 2024-09-13T17:24:23.337 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:24:23.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1de8066730 msgr2=0x7f1de8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:23.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1de8066730 0x7f1de8068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e081433a0 tx=0x7f1df4008030 comp rx=0 tx=0).stop 2024-09-13T17:24:23.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 msgr2=0x7f1e0813ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:23.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 0x7f1e0813ef20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c4d0 tx=0x7f1dfc00c7e0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 shutdown_connections 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1de8066730 0x7f1de8068bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e081f2a70 0x7f1e0815fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e080cc630 0x7f1e080ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 --2- 172.21.15.139:0/213756787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0806f570 0x7f1e0813ef20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 >> 172.21.15.139:0/213756787 conn(0x7f1e08071170 msgr2=0x7f1e080b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 shutdown_connections 2024-09-13T17:24:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:23.332+0000 7f1e10000700 1 -- 172.21.15.139:0/213756787 wait complete. 2024-09-13T17:24:23.363 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:24:23.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:24:23.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-13T17:24:23.364 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T17:24:23.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:23.364 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:24:23.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:24:23.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:24:23.364 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:24:23.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.364 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42456sec preferred_lft 42456sec 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:42:b9:61:11:da brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:24:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:23.385 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:24:23.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:24:23.385 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:23.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.536 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:24:23.564 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-13T17:24:23.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.567 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-13T17:24:23.642 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:24:23.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.644 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:23.644 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:23.644 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:24:23.644 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:24:23.644 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:24:23.644 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:23.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.773 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:24:23.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.790 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-09-13T17:24:23.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.850 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:23.850 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:23.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:24:23.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T17:24:23.850 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:23.963 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T17:24:23.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T17:24:23.964 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:24.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:24.148 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:24.148 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:24.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-09-13T17:24:24.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:24:24.148 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:24.215 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T17:24:24.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:24.215 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:24.231 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:24:24.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:24.231 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:24.287 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-09-13T17:24:24.369 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:24:24.369 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:24:24.452 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:24:24.454 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:24:24.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:24.455 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-09-13T17:24:24.516 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:24:24.516 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T17:24:24.566 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-09-13T17:24:24.598 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:24:24.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:24:24.671 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:24:24.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:24:24.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:24.674 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-09-13T17:24:24.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:2024-09-13T17:24:24.704+0000 7f0fbad8c640 -1 init, newargv = 0x5607e07cd6a0 newargc=15 2024-09-13T17:24:24.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[32465]: starting ceph client 2024-09-13T17:24:24.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[32465]: starting fuse 2024-09-13T17:24:25.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-09-13T17:24:25.858 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:24:25.858 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:24:25.941 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:24:25.943 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:24:25.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:25.944 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-09-13T17:24:26.000 INFO:teuthology.orchestra.run.smithi139.stdout:50 2024-09-13T17:24:26.000 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> import re 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> import os 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> def _find_admin_socket(client_name): 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-13T17:24:26.001 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> contents = proc_f.read() 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> if mountpoint in contents: 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> return f 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-13T17:24:26.002 DEBUG:teuthology.orchestra.run.smithi139:> print(_find_admin_socket("client.admin")) 2024-09-13T17:24:26.003 DEBUG:teuthology.orchestra.run.smithi139:> ' 2024-09-13T17:24:26.159 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.admin.32465.asok 2024-09-13T17:24:26.341 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32465.asok 2024-09-13T17:24:26.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:26.342 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32465.asok status 2024-09-13T17:24:26.542 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:24:26.542 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2024-09-13T17:24:26.542 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:24:26.542 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "admin", 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "32465", 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4437, 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2024-09-13T17:24:26.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 4437 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2832706147 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2832706147 2024-09-13T17:24:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.4437 192.168.0.1:0/2832706147", 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "192.168.0.1:0/2832706147", 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 6, 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 25, 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "blocklisted": false, 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2024-09-13T17:24:26.545 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:24:26.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:26.560 DEBUG:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2024-09-13T17:24:26.560 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:26.578 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2024-09-13T17:24:26.578 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:26.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:26.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:26.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:26.653 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T17:24:26.773 INFO:teuthology.orchestra.run.smithi139.stdout:# file: . 2024-09-13T17:24:26.773 INFO:teuthology.orchestra.run.smithi139.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T17:24:26.773 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:26.774 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:24:26.774 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:26.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:27.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 Processor -- start 2024-09-13T17:24:27.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 -- start start 2024-09-13T17:24:27.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f096c15ebb0 0x7f096c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15ef90 0x7f096c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096c0b41a0 con 0x7f096c15f5c0 2024-09-13T17:24:27.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096c0b6370 con 0x7f096c15ebb0 2024-09-13T17:24:27.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.004+0000 7f0973200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096c0b6650 con 0x7f096c15ef90 2024-09-13T17:24:27.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f096c15ebb0 0x7f096c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f096c15f5c0 0x7f096c1434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51316/0 (socket says 172.21.15.139:51316) 2024-09-13T17:24:27.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971400700 1 -- 172.21.15.139:0/917273539 learned_addr learned my addr 172.21.15.139:0/917273539 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:27.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0972800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15ef90 0x7f096c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971e00700 1 -- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15ef90 msgr2=0x7f096c143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:27.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971e00700 1 --2- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15ef90 0x7f096c143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0970a00700 1 -- 172.21.15.139:0/917273539 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241199217 0 0) 0x7f095c001110 con 0x7f096c15f5c0 2024-09-13T17:24:27.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971e00700 1 -- 172.21.15.139:0/917273539 >> v1:172.21.15.176:6789/0 conn(0x7f096c15f5c0 legacy=0x7f096c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971e00700 1 -- 172.21.15.139:0/917273539 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c0b6930 con 0x7f096c15ebb0 2024-09-13T17:24:27.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0971e00700 1 --2- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c0b3c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0960009850 tx=0x7f0960009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=263899af0301a417 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0970a00700 1 -- 172.21.15.139:0/917273539 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011830 con 0x7f096c15ebb0 2024-09-13T17:24:27.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0970a00700 1 -- 172.21.15.139:0/917273539 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960011990 con 0x7f096c15ebb0 2024-09-13T17:24:27.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0970a00700 1 -- 172.21.15.139:0/917273539 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011d40 con 0x7f096c15ebb0 2024-09-13T17:24:27.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0973200700 1 -- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 msgr2=0x7f096c0b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.008+0000 7f0973200700 1 --2- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c0b3c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0960009850 tx=0x7f0960009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:27.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 -- 172.21.15.139:0/917273539 shutdown_connections 2024-09-13T17:24:27.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 --2- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15ef90 0x7f096c143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 --2- 172.21.15.139:0/917273539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c0b3c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 -- 172.21.15.139:0/917273539 >> 172.21.15.139:0/917273539 conn(0x7f096c071fa0 msgr2=0x7f096c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:27.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 -- 172.21.15.139:0/917273539 shutdown_connections 2024-09-13T17:24:27.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 -- 172.21.15.139:0/917273539 wait complete. 2024-09-13T17:24:27.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 Processor -- start 2024-09-13T17:24:27.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.012+0000 7f0973200700 1 -- start start 2024-09-13T17:24:27.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 0x7f096c1f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15f5c0 0x7f096c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c15bdf0 con 0x7f096c15ef90 2024-09-13T17:24:27.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c15c0d0 con 0x7f096c15ebb0 2024-09-13T17:24:27.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096c15c3b0 con 0x7f096c15f5c0 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0971400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 0x7f096c1f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0971400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 0x7f096c1f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41440/0 (socket says 172.21.15.139:41440) 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15f5c0 0x7f096c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0971400700 1 -- 172.21.15.139:0/2478634626 learned_addr learned my addr 172.21.15.139:0/2478634626 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0971e00700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 -- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 msgr2=0x7f096c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 -- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 msgr2=0x7f096c1f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 0x7f096c1f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 -- 172.21.15.139:0/2478634626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600094b0 con 0x7f096c15f5c0 2024-09-13T17:24:27.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0971400700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 0x7f096c1f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:27.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0972800700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15f5c0 0x7f096c156740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f096800efc0 tx=0x7f096800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096800cc90 con 0x7f096c15f5c0 2024-09-13T17:24:27.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096800f040 con 0x7f096c15f5c0 2024-09-13T17:24:27.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680146c0 con 0x7f096c15f5c0 2024-09-13T17:24:27.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c15c690 con 0x7f096c15f5c0 2024-09-13T17:24:27.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.016+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096c139b90 con 0x7f096c15f5c0 2024-09-13T17:24:27.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.020+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096c0677e0 con 0x7f096c15f5c0 2024-09-13T17:24:27.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.024+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0968014820 con 0x7f096c15f5c0 2024-09-13T17:24:27.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.024+0000 7f0966000700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0950066730 0x7f0950068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.024+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0968084f80 con 0x7f096c15f5c0 2024-09-13T17:24:27.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.024+0000 7f0971e00700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0950066730 0x7f0950068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.024+0000 7f0971e00700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0950066730 0x7f0950068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09600090b0 tx=0x7f0960008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.036+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0968051f60 con 0x7f096c15f5c0 2024-09-13T17:24:27.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.224+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f096c0b06f0 con 0x7f096c15f5c0 2024-09-13T17:24:27.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0966000700 1 -- 172.21.15.139:0/2478634626 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f096c0b06f0 con 0x7f096c15f5c0 2024-09-13T17:24:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:27.235 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:27.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0950066730 msgr2=0x7f0950068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0950066730 0x7f0950068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09600090b0 tx=0x7f0960008030 comp rx=0 tx=0).stop 2024-09-13T17:24:27.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15f5c0 msgr2=0x7f096c156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15f5c0 0x7f096c156740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f096800efc0 tx=0x7f096800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 shutdown_connections 2024-09-13T17:24:27.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0950066730 0x7f0950068bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f096c15f5c0 0x7f096c156740 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f096c15ef90 0x7f096c1f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 --2- 172.21.15.139:0/2478634626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096c15ebb0 0x7f096c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 >> 172.21.15.139:0/2478634626 conn(0x7f096c071fa0 msgr2=0x7f096c13fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:27.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 shutdown_connections 2024-09-13T17:24:27.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.232+0000 7f0973200700 1 -- 172.21.15.139:0/2478634626 wait complete. 2024-09-13T17:24:27.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:27.262 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:27.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.444+0000 7ff527200700 1 Processor -- start 2024-09-13T17:24:27.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.444+0000 7ff527200700 1 -- start start 2024-09-13T17:24:27.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff527200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5280b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff527200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff52815f5c0 0x7ff5281434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff527200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5280b41a0 con 0x7ff52815ef90 2024-09-13T17:24:27.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff527200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5280b6370 con 0x7ff52815f5c0 2024-09-13T17:24:27.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff527200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280b6650 con 0x7ff52815ebb0 2024-09-13T17:24:27.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5280b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff52815f5c0 0x7ff5281434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5280b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:47120/0 (socket says 172.21.15.139:47120) 2024-09-13T17:24:27.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 -- 172.21.15.139:0/2906317403 learned_addr learned my addr 172.21.15.139:0/2906317403 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:27.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff526800700 1 --1- 172.21.15.139:0/2906317403 >> v1:172.21.15.176:6789/0 conn(0x7ff52815ef90 0x7ff528143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51322/0 (socket says 172.21.15.139:51322) 2024-09-13T17:24:27.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 -- 172.21.15.139:0/2906317403 >> v2:172.21.15.176:3300/0 conn(0x7ff52815f5c0 msgr2=0x7ff5281434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:27.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 --2- 172.21.15.139:0/2906317403 >> v2:172.21.15.176:3300/0 conn(0x7ff52815f5c0 0x7ff5281434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 -- 172.21.15.139:0/2906317403 >> v1:172.21.15.176:6789/0 conn(0x7ff52815ef90 legacy=0x7ff528143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 -- 172.21.15.139:0/2906317403 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280b6930 con 0x7ff52815ebb0 2024-09-13T17:24:27.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff524a00700 1 -- 172.21.15.139:0/2906317403 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265693543 0 0) 0x7ff520001490 con 0x7ff52815ef90 2024-09-13T17:24:27.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff525e00700 1 --2- 172.21.15.139:0/2906317403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5280b3c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff518009910 tx=0x7ff518009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ce6efd3477c5600 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff524a00700 1 -- 172.21.15.139:0/2906317403 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011830 con 0x7ff52815ebb0 2024-09-13T17:24:27.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff524a00700 1 -- 172.21.15.139:0/2906317403 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518011990 con 0x7ff52815ebb0 2024-09-13T17:24:27.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.448+0000 7ff524a00700 1 -- 172.21.15.139:0/2906317403 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011d40 con 0x7ff52815ebb0 2024-09-13T17:24:27.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- 172.21.15.139:0/2906317403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 msgr2=0x7ff5280b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 --2- 172.21.15.139:0/2906317403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5280b3c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff518009910 tx=0x7ff518009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:27.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- 172.21.15.139:0/2906317403 shutdown_connections 2024-09-13T17:24:27.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 --2- 172.21.15.139:0/2906317403 >> v2:172.21.15.176:3300/0 conn(0x7ff52815f5c0 0x7ff5281434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 --2- 172.21.15.139:0/2906317403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5280b3c60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- 172.21.15.139:0/2906317403 >> 172.21.15.139:0/2906317403 conn(0x7ff528071fa0 msgr2=0x7ff528072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:27.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- 172.21.15.139:0/2906317403 shutdown_connections 2024-09-13T17:24:27.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- 172.21.15.139:0/2906317403 wait complete. 2024-09-13T17:24:27.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 Processor -- start 2024-09-13T17:24:27.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- start start 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5281584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 0x7ff528158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff52815f5c0 0x7ff528156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff528159cb0 con 0x7ff52815ef90 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.452+0000 7ff527200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff528159030 con 0x7ff52815f5c0 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff527200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff528159310 con 0x7ff52815ebb0 2024-09-13T17:24:27.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 0x7ff528158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 0x7ff528158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41448/0 (socket says 172.21.15.139:41448) 2024-09-13T17:24:27.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 -- 172.21.15.139:0/774742096 learned_addr learned my addr 172.21.15.139:0/774742096 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff526800700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff52815f5c0 0x7ff528156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 -- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 msgr2=0x7ff5281584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525e00700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5281584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5281584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 -- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff52815f5c0 msgr2=0x7ff528156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff52815f5c0 0x7ff528156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 -- 172.21.15.139:0/774742096 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518009570 con 0x7ff52815ef90 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff526800700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff52815f5c0 0x7ff528156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525e00700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5281584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff525400700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 0x7ff528158a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff51400e840 tx=0x7ff51400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140095a0 con 0x7ff52815ef90 2024-09-13T17:24:27.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400c690 con 0x7ff52815ef90 2024-09-13T17:24:27.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400ca00 con 0x7ff52815ef90 2024-09-13T17:24:27.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5281595f0 con 0x7ff52815ef90 2024-09-13T17:24:27.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5281580a0 con 0x7ff52815ef90 2024-09-13T17:24:27.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.456+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5280677e0 con 0x7ff52815ef90 2024-09-13T17:24:27.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.460+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff51400cb60 con 0x7ff52815ef90 2024-09-13T17:24:27.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.460+0000 7ff51e000700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff508066730 0x7ff508068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.460+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5140844b0 con 0x7ff52815ef90 2024-09-13T17:24:27.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.460+0000 7ff525e00700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff508066730 0x7ff508068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.460+0000 7ff525e00700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff508066730 0x7ff508068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff518009c60 tx=0x7ff518008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.468+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff514051520 con 0x7ff52815ef90 2024-09-13T17:24:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.656+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff528159df0 con 0x7ff52815ef90 2024-09-13T17:24:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.656+0000 7ff51e000700 1 -- 172.21.15.139:0/774742096 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff528159df0 con 0x7ff52815ef90 2024-09-13T17:24:27.664 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:24:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff508066730 msgr2=0x7ff508068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff508066730 0x7ff508068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff518009c60 tx=0x7ff518008030 comp rx=0 tx=0).stop 2024-09-13T17:24:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 msgr2=0x7ff528158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 0x7ff528158a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff51400e840 tx=0x7ff51400ec00 comp rx=0 tx=0).stop 2024-09-13T17:24:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 shutdown_connections 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff508066730 0x7ff508068bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff52815f5c0 0x7ff528156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff52815ef90 0x7ff528158a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 --2- 172.21.15.139:0/774742096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff52815ebb0 0x7ff5281584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 >> 172.21.15.139:0/774742096 conn(0x7ff528071fa0 msgr2=0x7ff52813f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 shutdown_connections 2024-09-13T17:24:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.660+0000 7ff527200700 1 -- 172.21.15.139:0/774742096 wait complete. 2024-09-13T17:24:27.687 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:27.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.856+0000 7f2cc0400700 1 Processor -- start 2024-09-13T17:24:27.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.856+0000 7f2cc0400700 1 -- start start 2024-09-13T17:24:27.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cc0400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb8150d40 0x7f2cb806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cc0400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2cb806cc80 0x7f2cb80b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cc0400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb8151120 con 0x7f2cb80b4dd0 2024-09-13T17:24:27.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cc0400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80b5280 con 0x7f2cb806cc80 2024-09-13T17:24:27.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cc0400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb806d0a0 con 0x7f2cb8150d40 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbd000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2cb806cc80 0x7f2cb80b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbe400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2cb80b4dd0 0x7f2cb815d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51332/0 (socket says 172.21.15.139:51332) 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbe400700 1 -- 172.21.15.139:0/2999548301 learned_addr learned my addr 172.21.15.139:0/2999548301 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbda00700 1 --2- 172.21.15.139:0/2999548301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb8150d40 0x7f2cb806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cb7e00700 1 -- 172.21.15.139:0/2999548301 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594542487 0 0) 0x7f2cb8151120 con 0x7f2cb80b4dd0 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cb7e00700 1 -- 172.21.15.139:0/2999548301 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca00035d0 con 0x7f2cb80b4dd0 2024-09-13T17:24:27.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbd000700 1 -- 172.21.15.139:0/2999548301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb8150d40 msgr2=0x7f2cb806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:27.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbd000700 1 --2- 172.21.15.139:0/2999548301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb8150d40 0x7f2cb806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbd000700 1 -- 172.21.15.139:0/2999548301 >> v1:172.21.15.176:6789/0 conn(0x7f2cb80b4dd0 legacy=0x7f2cb815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbd000700 1 -- 172.21.15.139:0/2999548301 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80cc900 con 0x7f2cb806cc80 2024-09-13T17:24:27.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cbd000700 1 --2- 172.21.15.139:0/2999548301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb806cc80 0x7f2cb80b4890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009850 tx=0x7f2ca4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda619c9d138a21d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cb7e00700 1 -- 172.21.15.139:0/2999548301 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400f8a0 con 0x7f2cb806cc80 2024-09-13T17:24:27.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cb7e00700 1 -- 172.21.15.139:0/2999548301 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca400fa00 con 0x7f2cb806cc80 2024-09-13T17:24:27.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.860+0000 7f2cb7e00700 1 -- 172.21.15.139:0/2999548301 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400fd70 con 0x7f2cb806cc80 2024-09-13T17:24:27.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 -- 172.21.15.139:0/2999548301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb806cc80 msgr2=0x7f2cb80b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2999548301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb806cc80 0x7f2cb80b4890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009850 tx=0x7f2ca4009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:27.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 -- 172.21.15.139:0/2999548301 shutdown_connections 2024-09-13T17:24:27.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2999548301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb806cc80 0x7f2cb80b4890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2999548301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb8150d40 0x7f2cb806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 -- 172.21.15.139:0/2999548301 >> 172.21.15.139:0/2999548301 conn(0x7f2cb8072010 msgr2=0x7f2cb80b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:27.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 -- 172.21.15.139:0/2999548301 shutdown_connections 2024-09-13T17:24:27.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 -- 172.21.15.139:0/2999548301 wait complete. 2024-09-13T17:24:27.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.864+0000 7f2cc0400700 1 Processor -- start 2024-09-13T17:24:27.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 -- start start 2024-09-13T17:24:27.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb806cc80 0x7f2cb8152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cb80b4dd0 0x7f2cb81eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 0x7f2cb814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81f0360 con 0x7f2cb8150d40 2024-09-13T17:24:27.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81ef2d0 con 0x7f2cb80b4dd0 2024-09-13T17:24:27.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cc0400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81ef490 con 0x7f2cb806cc80 2024-09-13T17:24:27.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 0x7f2cb814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbda00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb806cc80 0x7f2cb8152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 0x7f2cb814e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41476/0 (socket says 172.21.15.139:41476) 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 -- 172.21.15.139:0/2897826562 learned_addr learned my addr 172.21.15.139:0/2897826562 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbd000700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cb80b4dd0 0x7f2cb81eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 -- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb806cc80 msgr2=0x7f2cb8152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb806cc80 0x7f2cb8152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 -- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cb80b4dd0 msgr2=0x7f2cb81eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cb80b4dd0 0x7f2cb81eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 -- 172.21.15.139:0/2897826562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40094b0 con 0x7f2cb8150d40 2024-09-13T17:24:27.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.868+0000 7f2cbe400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 0x7f2cb814e900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000caa0 tx=0x7f2cb000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.872+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0007480 con 0x7f2cb8150d40 2024-09-13T17:24:27.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.872+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb00075e0 con 0x7f2cb8150d40 2024-09-13T17:24:27.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.872+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb81ef6e0 con 0x7f2cb8150d40 2024-09-13T17:24:27.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.872+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0007970 con 0x7f2cb8150d40 2024-09-13T17:24:27.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.872+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb81efca0 con 0x7f2cb8150d40 2024-09-13T17:24:27.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.872+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb81f04a0 con 0x7f2cb8150d40 2024-09-13T17:24:27.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.876+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cb001b3b0 con 0x7f2cb8150d40 2024-09-13T17:24:27.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.876+0000 7f2cb5600700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c98066730 0x7f2c98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:27.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.876+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2cb0083ce0 con 0x7f2cb8150d40 2024-09-13T17:24:27.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.876+0000 7f2cbda00700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c98066730 0x7f2c98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:27.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.876+0000 7f2cbda00700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c98066730 0x7f2c98068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009bf0 tx=0x7f2cac009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:27.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:27.880+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2cb81f04a0 con 0x7f2cb8150d40 2024-09-13T17:24:28.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.060+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cb81f04a0 con 0x7f2cb8150d40 2024-09-13T17:24:28.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.060+0000 7f2cb5600700 1 -- 172.21.15.139:0/2897826562 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cb81f04a0 con 0x7f2cb8150d40 2024-09-13T17:24:28.067 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:28.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c98066730 msgr2=0x7f2c98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c98066730 0x7f2c98068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009bf0 tx=0x7f2cac009240 comp rx=0 tx=0).stop 2024-09-13T17:24:28.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 msgr2=0x7f2cb814e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 0x7f2cb814e900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000caa0 tx=0x7f2cb000cad0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 shutdown_connections 2024-09-13T17:24:28.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c98066730 0x7f2c98068bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cb8150d40 0x7f2cb814e900 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cb80b4dd0 0x7f2cb81eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 --2- 172.21.15.139:0/2897826562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cb806cc80 0x7f2cb8152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 >> 172.21.15.139:0/2897826562 conn(0x7f2cb8072010 msgr2=0x7f2cb806f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:28.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 shutdown_connections 2024-09-13T17:24:28.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.064+0000 7f2cc0400700 1 -- 172.21.15.139:0/2897826562 wait complete. 2024-09-13T17:24:28.093 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:28.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.264+0000 7f0653200700 1 Processor -- start 2024-09-13T17:24:28.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.264+0000 7f0653200700 1 -- start start 2024-09-13T17:24:28.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0653200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540b64e0 0x7f0654162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0653200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f06540d1030 0x7f06540d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0653200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065406c080 con 0x7f06540d0270 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0653200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540d09f0 con 0x7f06540d1030 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0653200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540cf2c0 con 0x7f06540b64e0 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0652800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f06540d1030 0x7f06540d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0652800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f06540d1030 0x7f06540d14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41478/0 (socket says 172.21.15.139:41478) 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0652800700 1 -- 172.21.15.139:0/2780295722 learned_addr learned my addr 172.21.15.139:0/2780295722 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0651400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f06540d0270 0x7f06540cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51340/0 (socket says 172.21.15.139:51340) 2024-09-13T17:24:28.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.268+0000 7f0651e00700 1 --2- 172.21.15.139:0/2780295722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540b64e0 0x7f0654162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0652800700 1 -- 172.21.15.139:0/2780295722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540b64e0 msgr2=0x7f0654162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:28.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0652800700 1 --2- 172.21.15.139:0/2780295722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540b64e0 0x7f0654162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0652800700 1 -- 172.21.15.139:0/2780295722 >> v1:172.21.15.176:6789/0 conn(0x7f06540d0270 legacy=0x7f06540cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0650a00700 1 -- 172.21.15.139:0/2780295722 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501074525 0 0) 0x7f065406c080 con 0x7f06540d0270 2024-09-13T17:24:28.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0652800700 1 -- 172.21.15.139:0/2780295722 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540d1a00 con 0x7f06540d1030 2024-09-13T17:24:28.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0652800700 1 --2- 172.21.15.139:0/2780295722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540d1030 0x7f06540d14c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f064c009e50 tx=0x7f064c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0a0595dbc2933 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:28.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0650a00700 1 -- 172.21.15.139:0/2780295722 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00e070 con 0x7f06540d1030 2024-09-13T17:24:28.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0650a00700 1 -- 172.21.15.139:0/2780295722 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c00b910 con 0x7f06540d1030 2024-09-13T17:24:28.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0650a00700 1 -- 172.21.15.139:0/2780295722 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00bcc0 con 0x7f06540d1030 2024-09-13T17:24:28.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 -- 172.21.15.139:0/2780295722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540d1030 msgr2=0x7f06540d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 --2- 172.21.15.139:0/2780295722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540d1030 0x7f06540d14c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f064c009e50 tx=0x7f064c00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:28.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 -- 172.21.15.139:0/2780295722 shutdown_connections 2024-09-13T17:24:28.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 --2- 172.21.15.139:0/2780295722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540d1030 0x7f06540d14c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 --2- 172.21.15.139:0/2780295722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540b64e0 0x7f0654162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 -- 172.21.15.139:0/2780295722 >> 172.21.15.139:0/2780295722 conn(0x7f0654071fa0 msgr2=0x7f0654072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:28.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 -- 172.21.15.139:0/2780295722 shutdown_connections 2024-09-13T17:24:28.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.272+0000 7f0653200700 1 -- 172.21.15.139:0/2780295722 wait complete. 2024-09-13T17:24:28.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 Processor -- start 2024-09-13T17:24:28.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 -- start start 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 0x7f06541596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06540d0270 0x7f065415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540d1030 0x7f0654155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06541589b0 con 0x7f06540b64e0 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065415ac00 con 0x7f06540d0270 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0653200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0654158c00 con 0x7f06540d1030 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0651e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 0x7f06541596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0651e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 0x7f06541596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41488/0 (socket says 172.21.15.139:41488) 2024-09-13T17:24:28.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.276+0000 7f0651e00700 1 -- 172.21.15.139:0/2163168607 learned_addr learned my addr 172.21.15.139:0/2163168607 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:28.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0652800700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540d1030 0x7f0654155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0651e00700 1 -- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540d1030 msgr2=0x7f0654155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0651e00700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540d1030 0x7f0654155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0651e00700 1 -- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06540d0270 msgr2=0x7f065415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0651e00700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06540d0270 0x7f065415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0651e00700 1 -- 172.21.15.139:0/2163168607 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009b30 con 0x7f06540b64e0 2024-09-13T17:24:28.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0651e00700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 0x7f06541596e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f064400ebe0 tx=0x7f0644009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:28.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644009740 con 0x7f06540b64e0 2024-09-13T17:24:28.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400c8b0 con 0x7f06540b64e0 2024-09-13T17:24:28.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0654158ee0 con 0x7f06540b64e0 2024-09-13T17:24:28.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400cc40 con 0x7f06540b64e0 2024-09-13T17:24:28.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06540b2400 con 0x7f06540b64e0 2024-09-13T17:24:28.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.280+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06540677e0 con 0x7f06540b64e0 2024-09-13T17:24:28.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.284+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0644013470 con 0x7f06540b64e0 2024-09-13T17:24:28.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.284+0000 7f064a000700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0634066760 0x7f0634068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.284+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0644084550 con 0x7f06540b64e0 2024-09-13T17:24:28.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.284+0000 7f0651400700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0634066760 0x7f0634068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.284+0000 7f0651400700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0634066760 0x7f0634068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06400011e0 tx=0x7f06400079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:28.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.292+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06440515c0 con 0x7f06540b64e0 2024-09-13T17:24:28.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.476+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06541587c0 con 0x7f06540b64e0 2024-09-13T17:24:28.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.476+0000 7f064a000700 1 -- 172.21.15.139:0/2163168607 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06541587c0 con 0x7f06540b64e0 2024-09-13T17:24:28.483 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:24:28.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0634066760 msgr2=0x7f0634068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0634066760 0x7f0634068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06400011e0 tx=0x7f06400079d0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 msgr2=0x7f06541596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 0x7f06541596e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f064400ebe0 tx=0x7f0644009e00 comp rx=0 tx=0).stop 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 shutdown_connections 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0634066760 0x7f0634068c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06540d1030 0x7f0654155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06540d0270 0x7f065415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 --2- 172.21.15.139:0/2163168607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06540b64e0 0x7f06541596e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 >> 172.21.15.139:0/2163168607 conn(0x7f0654071fa0 msgr2=0x7f0654164070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 shutdown_connections 2024-09-13T17:24:28.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.480+0000 7f0653200700 1 -- 172.21.15.139:0/2163168607 wait complete. 2024-09-13T17:24:28.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:28.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.680+0000 7f2b0e600700 1 Processor -- start 2024-09-13T17:24:28.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.680+0000 7f2b0e600700 1 -- start start 2024-09-13T17:24:28.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0e600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b08071190 0x7f2b0815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071570 0x7f2b08159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0e600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0813f0c0 con 0x7f2b0813f810 2024-09-13T17:24:28.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0e600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0815a4a0 con 0x7f2b08071190 2024-09-13T17:24:28.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0815a720 con 0x7f2b08071570 2024-09-13T17:24:28.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b08071190 0x7f2b0815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b08071190 0x7f2b0815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41494/0 (socket says 172.21.15.139:41494) 2024-09-13T17:24:28.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 -- 172.21.15.139:0/2713611453 learned_addr learned my addr 172.21.15.139:0/2713611453 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:28.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b07e00700 1 --2- 172.21.15.139:0/2713611453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071570 0x7f2b08159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 -- 172.21.15.139:0/2713611453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071570 msgr2=0x7f2b08159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:28.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 --2- 172.21.15.139:0/2713611453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071570 0x7f2b08159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 -- 172.21.15.139:0/2713611453 >> v1:172.21.15.139:6789/0 conn(0x7f2b0813f810 legacy=0x7f2b0813d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 -- 172.21.15.139:0/2713611453 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0815aa00 con 0x7f2b08071190 2024-09-13T17:24:28.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b0d200700 1 --2- 172.21.15.139:0/2713611453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071190 0x7f2b0815dfd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009910 tx=0x7f2afc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff2cdc41b7b7b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:28.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b07400700 1 -- 172.21.15.139:0/2713611453 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc011830 con 0x7f2b08071190 2024-09-13T17:24:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b07400700 1 -- 172.21.15.139:0/2713611453 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc011990 con 0x7f2b08071190 2024-09-13T17:24:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.684+0000 7f2b07400700 1 -- 172.21.15.139:0/2713611453 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc011d40 con 0x7f2b08071190 2024-09-13T17:24:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 -- 172.21.15.139:0/2713611453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071190 msgr2=0x7f2b0815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 --2- 172.21.15.139:0/2713611453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071190 0x7f2b0815dfd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009910 tx=0x7f2afc009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 -- 172.21.15.139:0/2713611453 shutdown_connections 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 --2- 172.21.15.139:0/2713611453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071570 0x7f2b08159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 --2- 172.21.15.139:0/2713611453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071190 0x7f2b0815dfd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 -- 172.21.15.139:0/2713611453 >> 172.21.15.139:0/2713611453 conn(0x7f2b080ce9d0 msgr2=0x7f2b080cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 -- 172.21.15.139:0/2713611453 shutdown_connections 2024-09-13T17:24:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.688+0000 7f2b0e600700 1 -- 172.21.15.139:0/2713611453 wait complete. 2024-09-13T17:24:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 Processor -- start 2024-09-13T17:24:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 -- start start 2024-09-13T17:24:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071190 0x7f2b081f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 0x7f2b08138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b0813f810 0x7f2b080cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0813fe90 con 0x7f2b08071570 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081f69b0 con 0x7f2b0813f810 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0806d320 con 0x7f2b08071190 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 0x7f2b08138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 0x7f2b08138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41510/0 (socket says 172.21.15.139:41510) 2024-09-13T17:24:28.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 -- 172.21.15.139:0/1504434024 learned_addr learned my addr 172.21.15.139:0/1504434024 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:28.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0d200700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071190 0x7f2b081f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b0dc00700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b0813f810 0x7f2b080cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 -- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071190 msgr2=0x7f2b081f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071190 0x7f2b081f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 -- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b0813f810 msgr2=0x7f2b080cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b0813f810 0x7f2b080cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.692+0000 7f2b07e00700 1 -- 172.21.15.139:0/1504434024 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009570 con 0x7f2b08071570 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b07e00700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 0x7f2b08138620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ea00 tx=0x7f2af400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4009720 con 0x7f2b08071570 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400c850 con 0x7f2b08071570 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400cbc0 con 0x7f2b08071570 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0806d600 con 0x7f2b08071570 2024-09-13T17:24:28.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b081403c0 con 0x7f2b08071570 2024-09-13T17:24:28.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0813fc80 con 0x7f2b08071570 2024-09-13T17:24:28.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.696+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2af400cd20 con 0x7f2b08071570 2024-09-13T17:24:28.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.700+0000 7f2b04c00700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2ae8066730 0x7f2ae8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:28.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.700+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2af4084620 con 0x7f2b08071570 2024-09-13T17:24:28.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.700+0000 7f2b0d200700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2ae8066730 0x7f2ae8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:28.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.700+0000 7f2b0d200700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2ae8066730 0x7f2ae8068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009c60 tx=0x7f2afc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.704+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2af4051600 con 0x7f2b08071570 2024-09-13T17:24:28.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.884+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b0815bc00 con 0x7f2b08071570 2024-09-13T17:24:28.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b04c00700 1 -- 172.21.15.139:0/1504434024 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2af4054c20 con 0x7f2b08071570 2024-09-13T17:24:28.893 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2ae8066730 msgr2=0x7f2ae8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2ae8066730 0x7f2ae8068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009c60 tx=0x7f2afc008030 comp rx=0 tx=0).stop 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 msgr2=0x7f2b08138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 0x7f2b08138620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ea00 tx=0x7f2af400edc0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 shutdown_connections 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2ae8066730 0x7f2ae8068bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b0813f810 0x7f2b080cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b08071570 0x7f2b08138620 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 --2- 172.21.15.139:0/1504434024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b08071190 0x7f2b081f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:28.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 >> 172.21.15.139:0/1504434024 conn(0x7f2b080ce9d0 msgr2=0x7f2b080b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:28.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 shutdown_connections 2024-09-13T17:24:28.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:28.888+0000 7f2b0e600700 1 -- 172.21.15.139:0/1504434024 wait complete. 2024-09-13T17:24:28.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:24:29.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.084+0000 7f121e000700 1 Processor -- start 2024-09-13T17:24:29.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.084+0000 7f121e000700 1 -- start start 2024-09-13T17:24:29.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f12180c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121e000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12180ce810 0x7f121806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121e000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12180c5200 con 0x7f12180c49c0 2024-09-13T17:24:29.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121e000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121806a810 con 0x7f12180ce810 2024-09-13T17:24:29.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180c54e0 con 0x7f121815aab0 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f120fe00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f12180c49c0 0x7f12180ce100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49910/0 (socket says 172.21.15.139:49910) 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f120fe00700 1 -- 172.21.15.139:0/1346368740 learned_addr learned my addr 172.21.15.139:0/1346368740 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121cc00700 1 --2- 172.21.15.139:0/1346368740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f12180c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121d600700 1 --2- 172.21.15.139:0/1346368740 >> v2:172.21.15.176:3300/0 conn(0x7f12180ce810 0x7f121806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f1217e00700 1 -- 172.21.15.139:0/1346368740 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326481461 0 0) 0x7f12180c5200 con 0x7f12180c49c0 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f1217e00700 1 -- 172.21.15.139:0/1346368740 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc0035d0 con 0x7f12180c49c0 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121cc00700 1 -- 172.21.15.139:0/1346368740 >> v2:172.21.15.176:3300/0 conn(0x7f12180ce810 msgr2=0x7f121806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121cc00700 1 --2- 172.21.15.139:0/1346368740 >> v2:172.21.15.176:3300/0 conn(0x7f12180ce810 0x7f121806ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121cc00700 1 -- 172.21.15.139:0/1346368740 >> v1:172.21.15.139:6789/0 conn(0x7f12180c49c0 legacy=0x7f12180ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121cc00700 1 -- 172.21.15.139:0/1346368740 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121806a430 con 0x7f121815aab0 2024-09-13T17:24:29.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.088+0000 7f121cc00700 1 --2- 172.21.15.139:0/1346368740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f12180c4480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1208009dc0 tx=0x7f120800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206b0a5b253e33db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f1217e00700 1 -- 172.21.15.139:0/1346368740 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800e070 con 0x7f121815aab0 2024-09-13T17:24:29.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f1217e00700 1 -- 172.21.15.139:0/1346368740 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120800bae0 con 0x7f121815aab0 2024-09-13T17:24:29.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f1217e00700 1 -- 172.21.15.139:0/1346368740 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800be90 con 0x7f121815aab0 2024-09-13T17:24:29.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 -- 172.21.15.139:0/1346368740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 msgr2=0x7f12180c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 --2- 172.21.15.139:0/1346368740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f12180c4480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1208009dc0 tx=0x7f120800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:29.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 -- 172.21.15.139:0/1346368740 shutdown_connections 2024-09-13T17:24:29.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 --2- 172.21.15.139:0/1346368740 >> v2:172.21.15.176:3300/0 conn(0x7f12180ce810 0x7f121806ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 --2- 172.21.15.139:0/1346368740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f12180c4480 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 -- 172.21.15.139:0/1346368740 >> 172.21.15.139:0/1346368740 conn(0x7f121806ed30 msgr2=0x7f12180b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:29.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 -- 172.21.15.139:0/1346368740 shutdown_connections 2024-09-13T17:24:29.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.092+0000 7f121e000700 1 -- 172.21.15.139:0/1346368740 wait complete. 2024-09-13T17:24:29.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 Processor -- start 2024-09-13T17:24:29.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 -- start start 2024-09-13T17:24:29.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12180c49c0 0x7f12181f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 0x7f1218149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f1218153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121814a2c0 con 0x7f12180ce810 2024-09-13T17:24:29.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12181551b0 con 0x7f12180c49c0 2024-09-13T17:24:29.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1218155490 con 0x7f121815aab0 2024-09-13T17:24:29.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 0x7f1218149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 0x7f1218149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41512/0 (socket says 172.21.15.139:41512) 2024-09-13T17:24:29.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 -- 172.21.15.139:0/53617726 learned_addr learned my addr 172.21.15.139:0/53617726 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:29.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121cc00700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12180c49c0 0x7f12181f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f121d600700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f1218153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 -- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 msgr2=0x7f1218153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f1218153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 -- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12180c49c0 msgr2=0x7f12181f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12180c49c0 0x7f12181f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 -- 172.21.15.139:0/53617726 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208009a70 con 0x7f12180ce810 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.096+0000 7f120fe00700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 0x7f1218149d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12000010e0 tx=0x7f120000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200005d90 con 0x7f12180ce810 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000070d0 con 0x7f12180ce810 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1218155770 con 0x7f12180ce810 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200007480 con 0x7f12180ce810 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1218155d30 con 0x7f12180ce810 2024-09-13T17:24:29.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1218155f20 con 0x7f12180ce810 2024-09-13T17:24:29.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.100+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12000075e0 con 0x7f12180ce810 2024-09-13T17:24:29.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.104+0000 7f1215600700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f11f4066730 0x7f11f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.104+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1200083880 con 0x7f12180ce810 2024-09-13T17:24:29.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.104+0000 7f121cc00700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f11f4066730 0x7f11f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.104+0000 7f121cc00700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f11f4066730 0x7f11f4068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1208000f80 tx=0x7f1208011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.108+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12000508f0 con 0x7f12180ce810 2024-09-13T17:24:29.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.300+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f12180ce330 con 0x7f12180ce810 2024-09-13T17:24:29.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.300+0000 7f1215600700 1 -- 172.21.15.139:0/53617726 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1200053f10 con 0x7f12180ce810 2024-09-13T17:24:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.300+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f11f4066730 msgr2=0x7f11f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.300+0000 7f121e000700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f11f4066730 0x7f11f4068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1208000f80 tx=0x7f1208011000 comp rx=0 tx=0).stop 2024-09-13T17:24:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.300+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 msgr2=0x7f1218149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.300+0000 7f121e000700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 0x7f1218149d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12000010e0 tx=0x7f120000c9e0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 shutdown_connections 2024-09-13T17:24:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f11f4066730 0x7f11f4068bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f121815aab0 0x7f1218153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12180ce810 0x7f1218149d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 --2- 172.21.15.139:0/53617726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12180c49c0 0x7f12181f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 >> 172.21.15.139:0/53617726 conn(0x7f121806ed30 msgr2=0x7f121815b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:29.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 shutdown_connections 2024-09-13T17:24:29.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.304+0000 7f121e000700 1 -- 172.21.15.139:0/53617726 wait complete. 2024-09-13T17:24:29.311 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-09-13T17:24:29.330 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:24:29.330 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:29.345 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:29.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.556+0000 7f7c9dc00700 1 Processor -- start 2024-09-13T17:24:29.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.556+0000 7f7c9dc00700 1 -- start start 2024-09-13T17:24:29.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c980702c0 0x7f7c9806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98162550 0x7f7c9806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c980706a0 0x7f7c98070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980cb580 con 0x7f7c980702c0 2024-09-13T17:24:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c98071070 con 0x7f7c980706a0 2024-09-13T17:24:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98071e30 con 0x7f7c98162550 2024-09-13T17:24:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c980702c0 0x7f7c9806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c980702c0 0x7f7c9806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41514/0 (socket says 172.21.15.139:41514) 2024-09-13T17:24:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 -- 172.21.15.139:0/832047238 learned_addr learned my addr 172.21.15.139:0/832047238 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c8e000700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98162550 0x7f7c9806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c97400700 1 --2- 172.21.15.139:0/832047238 >> v2:172.21.15.176:3300/0 conn(0x7f7c980706a0 0x7f7c98070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 -- 172.21.15.139:0/832047238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98162550 msgr2=0x7f7c9806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98162550 0x7f7c9806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 -- 172.21.15.139:0/832047238 >> v2:172.21.15.176:3300/0 conn(0x7f7c980706a0 msgr2=0x7f7c98070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 --2- 172.21.15.139:0/832047238 >> v2:172.21.15.176:3300/0 conn(0x7f7c980706a0 0x7f7c98070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 -- 172.21.15.139:0/832047238 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980712b0 con 0x7f7c980702c0 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c8e000700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98162550 0x7f7c9806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c97400700 1 --2- 172.21.15.139:0/832047238 >> v2:172.21.15.176:3300/0 conn(0x7f7c980706a0 0x7f7c98070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96a00700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c980702c0 0x7f7c9806d2a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c980b4460 tx=0x7f7c88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb13a86282dcd73d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96000700 1 -- 172.21.15.139:0/832047238 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800b8a0 con 0x7f7c980702c0 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96000700 1 -- 172.21.15.139:0/832047238 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800ba00 con 0x7f7c980702c0 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c96000700 1 -- 172.21.15.139:0/832047238 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800bd90 con 0x7f7c980702c0 2024-09-13T17:24:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- 172.21.15.139:0/832047238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c980702c0 msgr2=0x7f7c9806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c980702c0 0x7f7c9806d2a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c980b4460 tx=0x7f7c88009bf0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- 172.21.15.139:0/832047238 shutdown_connections 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/832047238 >> v2:172.21.15.176:3300/0 conn(0x7f7c980706a0 0x7f7c98070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98162550 0x7f7c9806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/832047238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c980702c0 0x7f7c9806d2a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- 172.21.15.139:0/832047238 >> 172.21.15.139:0/832047238 conn(0x7f7c9806b1e0 msgr2=0x7f7c9806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- 172.21.15.139:0/832047238 shutdown_connections 2024-09-13T17:24:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- 172.21.15.139:0/832047238 wait complete. 2024-09-13T17:24:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 Processor -- start 2024-09-13T17:24:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- start start 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c980702c0 0x7f7c980a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c980706a0 0x7f7c9815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 0x7f7c98143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815d870 con 0x7f7c98162550 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98144380 con 0x7f7c980702c0 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c9dc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815cbf0 con 0x7f7c980706a0 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.560+0000 7f7c97400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 0x7f7c98143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 0x7f7c98143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41518/0 (socket says 172.21.15.139:41518) 2024-09-13T17:24:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 -- 172.21.15.139:0/2278996065 learned_addr learned my addr 172.21.15.139:0/2278996065 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:29.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c8e000700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c980706a0 0x7f7c9815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c96a00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c980702c0 0x7f7c980a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 -- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c980706a0 msgr2=0x7f7c9815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c980706a0 0x7f7c9815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 -- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c980702c0 msgr2=0x7f7c980a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c980702c0 0x7f7c980a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 -- 172.21.15.139:0/2278996065 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009570 con 0x7f7c98162550 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c97400700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 0x7f7c98143e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cef0 tx=0x7f7c9000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000ac80 con 0x7f7c98162550 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000ade0 con 0x7f7c98162550 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90015680 con 0x7f7c98162550 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9815ced0 con 0x7f7c98162550 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9815d490 con 0x7f7c98162550 2024-09-13T17:24:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.564+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9815d9b0 con 0x7f7c98162550 2024-09-13T17:24:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.568+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c9000d430 con 0x7f7c98162550 2024-09-13T17:24:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.568+0000 7f7c8f400700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c74066730 0x7f7c74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.568+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c90084870 con 0x7f7c98162550 2024-09-13T17:24:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.568+0000 7f7c96a00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c74066730 0x7f7c74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.568+0000 7f7c96a00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c74066730 0x7f7c74068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000c00 tx=0x7f7c88008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.576+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c900518e0 con 0x7f7c98162550 2024-09-13T17:24:29.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.764+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c98070b30 con 0x7f7c98162550 2024-09-13T17:24:29.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.764+0000 7f7c8f400700 1 -- 172.21.15.139:0/2278996065 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f7c90054f00 con 0x7f7c98162550 2024-09-13T17:24:29.774 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:29.774 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:29.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c74066730 msgr2=0x7f7c74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c74066730 0x7f7c74068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000c00 tx=0x7f7c88008030 comp rx=0 tx=0).stop 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 msgr2=0x7f7c98143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 0x7f7c98143e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cef0 tx=0x7f7c9000cf20 comp rx=0 tx=0).stop 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 shutdown_connections 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c74066730 0x7f7c74068bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c98162550 0x7f7c98143e40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c980706a0 0x7f7c9815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 --2- 172.21.15.139:0/2278996065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c980702c0 0x7f7c980a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 >> 172.21.15.139:0/2278996065 conn(0x7f7c9806b1e0 msgr2=0x7f7c980ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:29.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 shutdown_connections 2024-09-13T17:24:29.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.768+0000 7f7c9dc00700 1 -- 172.21.15.139:0/2278996065 wait complete. 2024-09-13T17:24:29.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:29.797 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:29.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f806a000700 1 Processor -- start 2024-09-13T17:24:29.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f806a000700 1 -- start start 2024-09-13T17:24:29.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f806a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8064146b40 0x7f8064161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f806a000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8064161ab0 con 0x7f806406b140 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f806a000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806406cd90 con 0x7f80640c8ed0 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f806a000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806406c260 con 0x7f8064146b40 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f805aa00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f806406b140 0x7f806406c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49912/0 (socket says 172.21.15.139:49912) 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f8063400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8064146b40 0x7f8064161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f805aa00700 1 -- 172.21.15.139:0/635174354 learned_addr learned my addr 172.21.15.139:0/635174354 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f8063400700 1 -- 172.21.15.139:0/635174354 >> v1:172.21.15.176:6789/0 conn(0x7f80640c8ed0 legacy=0x7f80640c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f8063400700 1 -- 172.21.15.139:0/635174354 >> v1:172.21.15.139:6789/0 conn(0x7f806406b140 legacy=0x7f806406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.964+0000 7f8063400700 1 -- 172.21.15.139:0/635174354 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806406b5e0 con 0x7f8064146b40 2024-09-13T17:24:29.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f8063400700 1 --2- 172.21.15.139:0/635174354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8064146b40 0x7f8064161570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8054009d90 tx=0x7f805400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff1009ceefdea2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f8062a00700 1 -- 172.21.15.139:0/635174354 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805400e070 con 0x7f8064146b40 2024-09-13T17:24:29.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f8062a00700 1 -- 172.21.15.139:0/635174354 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805400bb90 con 0x7f8064146b40 2024-09-13T17:24:29.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f8062a00700 1 -- 172.21.15.139:0/635174354 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054003a40 con 0x7f8064146b40 2024-09-13T17:24:29.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 -- 172.21.15.139:0/635174354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8064146b40 msgr2=0x7f8064161570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 --2- 172.21.15.139:0/635174354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8064146b40 0x7f8064161570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8054009d90 tx=0x7f805400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:29.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 -- 172.21.15.139:0/635174354 shutdown_connections 2024-09-13T17:24:29.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 --2- 172.21.15.139:0/635174354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8064146b40 0x7f8064161570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 -- 172.21.15.139:0/635174354 >> 172.21.15.139:0/635174354 conn(0x7f80640cfa80 msgr2=0x7f80640cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:29.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 -- 172.21.15.139:0/635174354 shutdown_connections 2024-09-13T17:24:29.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.968+0000 7f806a000700 1 -- 172.21.15.139:0/635174354 wait complete. 2024-09-13T17:24:29.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 Processor -- start 2024-09-13T17:24:29.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 -- start start 2024-09-13T17:24:29.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f806406b140 0x7f806415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 0x7f80640ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8064146b40 0x7f80640cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80641f28b0 con 0x7f80640c8ed0 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806413c000 con 0x7f806406b140 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f806a000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806413c2e0 con 0x7f8064146b40 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 0x7f80640ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 0x7f80640ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41528/0 (socket says 172.21.15.139:41528) 2024-09-13T17:24:29.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 -- 172.21.15.139:0/1917663066 learned_addr learned my addr 172.21.15.139:0/1917663066 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:29.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f8063400700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f806406b140 0x7f806415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f8063e00700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8064146b40 0x7f80640cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 -- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8064146b40 msgr2=0x7f80640cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8064146b40 0x7f80640cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 -- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f806406b140 msgr2=0x7f806415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:29.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f806406b140 0x7f806415c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 -- 172.21.15.139:0/1917663066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054009a70 con 0x7f80640c8ed0 2024-09-13T17:24:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f8063e00700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8064146b40 0x7f80640cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f8063400700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f806406b140 0x7f806415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805aa00700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 0x7f80640ce7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c430 tx=0x7f804c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.972+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c005d90 con 0x7f80640c8ed0 2024-09-13T17:24:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.976+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c0070d0 con 0x7f80640c8ed0 2024-09-13T17:24:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.976+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806413c5c0 con 0x7f80640c8ed0 2024-09-13T17:24:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.976+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c007460 con 0x7f80640c8ed0 2024-09-13T17:24:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.976+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806413cb80 con 0x7f80640c8ed0 2024-09-13T17:24:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.976+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80640d22d0 con 0x7f80640c8ed0 2024-09-13T17:24:29.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.976+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f804c0075c0 con 0x7f80640c8ed0 2024-09-13T17:24:29.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.980+0000 7f805be00700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8040066730 0x7f8040068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:29.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.980+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f804c083960 con 0x7f80640c8ed0 2024-09-13T17:24:29.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.980+0000 7f8063400700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8040066730 0x7f8040068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:29.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.980+0000 7f8063400700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8040066730 0x7f8040068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8054000f80 tx=0x7f8054011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:29.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:29.984+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f804c0508b0 con 0x7f80640c8ed0 2024-09-13T17:24:30.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.168+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80640cc250 con 0x7f80640c8ed0 2024-09-13T17:24:30.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.168+0000 7f805be00700 1 -- 172.21.15.139:0/1917663066 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f804c017020 con 0x7f80640c8ed0 2024-09-13T17:24:30.175 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:24:30.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8040066730 msgr2=0x7f8040068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8040066730 0x7f8040068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8054000f80 tx=0x7f8054011000 comp rx=0 tx=0).stop 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 msgr2=0x7f80640ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 0x7f80640ce7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c430 tx=0x7f804c00c7f0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 shutdown_connections 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8040066730 0x7f8040068bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8064146b40 0x7f80640cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80640c8ed0 0x7f80640ce7b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 --2- 172.21.15.139:0/1917663066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f806406b140 0x7f806415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 >> 172.21.15.139:0/1917663066 conn(0x7f80640cfa80 msgr2=0x7f80640ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 shutdown_connections 2024-09-13T17:24:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.172+0000 7f806a000700 1 -- 172.21.15.139:0/1917663066 wait complete. 2024-09-13T17:24:30.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:30.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 Processor -- start 2024-09-13T17:24:30.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 -- start start 2024-09-13T17:24:30.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd4c0144770 0x7fd4c00ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c015b1c0 0x7fd4c006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c015c160 con 0x7fd4c006d7e0 2024-09-13T17:24:30.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c006dc90 con 0x7fd4c0144770 2024-09-13T17:24:30.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c015c540 con 0x7fd4c015b1c0 2024-09-13T17:24:30.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd4c0144770 0x7fd4c00ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4b7e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c015b1c0 0x7fd4c006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd4c0144770 0x7fd4c00ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:46274/0 (socket says 172.21.15.139:46274) 2024-09-13T17:24:30.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4be800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd4c006d7e0 0x7fd4c015e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49924/0 (socket says 172.21.15.139:49924) 2024-09-13T17:24:30.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 -- 172.21.15.139:0/2426939584 learned_addr learned my addr 172.21.15.139:0/2426939584 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:30.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 -- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c015b1c0 msgr2=0x7fd4c006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:30.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 --2- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c015b1c0 0x7fd4c006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 -- 172.21.15.139:0/2426939584 >> v1:172.21.15.139:6789/0 conn(0x7fd4c006d7e0 legacy=0x7fd4c015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bd400700 1 -- 172.21.15.139:0/2426939584 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377295136 0 0) 0x7fd4c015c160 con 0x7fd4c006d7e0 2024-09-13T17:24:30.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 -- 172.21.15.139:0/2426939584 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0144b50 con 0x7fd4c0144770 2024-09-13T17:24:30.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4b7e00700 1 --2- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c015b1c0 0x7fd4c006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:30.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bde00700 1 --2- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0144770 0x7fd4c00ce5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009910 tx=0x7fd4b0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509eb90a869335d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:30.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bd400700 1 -- 172.21.15.139:0/2426939584 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0011830 con 0x7fd4c0144770 2024-09-13T17:24:30.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bd400700 1 -- 172.21.15.139:0/2426939584 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0011990 con 0x7fd4c0144770 2024-09-13T17:24:30.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4bd400700 1 -- 172.21.15.139:0/2426939584 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0011d40 con 0x7fd4c0144770 2024-09-13T17:24:30.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 -- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0144770 msgr2=0x7fd4c00ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.380+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0144770 0x7fd4c00ce5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009910 tx=0x7fd4b0009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:30.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 -- 172.21.15.139:0/2426939584 shutdown_connections 2024-09-13T17:24:30.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c015b1c0 0x7fd4c006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/2426939584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0144770 0x7fd4c00ce5f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 -- 172.21.15.139:0/2426939584 >> 172.21.15.139:0/2426939584 conn(0x7fd4c006b1e0 msgr2=0x7fd4c006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:30.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 -- 172.21.15.139:0/2426939584 shutdown_connections 2024-09-13T17:24:30.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 -- 172.21.15.139:0/2426939584 wait complete. 2024-09-13T17:24:30.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 Processor -- start 2024-09-13T17:24:30.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.384+0000 7fd4c4e00700 1 -- start start 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 0x7fd4c01f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c0144770 0x7fd4c0142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c015b1c0 0x7fd4c00acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01f34e0 con 0x7fd4c006d7e0 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00abc00 con 0x7fd4c015b1c0 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00abee0 con 0x7fd4c0144770 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 0x7fd4c01f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 0x7fd4c01f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41540/0 (socket says 172.21.15.139:41540) 2024-09-13T17:24:30.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 -- 172.21.15.139:0/3779886235 learned_addr learned my addr 172.21.15.139:0/3779886235 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4b7e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c0144770 0x7fd4c0142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4be800700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c015b1c0 0x7fd4c00acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 -- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c0144770 msgr2=0x7fd4c0142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c0144770 0x7fd4c0142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 -- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c015b1c0 msgr2=0x7fd4c00acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c015b1c0 0x7fd4c00acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 -- 172.21.15.139:0/3779886235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80094b0 con 0x7fd4c006d7e0 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4be800700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c015b1c0 0x7fd4c00acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4bde00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 0x7fd4c01f2fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4c006fd20 tx=0x7fd4b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000b9f0 con 0x7fd4c006d7e0 2024-09-13T17:24:30.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b001f070 con 0x7fd4c006d7e0 2024-09-13T17:24:30.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b0009570 con 0x7fd4c006d7e0 2024-09-13T17:24:30.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000bd70 con 0x7fd4c006d7e0 2024-09-13T17:24:30.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.388+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c00ac4a0 con 0x7fd4c006d7e0 2024-09-13T17:24:30.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.392+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c00cd160 con 0x7fd4c006d7e0 2024-09-13T17:24:30.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.392+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4b001a430 con 0x7fd4c006d7e0 2024-09-13T17:24:30.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.392+0000 7fd4b6000700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd49c066730 0x7fd49c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.392+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4b0021070 con 0x7fd4c006d7e0 2024-09-13T17:24:30.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.396+0000 7fd4b7e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd49c066730 0x7fd49c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.396+0000 7fd4b7e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd49c066730 0x7fd49c068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00ce2e0 tx=0x7fd4a8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:30.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.400+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4b0052dd0 con 0x7fd4c006d7e0 2024-09-13T17:24:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.580+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4c006b760 con 0x7fd4c006d7e0 2024-09-13T17:24:30.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4b6000700 1 -- 172.21.15.139:0/3779886235 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4b00563f0 con 0x7fd4c006d7e0 2024-09-13T17:24:30.589 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd49c066730 msgr2=0x7fd49c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd49c066730 0x7fd49c068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00ce2e0 tx=0x7fd4a8009240 comp rx=0 tx=0).stop 2024-09-13T17:24:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 msgr2=0x7fd4c01f2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 0x7fd4c01f2fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4c006fd20 tx=0x7fd4b0004770 comp rx=0 tx=0).stop 2024-09-13T17:24:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 shutdown_connections 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd49c066730 0x7fd49c068bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c015b1c0 0x7fd4c00acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4c0144770 0x7fd4c0142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 --2- 172.21.15.139:0/3779886235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4c006d7e0 0x7fd4c01f2fa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 >> 172.21.15.139:0/3779886235 conn(0x7fd4c006b1e0 msgr2=0x7fd4c00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 shutdown_connections 2024-09-13T17:24:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.584+0000 7fd4c4e00700 1 -- 172.21.15.139:0/3779886235 wait complete. 2024-09-13T17:24:30.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:30.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.776+0000 7f350d400700 1 Processor -- start 2024-09-13T17:24:30.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.776+0000 7f350d400700 1 -- start start 2024-09-13T17:24:30.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f350d400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3508144770 0x7f35080ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f350d400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f350806d9b0 0x7f350815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f350d400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350815c160 con 0x7f350815b1c0 2024-09-13T17:24:30.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f350d400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350815c540 con 0x7f350806d9b0 2024-09-13T17:24:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f350d400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3508144b50 con 0x7f3508144770 2024-09-13T17:24:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3505e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f350815b1c0 0x7f350806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51362/0 (socket says 172.21.15.139:51362) 2024-09-13T17:24:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3505e00700 1 -- 172.21.15.139:0/1881260392 learned_addr learned my addr 172.21.15.139:0/1881260392 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3507200700 1 --2- 172.21.15.139:0/1881260392 >> v2:172.21.15.139:3300/0 conn(0x7f350806d9b0 0x7f350815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3506800700 1 --2- 172.21.15.139:0/1881260392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3508144770 0x7f35080ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3505400700 1 -- 172.21.15.139:0/1881260392 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184054267 0 0) 0x7f350815c160 con 0x7f350815b1c0 2024-09-13T17:24:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3505400700 1 -- 172.21.15.139:0/1881260392 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34ec0035d0 con 0x7f350815b1c0 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3506800700 1 -- 172.21.15.139:0/1881260392 >> v2:172.21.15.139:3300/0 conn(0x7f350806d9b0 msgr2=0x7f350815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3506800700 1 --2- 172.21.15.139:0/1881260392 >> v2:172.21.15.139:3300/0 conn(0x7f350806d9b0 0x7f350815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3506800700 1 -- 172.21.15.139:0/1881260392 >> v1:172.21.15.176:6789/0 conn(0x7f350815b1c0 legacy=0x7f350806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3506800700 1 -- 172.21.15.139:0/1881260392 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350815b620 con 0x7f3508144770 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.780+0000 7f3507200700 1 --2- 172.21.15.139:0/1881260392 >> v2:172.21.15.139:3300/0 conn(0x7f350806d9b0 0x7f350815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f3506800700 1 --2- 172.21.15.139:0/1881260392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3508144770 0x7f35080ce5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009850 tx=0x7f34f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0f049bcfb337842 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f3505400700 1 -- 172.21.15.139:0/1881260392 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8011830 con 0x7f3508144770 2024-09-13T17:24:30.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f3505400700 1 -- 172.21.15.139:0/1881260392 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8011990 con 0x7f3508144770 2024-09-13T17:24:30.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f3505400700 1 -- 172.21.15.139:0/1881260392 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8011d40 con 0x7f3508144770 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 -- 172.21.15.139:0/1881260392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3508144770 msgr2=0x7f35080ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 --2- 172.21.15.139:0/1881260392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3508144770 0x7f35080ce5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009850 tx=0x7f34f8009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 -- 172.21.15.139:0/1881260392 shutdown_connections 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 --2- 172.21.15.139:0/1881260392 >> v2:172.21.15.139:3300/0 conn(0x7f350806d9b0 0x7f350815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 --2- 172.21.15.139:0/1881260392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3508144770 0x7f35080ce5f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 -- 172.21.15.139:0/1881260392 >> 172.21.15.139:0/1881260392 conn(0x7f350806b1e0 msgr2=0x7f350806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 -- 172.21.15.139:0/1881260392 shutdown_connections 2024-09-13T17:24:30.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.784+0000 7f350d400700 1 -- 172.21.15.139:0/1881260392 wait complete. 2024-09-13T17:24:30.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 Processor -- start 2024-09-13T17:24:30.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 -- start start 2024-09-13T17:24:30.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f350806d9b0 0x7f35080ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 0x7f350815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f350815b1c0 0x7f35080a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080ac1f0 con 0x7f3508144770 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080a9af0 con 0x7f350815b1c0 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f350d400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35080a9d90 con 0x7f350806d9b0 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f3505e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 0x7f350815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f3505e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 0x7f350815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41562/0 (socket says 172.21.15.139:41562) 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f3505e00700 1 -- 172.21.15.139:0/2782783792 learned_addr learned my addr 172.21.15.139:0/2782783792 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f3506800700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f350806d9b0 0x7f35080ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.788+0000 7f3507200700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f350815b1c0 0x7f35080a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f3505e00700 1 -- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f350806d9b0 msgr2=0x7f35080ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f3505e00700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f350806d9b0 0x7f35080ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f3505e00700 1 -- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f350815b1c0 msgr2=0x7f35080a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:30.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f3505e00700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f350815b1c0 0x7f35080a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:30.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f3505e00700 1 -- 172.21.15.139:0/2782783792 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500009a70 con 0x7f3508144770 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f3505e00700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 0x7f350815a8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f34f4005930 tx=0x7f34f400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4005d90 con 0x7f3508144770 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40070d0 con 0x7f3508144770 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f80094b0 con 0x7f3508144770 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4007480 con 0x7f3508144770 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35080ac700 con 0x7f3508144770 2024-09-13T17:24:30.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.792+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35080ce5f0 con 0x7f3508144770 2024-09-13T17:24:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.796+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34f40075e0 con 0x7f3508144770 2024-09-13T17:24:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.796+0000 7f34fea00700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34e8066730 0x7f34e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.796+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34f4083890 con 0x7f3508144770 2024-09-13T17:24:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.796+0000 7f3506800700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34e8066730 0x7f34e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.796+0000 7f3506800700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34e8066730 0x7f34e8068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34f80090b0 tx=0x7f34f8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.808+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34f4050900 con 0x7f3508144770 2024-09-13T17:24:30.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.996+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35080675e0 con 0x7f3508144770 2024-09-13T17:24:30.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:30.996+0000 7f34fea00700 1 -- 172.21.15.139:0/2782783792 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34f4053f20 con 0x7f3508144770 2024-09-13T17:24:30.998 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:24:31.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34e8066730 msgr2=0x7f34e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34e8066730 0x7f34e8068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34f80090b0 tx=0x7f34f8008030 comp rx=0 tx=0).stop 2024-09-13T17:24:31.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 msgr2=0x7f350815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 0x7f350815a8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f34f4005930 tx=0x7f34f400c9e0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 shutdown_connections 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34e8066730 0x7f34e8068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f350815b1c0 0x7f35080a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3508144770 0x7f350815a8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 --2- 172.21.15.139:0/2782783792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f350806d9b0 0x7f35080ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 >> 172.21.15.139:0/2782783792 conn(0x7f350806b1e0 msgr2=0x7f35080ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 shutdown_connections 2024-09-13T17:24:31.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.000+0000 7f350d400700 1 -- 172.21.15.139:0/2782783792 wait complete. 2024-09-13T17:24:31.022 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:31.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.192+0000 7f3fb7e00700 1 Processor -- start 2024-09-13T17:24:31.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.192+0000 7f3fb7e00700 1 -- start start 2024-09-13T17:24:31.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3fb8146690 0x7f3fb80d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3fb815e030 0x7f3fb80d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb80b1740 con 0x7f3fb80d1570 2024-09-13T17:24:31.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb80d08c0 con 0x7f3fb815e030 2024-09-13T17:24:31.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb80d1990 con 0x7f3fb8146690 2024-09-13T17:24:31.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3fb80d1570 0x7f3fb80ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49928/0 (socket says 172.21.15.139:49928) 2024-09-13T17:24:31.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb7400700 1 -- 172.21.15.139:0/3952729105 learned_addr learned my addr 172.21.15.139:0/3952729105 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:31.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb6000700 1 --2- 172.21.15.139:0/3952729105 >> v2:172.21.15.139:3300/0 conn(0x7f3fb815e030 0x7f3fb80d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb6a00700 1 --2- 172.21.15.139:0/3952729105 >> v2:172.21.15.176:3300/0 conn(0x7f3fb8146690 0x7f3fb80d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb5600700 1 -- 172.21.15.139:0/3952729105 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628925640 0 0) 0x7f3fb80b1740 con 0x7f3fb80d1570 2024-09-13T17:24:31.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.196+0000 7f3fb5600700 1 -- 172.21.15.139:0/3952729105 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f9c0035d0 con 0x7f3fb80d1570 2024-09-13T17:24:31.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb6000700 1 -- 172.21.15.139:0/3952729105 >> v2:172.21.15.176:3300/0 conn(0x7f3fb8146690 msgr2=0x7f3fb80d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:31.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb6000700 1 --2- 172.21.15.139:0/3952729105 >> v2:172.21.15.176:3300/0 conn(0x7f3fb8146690 0x7f3fb80d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb6000700 1 -- 172.21.15.139:0/3952729105 >> v1:172.21.15.139:6789/0 conn(0x7f3fb80d1570 legacy=0x7f3fb80ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb6000700 1 -- 172.21.15.139:0/3952729105 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb815e4c0 con 0x7f3fb815e030 2024-09-13T17:24:31.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb6000700 1 --2- 172.21.15.139:0/3952729105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb815e030 0x7f3fb80d1030 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8146d80 tx=0x7f3fa4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66ac4a97d82f183 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:31.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb5600700 1 -- 172.21.15.139:0/3952729105 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011830 con 0x7f3fb815e030 2024-09-13T17:24:31.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb5600700 1 -- 172.21.15.139:0/3952729105 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4011990 con 0x7f3fb815e030 2024-09-13T17:24:31.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb5600700 1 -- 172.21.15.139:0/3952729105 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011d00 con 0x7f3fb815e030 2024-09-13T17:24:31.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 -- 172.21.15.139:0/3952729105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb815e030 msgr2=0x7f3fb80d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/3952729105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb815e030 0x7f3fb80d1030 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8146d80 tx=0x7f3fa4009b30 comp rx=0 tx=0).stop 2024-09-13T17:24:31.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 -- 172.21.15.139:0/3952729105 shutdown_connections 2024-09-13T17:24:31.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/3952729105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb815e030 0x7f3fb80d1030 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/3952729105 >> v2:172.21.15.176:3300/0 conn(0x7f3fb8146690 0x7f3fb80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 -- 172.21.15.139:0/3952729105 >> 172.21.15.139:0/3952729105 conn(0x7f3fb8071fa0 msgr2=0x7f3fb8072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:31.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 -- 172.21.15.139:0/3952729105 shutdown_connections 2024-09-13T17:24:31.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.200+0000 7f3fb7e00700 1 -- 172.21.15.139:0/3952729105 wait complete. 2024-09-13T17:24:31.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.204+0000 7f3fb7e00700 1 Processor -- start 2024-09-13T17:24:31.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.204+0000 7f3fb7e00700 1 -- start start 2024-09-13T17:24:31.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.204+0000 7f3fb7e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fb80d1570 0x7f3fb80c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.204+0000 7f3fb7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 0x7f3fb815a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.204+0000 7f3fb7e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fb815e030 0x7f3fb80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb7e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb815ae40 con 0x7f3fb8146690 2024-09-13T17:24:31.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb7e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb81345c0 con 0x7f3fb80d1570 2024-09-13T17:24:31.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb7e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb81348a0 con 0x7f3fb815e030 2024-09-13T17:24:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 0x7f3fb815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 0x7f3fb815a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41586/0 (socket says 172.21.15.139:41586) 2024-09-13T17:24:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 -- 172.21.15.139:0/1955904560 learned_addr learned my addr 172.21.15.139:0/1955904560 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb7400700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fb815e030 0x7f3fb80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6a00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fb80d1570 0x7f3fb80c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 -- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fb815e030 msgr2=0x7f3fb80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fb815e030 0x7f3fb80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 -- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fb80d1570 msgr2=0x7f3fb80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fb80d1570 0x7f3fb80c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 -- 172.21.15.139:0/1955904560 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40094b0 con 0x7f3fb8146690 2024-09-13T17:24:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb6000700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 0x7f3fb815a900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4014040 tx=0x7f3fa4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:31.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4004510 con 0x7f3fb8146690 2024-09-13T17:24:31.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8134b80 con 0x7f3fb8146690 2024-09-13T17:24:31.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa401e070 con 0x7f3fb8146690 2024-09-13T17:24:31.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40038c0 con 0x7f3fb8146690 2024-09-13T17:24:31.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.208+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb8135140 con 0x7f3fb8146690 2024-09-13T17:24:31.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.212+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3fa4003a20 con 0x7f3fb8146690 2024-09-13T17:24:31.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.212+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb80677e0 con 0x7f3fb8146690 2024-09-13T17:24:31.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.212+0000 7f3faea00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3f98066730 0x7f3f98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.212+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fa40851d0 con 0x7f3fb8146690 2024-09-13T17:24:31.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.212+0000 7f3fb6a00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3f98066730 0x7f3f98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.212+0000 7f3fb6a00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3f98066730 0x7f3f98068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009bf0 tx=0x7f3fa8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:31.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.220+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3fa40521c0 con 0x7f3fb8146690 2024-09-13T17:24:31.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.396+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fb81352d0 con 0x7f3fb8146690 2024-09-13T17:24:31.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3faea00700 1 -- 172.21.15.139:0/1955904560 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3fa40557e0 con 0x7f3fb8146690 2024-09-13T17:24:31.402 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3f98066730 msgr2=0x7f3f98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3f98066730 0x7f3f98068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009bf0 tx=0x7f3fa8009240 comp rx=0 tx=0).stop 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 msgr2=0x7f3fb815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 0x7f3fb815a900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4014040 tx=0x7f3fa4004770 comp rx=0 tx=0).stop 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 shutdown_connections 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3f98066730 0x7f3f98068bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fb815e030 0x7f3fb80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb8146690 0x7f3fb815a900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 --2- 172.21.15.139:0/1955904560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fb80d1570 0x7f3fb80c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 >> 172.21.15.139:0/1955904560 conn(0x7f3fb8071fa0 msgr2=0x7f3fb80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 shutdown_connections 2024-09-13T17:24:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.400+0000 7f3fb7e00700 1 -- 172.21.15.139:0/1955904560 wait complete. 2024-09-13T17:24:31.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:24:31.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.608+0000 7fe8db400700 1 Processor -- start 2024-09-13T17:24:31.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.608+0000 7fe8db400700 1 -- start start 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8db400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe8d406b140 0x7fe8d406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8db400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8d40c8ed0 0x7fe8d40c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8db400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40c9820 con 0x7fe8d4146b40 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8db400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d406c260 con 0x7fe8d406b140 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8db400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d406b5e0 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe8d406b140 0x7fe8d406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe8d406b140 0x7fe8d406c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41598/0 (socket says 172.21.15.139:41598) 2024-09-13T17:24:31.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 -- 172.21.15.139:0/2685633636 learned_addr learned my addr 172.21.15.139:0/2685633636 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:31.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d9400700 1 --2- 172.21.15.139:0/2685633636 >> v2:172.21.15.176:3300/0 conn(0x7fe8d40c8ed0 0x7fe8d40c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 -- 172.21.15.139:0/2685633636 >> v2:172.21.15.176:3300/0 conn(0x7fe8d40c8ed0 msgr2=0x7fe8d40c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:31.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 --2- 172.21.15.139:0/2685633636 >> v2:172.21.15.176:3300/0 conn(0x7fe8d40c8ed0 0x7fe8d40c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 -- 172.21.15.139:0/2685633636 >> v1:172.21.15.176:6789/0 conn(0x7fe8d4146b40 legacy=0x7fe8d4161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 -- 172.21.15.139:0/2685633636 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d406b8c0 con 0x7fe8d406b140 2024-09-13T17:24:31.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3e00700 1 --2- 172.21.15.139:0/2685633636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d406b140 0x7fe8d406c680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4160aa0 tx=0x7fe8c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7fc5882905bbef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:31.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3400700 1 -- 172.21.15.139:0/2685633636 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000b8a0 con 0x7fe8d406b140 2024-09-13T17:24:31.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3400700 1 -- 172.21.15.139:0/2685633636 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000ba00 con 0x7fe8d406b140 2024-09-13T17:24:31.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.612+0000 7fe8d3400700 1 -- 172.21.15.139:0/2685633636 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000bd90 con 0x7fe8d406b140 2024-09-13T17:24:31.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 -- 172.21.15.139:0/2685633636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d406b140 msgr2=0x7fe8d406c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 --2- 172.21.15.139:0/2685633636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d406b140 0x7fe8d406c680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4160aa0 tx=0x7fe8c0009bf0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 -- 172.21.15.139:0/2685633636 shutdown_connections 2024-09-13T17:24:31.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 --2- 172.21.15.139:0/2685633636 >> v2:172.21.15.176:3300/0 conn(0x7fe8d40c8ed0 0x7fe8d40c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 --2- 172.21.15.139:0/2685633636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d406b140 0x7fe8d406c680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 -- 172.21.15.139:0/2685633636 >> 172.21.15.139:0/2685633636 conn(0x7fe8d40cfa80 msgr2=0x7fe8d40cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:31.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 -- 172.21.15.139:0/2685633636 shutdown_connections 2024-09-13T17:24:31.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 -- 172.21.15.139:0/2685633636 wait complete. 2024-09-13T17:24:31.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 Processor -- start 2024-09-13T17:24:31.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.616+0000 7fe8db400700 1 -- start start 2024-09-13T17:24:31.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8d406b140 0x7fe8d41f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 0x7fe8d40b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8d4146b40 0x7fe8d413f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41405d0 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41407e0 con 0x7fe8d4146b40 2024-09-13T17:24:31.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4140ac0 con 0x7fe8d406b140 2024-09-13T17:24:31.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 0x7fe8d40b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 0x7fe8d40b8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41610/0 (socket says 172.21.15.139:41610) 2024-09-13T17:24:31.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 -- 172.21.15.139:0/3255456467 learned_addr learned my addr 172.21.15.139:0/3255456467 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:31.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d8a00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8d406b140 0x7fe8d41f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d9400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8d4146b40 0x7fe8d413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 -- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8d406b140 msgr2=0x7fe8d41f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8d406b140 0x7fe8d41f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 -- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8d4146b40 msgr2=0x7fe8d413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8d4146b40 0x7fe8d413f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 -- 172.21.15.139:0/3255456467 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0009570 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d9400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8d4146b40 0x7fe8d413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d3e00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 0x7fe8d40b8390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0000c00 tx=0x7fe8c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0003ad0 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c001e070 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d4140da0 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0003e90 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.620+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d4141360 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.624+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d41f3990 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.624+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8c0025480 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.624+0000 7fe8d0c00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe8b4066730 0x7fe8b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:31.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.624+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8c0020070 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.624+0000 7fe8d8a00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe8b4066730 0x7fe8b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:31.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.628+0000 7fe8d8a00700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe8b4066730 0x7fe8b4068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4141730 tx=0x7fe8c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:31.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.632+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8c0052c40 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.836+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8d40c92e0 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.836+0000 7fe8d0c00700 1 -- 172.21.15.139:0/3255456467 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8c0056260 con 0x7fe8d40c8ed0 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe8b4066730 msgr2=0x7fe8b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe8b4066730 0x7fe8b4068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4141730 tx=0x7fe8c8009040 comp rx=0 tx=0).stop 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 msgr2=0x7fe8d40b8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 0x7fe8d40b8390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0000c00 tx=0x7fe8c0004770 comp rx=0 tx=0).stop 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 shutdown_connections 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe8b4066730 0x7fe8b4068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8d4146b40 0x7fe8d413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8d40c8ed0 0x7fe8d40b8390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 --2- 172.21.15.139:0/3255456467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8d406b140 0x7fe8d41f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:31.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.840+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 >> 172.21.15.139:0/3255456467 conn(0x7fe8d40cfa80 msgr2=0x7fe8d406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:31.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.844+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 shutdown_connections 2024-09-13T17:24:31.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:31.844+0000 7fe8db400700 1 -- 172.21.15.139:0/3255456467 wait complete. 2024-09-13T17:24:31.847 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-09-13T17:24:31.865 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2024-09-13T17:24:31.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:31.866 DEBUG:teuthology.orchestra.run.smithi139:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:24:31.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[32465]: fuse finished with error 0 and tester_r 0 2024-09-13T17:24:31.911 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:24:38.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:24:38.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:38.013 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T17:24:38.049 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:38.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.256+0000 7f1d9ae00700 1 Processor -- start 2024-09-13T17:24:38.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.256+0000 7f1d9ae00700 1 -- start start 2024-09-13T17:24:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d9ae00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1d9415aff0 0x7f1d940cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d9ae00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d94070140 con 0x7f1d94144300 2024-09-13T17:24:38.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d9ae00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d94070420 con 0x7f1d940cdc00 2024-09-13T17:24:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d9ae00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940ce0b0 con 0x7f1d9415aff0 2024-09-13T17:24:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d99a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1d94144300 0x7f1d9406d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47404/0 (socket says 172.21.15.139:47404) 2024-09-13T17:24:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d99a00700 1 -- 172.21.15.139:0/3915291006 learned_addr learned my addr 172.21.15.139:0/3915291006 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:38.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d99000700 1 --2- 172.21.15.139:0/3915291006 >> v2:172.21.15.176:3300/0 conn(0x7f1d9415aff0 0x7f1d940cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d93e00700 1 -- 172.21.15.139:0/3915291006 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550673986 0 0) 0x7f1d94070140 con 0x7f1d94144300 2024-09-13T17:24:38.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.260+0000 7f1d93e00700 1 -- 172.21.15.139:0/3915291006 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d7c0035d0 con 0x7f1d94144300 2024-09-13T17:24:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d93e00700 1 -- 172.21.15.139:0/3915291006 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003461889 0 0) 0x7f1d7c0035d0 con 0x7f1d94144300 2024-09-13T17:24:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d99000700 1 -- 172.21.15.139:0/3915291006 >> v1:172.21.15.176:6789/0 conn(0x7f1d940cdc00 legacy=0x7f1d940711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d99000700 1 -- 172.21.15.139:0/3915291006 >> v1:172.21.15.139:6789/0 conn(0x7f1d94144300 legacy=0x7f1d9406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d99000700 1 -- 172.21.15.139:0/3915291006 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94070700 con 0x7f1d9415aff0 2024-09-13T17:24:38.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d99000700 1 --2- 172.21.15.139:0/3915291006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d940cd6c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009880 tx=0x7f1d80009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23c21da02b46183a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d93e00700 1 -- 172.21.15.139:0/3915291006 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88001670 con 0x7f1d9415aff0 2024-09-13T17:24:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d93e00700 1 -- 172.21.15.139:0/3915291006 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80010590 con 0x7f1d9415aff0 2024-09-13T17:24:38.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d93e00700 1 -- 172.21.15.139:0/3915291006 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80010940 con 0x7f1d9415aff0 2024-09-13T17:24:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 -- 172.21.15.139:0/3915291006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 msgr2=0x7f1d940cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/3915291006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d940cd6c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009880 tx=0x7f1d80009b90 comp rx=0 tx=0).stop 2024-09-13T17:24:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 -- 172.21.15.139:0/3915291006 shutdown_connections 2024-09-13T17:24:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/3915291006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d940cd6c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 -- 172.21.15.139:0/3915291006 >> 172.21.15.139:0/3915291006 conn(0x7f1d940ce9d0 msgr2=0x7f1d940cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 -- 172.21.15.139:0/3915291006 shutdown_connections 2024-09-13T17:24:38.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.264+0000 7f1d9ae00700 1 -- 172.21.15.139:0/3915291006 wait complete. 2024-09-13T17:24:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 Processor -- start 2024-09-13T17:24:38.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 -- start start 2024-09-13T17:24:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d940cdc00 0x7f1d941e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 0x7f1d941f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d9413ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9413d0a0 con 0x7f1d94144300 2024-09-13T17:24:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9413d380 con 0x7f1d9415aff0 2024-09-13T17:24:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9ae00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9413d660 con 0x7f1d940cdc00 2024-09-13T17:24:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 0x7f1d941f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 0x7f1d941f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37074/0 (socket says 172.21.15.139:37074) 2024-09-13T17:24:38.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 -- 172.21.15.139:0/1689443682 learned_addr learned my addr 172.21.15.139:0/1689443682 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:38.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d9a400700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d9413ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99a00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d940cdc00 0x7f1d941e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 -- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d940cdc00 msgr2=0x7f1d941e0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d940cdc00 0x7f1d941e0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 -- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 msgr2=0x7f1d9413ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d9413ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.268+0000 7f1d99000700 1 -- 172.21.15.139:0/1689443682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800094b0 con 0x7f1d94144300 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d99000700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 0x7f1d941f2420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d80012000 tx=0x7f1d80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004610 con 0x7f1d94144300 2024-09-13T17:24:38.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800036c0 con 0x7f1d94144300 2024-09-13T17:24:38.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9413d940 con 0x7f1d94144300 2024-09-13T17:24:38.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80003a50 con 0x7f1d94144300 2024-09-13T17:24:38.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9413f080 con 0x7f1d94144300 2024-09-13T17:24:38.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d941446e0 con 0x7f1d94144300 2024-09-13T17:24:38.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.272+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d80003bb0 con 0x7f1d94144300 2024-09-13T17:24:38.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.276+0000 7f1d91600700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d74066730 0x7f1d74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.276+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d80085700 con 0x7f1d94144300 2024-09-13T17:24:38.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.276+0000 7f1d99a00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d74066730 0x7f1d74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.276+0000 7f1d99a00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d74066730 0x7f1d74068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d88001eb0 tx=0x7f1d88001d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:38.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.280+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d80052770 con 0x7f1d94144300 2024-09-13T17:24:38.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.468+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d9413d1e0 con 0x7f1d94144300 2024-09-13T17:24:38.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.472+0000 7f1d91600700 1 -- 172.21.15.139:0/1689443682 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f1d9413d1e0 con 0x7f1d94144300 2024-09-13T17:24:38.475 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:38.475 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:38.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d74066730 msgr2=0x7f1d74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d74066730 0x7f1d74068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d88001eb0 tx=0x7f1d88001d00 comp rx=0 tx=0).stop 2024-09-13T17:24:38.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 msgr2=0x7f1d941f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 0x7f1d941f2420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d80012000 tx=0x7f1d80004770 comp rx=0 tx=0).stop 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 shutdown_connections 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d74066730 0x7f1d74068bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d9415aff0 0x7f1d9413ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d94144300 0x7f1d941f2420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 --2- 172.21.15.139:0/1689443682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d940cdc00 0x7f1d941e0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 >> 172.21.15.139:0/1689443682 conn(0x7f1d940ce9d0 msgr2=0x7f1d940711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 shutdown_connections 2024-09-13T17:24:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.476+0000 7f1d9ae00700 1 -- 172.21.15.139:0/1689443682 wait complete. 2024-09-13T17:24:38.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.660+0000 7f5b8aa00700 1 Processor -- start 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.660+0000 7f5b8aa00700 1 -- start start 2024-09-13T17:24:38.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8aa00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b84158570 0x7f5b840701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8aa00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b840706e0 0x7f5b8415e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8aa00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5b8415e960 0x7f5b8415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8aa00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b840cf460 con 0x7f5b8415e960 2024-09-13T17:24:38.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8aa00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8415edf0 con 0x7f5b840706e0 2024-09-13T17:24:38.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8aa00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8406ee00 con 0x7f5b84158570 2024-09-13T17:24:38.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5b8415e960 0x7f5b8415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b88c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b840706e0 0x7f5b8415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b89600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b84158570 0x7f5b840701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5b8415e960 0x7f5b8415aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37080/0 (socket says 172.21.15.139:37080) 2024-09-13T17:24:38.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 -- 172.21.15.139:0/2710867266 learned_addr learned my addr 172.21.15.139:0/2710867266 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:38.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 -- 172.21.15.139:0/2710867266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b84158570 msgr2=0x7f5b840701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:38.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 --2- 172.21.15.139:0/2710867266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b84158570 0x7f5b840701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 -- 172.21.15.139:0/2710867266 >> v2:172.21.15.176:3300/0 conn(0x7f5b840706e0 msgr2=0x7f5b8415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:38.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 --2- 172.21.15.139:0/2710867266 >> v2:172.21.15.176:3300/0 conn(0x7f5b840706e0 0x7f5b8415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 -- 172.21.15.139:0/2710867266 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b840cee50 con 0x7f5b8415e960 2024-09-13T17:24:38.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b88c00700 1 --2- 172.21.15.139:0/2710867266 >> v2:172.21.15.176:3300/0 conn(0x7f5b840706e0 0x7f5b8415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:38.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.664+0000 7f5b8a000700 1 --2- 172.21.15.139:0/2710867266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b8415e960 0x7f5b8415aea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5b840b59d0 tx=0x7f5b7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e97e22730a30df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:38.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b83e00700 1 -- 172.21.15.139:0/2710867266 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00e070 con 0x7f5b8415e960 2024-09-13T17:24:38.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b83e00700 1 -- 172.21.15.139:0/2710867266 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00b910 con 0x7f5b8415e960 2024-09-13T17:24:38.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b83e00700 1 -- 172.21.15.139:0/2710867266 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00bcc0 con 0x7f5b8415e960 2024-09-13T17:24:38.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 -- 172.21.15.139:0/2710867266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b8415e960 msgr2=0x7f5b8415aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/2710867266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b8415e960 0x7f5b8415aea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5b840b59d0 tx=0x7f5b7c00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:38.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 -- 172.21.15.139:0/2710867266 shutdown_connections 2024-09-13T17:24:38.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/2710867266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b8415e960 0x7f5b8415aea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/2710867266 >> v2:172.21.15.176:3300/0 conn(0x7f5b840706e0 0x7f5b8415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/2710867266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b84158570 0x7f5b840701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 -- 172.21.15.139:0/2710867266 >> 172.21.15.139:0/2710867266 conn(0x7f5b84071f50 msgr2=0x7f5b84072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:38.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 -- 172.21.15.139:0/2710867266 shutdown_connections 2024-09-13T17:24:38.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.668+0000 7f5b8aa00700 1 -- 172.21.15.139:0/2710867266 wait complete. 2024-09-13T17:24:38.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 Processor -- start 2024-09-13T17:24:38.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 -- start start 2024-09-13T17:24:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b840706e0 0x7f5b8406c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 0x7f5b84157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8415e960 0x7f5b8414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84157570 con 0x7f5b84158570 2024-09-13T17:24:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8406d6a0 con 0x7f5b840706e0 2024-09-13T17:24:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b8aa00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8406ce00 con 0x7f5b8415e960 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.672+0000 7f5b88c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 0x7f5b84157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 0x7f5b84157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37090/0 (socket says 172.21.15.139:37090) 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 -- 172.21.15.139:0/3001850624 learned_addr learned my addr 172.21.15.139:0/3001850624 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b89600700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b840706e0 0x7f5b8406c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b8a000700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8415e960 0x7f5b8414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 -- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8415e960 msgr2=0x7f5b8414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8415e960 0x7f5b8414c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 -- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b840706e0 msgr2=0x7f5b8406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b840706e0 0x7f5b8406c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 -- 172.21.15.139:0/3001850624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700094b0 con 0x7f5b84158570 2024-09-13T17:24:38.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b88c00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 0x7f5b84157030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000ea00 tx=0x7f5b7000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:38.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000eea0 con 0x7f5b84158570 2024-09-13T17:24:38.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000c850 con 0x7f5b84158570 2024-09-13T17:24:38.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000cbe0 con 0x7f5b84158570 2024-09-13T17:24:38.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c009b30 con 0x7f5b84158570 2024-09-13T17:24:38.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.676+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8406d3c0 con 0x7f5b84158570 2024-09-13T17:24:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.680+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b840cf080 con 0x7f5b84158570 2024-09-13T17:24:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.680+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b7000cd40 con 0x7f5b84158570 2024-09-13T17:24:38.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.680+0000 7f5b81600700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b64066730 0x7f5b64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:38.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.680+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b700844f0 con 0x7f5b84158570 2024-09-13T17:24:38.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.684+0000 7f5b89600700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b64066730 0x7f5b64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:38.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.684+0000 7f5b89600700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b64066730 0x7f5b64068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009bf0 tx=0x7f5b78009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:38.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.688+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b700514d0 con 0x7f5b84158570 2024-09-13T17:24:38.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.876+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b84158d60 con 0x7f5b84158570 2024-09-13T17:24:38.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b81600700 1 -- 172.21.15.139:0/3001850624 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f5b70054af0 con 0x7f5b84158570 2024-09-13T17:24:38.881 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:38.881 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:38.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b64066730 msgr2=0x7f5b64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b64066730 0x7f5b64068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009bf0 tx=0x7f5b78009240 comp rx=0 tx=0).stop 2024-09-13T17:24:38.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 msgr2=0x7f5b84157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:38.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 0x7f5b84157030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000ea00 tx=0x7f5b7000ed10 comp rx=0 tx=0).stop 2024-09-13T17:24:38.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 shutdown_connections 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b64066730 0x7f5b64068bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8415e960 0x7f5b8414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b84158570 0x7f5b84157030 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 --2- 172.21.15.139:0/3001850624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b840706e0 0x7f5b8406c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 >> 172.21.15.139:0/3001850624 conn(0x7f5b84071f50 msgr2=0x7f5b840b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 shutdown_connections 2024-09-13T17:24:38.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:38.880+0000 7f5b8aa00700 1 -- 172.21.15.139:0/3001850624 wait complete. 2024-09-13T17:24:38.907 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:24:39.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.088+0000 7eff1e200700 1 Processor -- start 2024-09-13T17:24:39.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.088+0000 7eff1e200700 1 -- start start 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1e200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7eff180b3280 0x7eff180ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1e200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff180cd160 con 0x7eff1806fe10 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1e200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff180aceb0 con 0x7eff1815cc00 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1e200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180ad190 con 0x7eff180b3280 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7eff180b3280 0x7eff180ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7eff180b3280 0x7eff180ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37092/0 (socket says 172.21.15.139:37092) 2024-09-13T17:24:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 -- 172.21.15.139:0/2661360114 learned_addr learned my addr 172.21.15.139:0/2661360114 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 -- 172.21.15.139:0/2661360114 >> v1:172.21.15.176:6789/0 conn(0x7eff1815cc00 legacy=0x7eff180adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 -- 172.21.15.139:0/2661360114 >> v1:172.21.15.139:6789/0 conn(0x7eff1806fe10 legacy=0x7eff180b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 -- 172.21.15.139:0/2661360114 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180ad470 con 0x7eff180b3280 2024-09-13T17:24:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff1d800700 1 --2- 172.21.15.139:0/2661360114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff180b3280 0x7eff180ac890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff10009e50 tx=0x7eff1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1623d51d3c6a0b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff17400700 1 -- 172.21.15.139:0/2661360114 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000e070 con 0x7eff180b3280 2024-09-13T17:24:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff17400700 1 -- 172.21.15.139:0/2661360114 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000b9c0 con 0x7eff180b3280 2024-09-13T17:24:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.092+0000 7eff17400700 1 -- 172.21.15.139:0/2661360114 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000bd70 con 0x7eff180b3280 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 -- 172.21.15.139:0/2661360114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff180b3280 msgr2=0x7eff180ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 --2- 172.21.15.139:0/2661360114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff180b3280 0x7eff180ac890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff10009e50 tx=0x7eff1000b330 comp rx=0 tx=0).stop 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 -- 172.21.15.139:0/2661360114 shutdown_connections 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 --2- 172.21.15.139:0/2661360114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff180b3280 0x7eff180ac890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 -- 172.21.15.139:0/2661360114 >> 172.21.15.139:0/2661360114 conn(0x7eff180ce9d0 msgr2=0x7eff180cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 -- 172.21.15.139:0/2661360114 shutdown_connections 2024-09-13T17:24:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 -- 172.21.15.139:0/2661360114 wait complete. 2024-09-13T17:24:39.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 Processor -- start 2024-09-13T17:24:39.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.096+0000 7eff1e200700 1 -- start start 2024-09-13T17:24:39.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 0x7eff18156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff180b3280 0x7eff180ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1815cc00 0x7eff1814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1806bd60 con 0x7eff1806fe10 2024-09-13T17:24:39.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1806c040 con 0x7eff180b3280 2024-09-13T17:24:39.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1806c320 con 0x7eff1815cc00 2024-09-13T17:24:39.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 0x7eff18156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 0x7eff18156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37102/0 (socket says 172.21.15.139:37102) 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 -- 172.21.15.139:0/3657609579 learned_addr learned my addr 172.21.15.139:0/3657609579 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 -- 172.21.15.139:0/3657609579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1815cc00 msgr2=0x7eff1814f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1815cc00 0x7eff1814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 -- 172.21.15.139:0/3657609579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff180b3280 msgr2=0x7eff180ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff180b3280 0x7eff180ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 -- 172.21.15.139:0/3657609579 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009b30 con 0x7eff1806fe10 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1ce00700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 0x7eff18156d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c500 tx=0x7eff0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0052d0 con 0x7eff1806fe10 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c005430 con 0x7eff1806fe10 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0055a0 con 0x7eff1806fe10 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1806c600 con 0x7eff1806fe10 2024-09-13T17:24:39.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff181572d0 con 0x7eff1806fe10 2024-09-13T17:24:39.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.100+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff180ac890 con 0x7eff1806fe10 2024-09-13T17:24:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.104+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff0c0038e0 con 0x7eff1806fe10 2024-09-13T17:24:39.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.104+0000 7eff14c00700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efef8066760 0x7efef8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.104+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff0c083a00 con 0x7eff1806fe10 2024-09-13T17:24:39.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.104+0000 7eff17e00700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efef8066760 0x7efef8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.108+0000 7eff17e00700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efef8066760 0x7efef8068c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f60 tx=0x7eff04007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:39.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.112+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff0c050950 con 0x7eff1806fe10 2024-09-13T17:24:39.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.328+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff180b28b0 con 0x7eff1806fe10 2024-09-13T17:24:39.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.559+0000 7eff14c00700 1 -- 172.21.15.139:0/3657609579 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff0c0170b0 con 0x7eff1806fe10 2024-09-13T17:24:39.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efef8066760 msgr2=0x7efef8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efef8066760 0x7efef8068c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f60 tx=0x7eff04007a60 comp rx=0 tx=0).stop 2024-09-13T17:24:39.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 msgr2=0x7eff18156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 0x7eff18156d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c500 tx=0x7eff0c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 shutdown_connections 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efef8066760 0x7efef8068c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1815cc00 0x7eff1814f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff180b3280 0x7eff180ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 --2- 172.21.15.139:0/3657609579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff1806fe10 0x7eff18156d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 >> 172.21.15.139:0/3657609579 conn(0x7eff180ce9d0 msgr2=0x7eff1815f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:39.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 shutdown_connections 2024-09-13T17:24:39.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.563+0000 7eff1e200700 1 -- 172.21.15.139:0/3657609579 wait complete. 2024-09-13T17:24:39.591 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T17:24:39.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:24:39.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.759+0000 7f1332200700 1 Processor -- start 2024-09-13T17:24:39.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.759+0000 7f1332200700 1 -- start start 2024-09-13T17:24:39.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1332200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f132c06bfb0 0x7f132c167870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1332200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c0b2130 con 0x7f132c0b1cf0 2024-09-13T17:24:39.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1332200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c0ccf00 con 0x7f132c15ce30 2024-09-13T17:24:39.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1332200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c06a4c0 con 0x7f132c06bfb0 2024-09-13T17:24:39.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1323e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f132c0b1cf0 0x7f132c0ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47416/0 (socket says 172.21.15.139:47416) 2024-09-13T17:24:39.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1323e00700 1 -- 172.21.15.139:0/3484084222 learned_addr learned my addr 172.21.15.139:0/3484084222 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:39.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1331800700 1 --2- 172.21.15.139:0/3484084222 >> v2:172.21.15.139:3300/0 conn(0x7f132c06bfb0 0x7f132c167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60598797 0 0) 0x7f132c0b2130 con 0x7f132c0b1cf0 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13100035d0 con 0x7f132c0b1cf0 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051853520 0 0) 0x7f132c0ccf00 con 0x7f132c15ce30 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f132c0b2130 con 0x7f132c15ce30 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1331800700 1 -- 172.21.15.139:0/3484084222 >> v1:172.21.15.176:6789/0 conn(0x7f132c15ce30 legacy=0x7f132c0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1331800700 1 -- 172.21.15.139:0/3484084222 >> v1:172.21.15.139:6789/0 conn(0x7f132c0b1cf0 legacy=0x7f132c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.763+0000 7f1331800700 1 -- 172.21.15.139:0/3484084222 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c06a7a0 con 0x7f132c06bfb0 2024-09-13T17:24:39.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1331800700 1 --2- 172.21.15.139:0/3484084222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c167870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1324009d90 tx=0x7f132400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1b71639ef8152a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:39.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400e070 con 0x7f132c06bfb0 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132400bb20 con 0x7f132c06bfb0 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f132be00700 1 -- 172.21.15.139:0/3484084222 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324012430 con 0x7f132c06bfb0 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 -- 172.21.15.139:0/3484084222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 msgr2=0x7f132c167870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 --2- 172.21.15.139:0/3484084222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c167870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1324009d90 tx=0x7f132400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 -- 172.21.15.139:0/3484084222 shutdown_connections 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 --2- 172.21.15.139:0/3484084222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c167870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 -- 172.21.15.139:0/3484084222 >> 172.21.15.139:0/3484084222 conn(0x7f132c06de90 msgr2=0x7f132c06e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 -- 172.21.15.139:0/3484084222 shutdown_connections 2024-09-13T17:24:39.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.767+0000 7f1332200700 1 -- 172.21.15.139:0/3484084222 wait complete. 2024-09-13T17:24:39.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 Processor -- start 2024-09-13T17:24:39.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 -- start start 2024-09-13T17:24:39.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f132c0b1cf0 0x7f132c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f132c15ce30 0x7f132c0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c156bf0 con 0x7f132c06bfb0 2024-09-13T17:24:39.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c154ab0 con 0x7f132c0b1cf0 2024-09-13T17:24:39.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1332200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0b4c70 con 0x7f132c15ce30 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37128/0 (socket says 172.21.15.139:37128) 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 -- 172.21.15.139:0/1781776685 learned_addr learned my addr 172.21.15.139:0/1781776685 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1323e00700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f132c0b1cf0 0x7f132c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1331800700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f132c15ce30 0x7f132c0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 -- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f132c15ce30 msgr2=0x7f132c0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f132c15ce30 0x7f132c0b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 -- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f132c0b1cf0 msgr2=0x7f132c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f132c0b1cf0 0x7f132c155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 -- 172.21.15.139:0/1781776685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324009a70 con 0x7f132c06bfb0 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1331800700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f132c15ce30 0x7f132c0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1330e00700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c149c90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c490 tx=0x7f131c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.771+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0052d0 con 0x7f132c06bfb0 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.775+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c005450 con 0x7f132c06bfb0 2024-09-13T17:24:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.775+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c0b4f50 con 0x7f132c06bfb0 2024-09-13T17:24:39.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.775+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0038e0 con 0x7f132c06bfb0 2024-09-13T17:24:39.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.775+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c154d70 con 0x7f132c06bfb0 2024-09-13T17:24:39.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.775+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c0b5470 con 0x7f132c06bfb0 2024-09-13T17:24:39.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.775+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f131c003a40 con 0x7f132c06bfb0 2024-09-13T17:24:39.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.779+0000 7f1329600700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1308066730 0x7f1308068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:39.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.779+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f131c0838b0 con 0x7f132c06bfb0 2024-09-13T17:24:39.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.779+0000 7f1323e00700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1308066730 0x7f1308068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:39.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.779+0000 7f1323e00700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1308066730 0x7f1308068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f132c1f5f90 tx=0x7f1314007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:39.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:39.783+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f131c050920 con 0x7f132c06bfb0 2024-09-13T17:24:40.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.011+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f132c0ccf00 con 0x7f132c06bfb0 2024-09-13T17:24:40.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.571+0000 7f1329600700 1 -- 172.21.15.139:0/1781776685 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f131c053f40 con 0x7f132c06bfb0 2024-09-13T17:24:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1308066730 msgr2=0x7f1308068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1308066730 0x7f1308068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f132c1f5f90 tx=0x7f1314007c90 comp rx=0 tx=0).stop 2024-09-13T17:24:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 msgr2=0x7f132c149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c149c90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c490 tx=0x7f131c00c7a0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 shutdown_connections 2024-09-13T17:24:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1308066730 0x7f1308068bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f132c15ce30 0x7f132c0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f132c0b1cf0 0x7f132c155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 --2- 172.21.15.139:0/1781776685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132c06bfb0 0x7f132c149c90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 >> 172.21.15.139:0/1781776685 conn(0x7f132c06de90 msgr2=0x7f132c157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 shutdown_connections 2024-09-13T17:24:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.575+0000 7f1332200700 1 -- 172.21.15.139:0/1781776685 wait complete. 2024-09-13T17:24:40.604 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:24:40.604 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:40.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 Processor -- start 2024-09-13T17:24:40.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 -- start start 2024-09-13T17:24:40.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2058144300 0x7f205806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:40.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20580cddd0 0x7f20580711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:40.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2058070140 con 0x7f205815aff0 2024-09-13T17:24:40.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2058070420 con 0x7f20580cddd0 2024-09-13T17:24:40.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205ea00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2058070700 con 0x7f2058144300 2024-09-13T17:24:40.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20580cddd0 0x7f20580711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:40.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20580cddd0 0x7f20580711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37134/0 (socket says 172.21.15.139:37134) 2024-09-13T17:24:40.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205e000700 1 -- 172.21.15.139:0/3995252045 learned_addr learned my addr 172.21.15.139:0/3995252045 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:40.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.763+0000 7f205cc00700 1 --1- 172.21.15.139:0/3995252045 >> v1:172.21.15.139:6789/0 conn(0x7f205815aff0 0x7f20580cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47418/0 (socket says 172.21.15.139:47418) 2024-09-13T17:24:40.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205d600700 1 --2- 172.21.15.139:0/3995252045 >> v2:172.21.15.176:3300/0 conn(0x7f2058144300 0x7f205806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:40.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205e000700 1 -- 172.21.15.139:0/3995252045 >> v2:172.21.15.176:3300/0 conn(0x7f2058144300 msgr2=0x7f205806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205e000700 1 --2- 172.21.15.139:0/3995252045 >> v2:172.21.15.176:3300/0 conn(0x7f2058144300 0x7f205806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205e000700 1 -- 172.21.15.139:0/3995252045 >> v1:172.21.15.139:6789/0 conn(0x7f205815aff0 legacy=0x7f20580cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205e000700 1 -- 172.21.15.139:0/3995252045 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580709e0 con 0x7f20580cddd0 2024-09-13T17:24:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205e000700 1 --2- 172.21.15.139:0/3995252045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20580cddd0 0x7f20580711e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2050009e50 tx=0x7f205000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e4047aea380f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f2057e00700 1 -- 172.21.15.139:0/3995252045 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205000e070 con 0x7f20580cddd0 2024-09-13T17:24:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f2057e00700 1 -- 172.21.15.139:0/3995252045 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205000b980 con 0x7f20580cddd0 2024-09-13T17:24:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f2057e00700 1 -- 172.21.15.139:0/3995252045 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205000bd30 con 0x7f20580cddd0 2024-09-13T17:24:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 -- 172.21.15.139:0/3995252045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20580cddd0 msgr2=0x7f20580711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 --2- 172.21.15.139:0/3995252045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20580cddd0 0x7f20580711e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2050009e50 tx=0x7f205000b330 comp rx=0 tx=0).stop 2024-09-13T17:24:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 -- 172.21.15.139:0/3995252045 shutdown_connections 2024-09-13T17:24:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 --2- 172.21.15.139:0/3995252045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20580cddd0 0x7f20580711e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 --2- 172.21.15.139:0/3995252045 >> v2:172.21.15.176:3300/0 conn(0x7f2058144300 0x7f205806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 -- 172.21.15.139:0/3995252045 >> 172.21.15.139:0/3995252045 conn(0x7f20580ce9d0 msgr2=0x7f20580cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 -- 172.21.15.139:0/3995252045 shutdown_connections 2024-09-13T17:24:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.767+0000 7f205ea00700 1 -- 172.21.15.139:0/3995252045 wait complete. 2024-09-13T17:24:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 Processor -- start 2024-09-13T17:24:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 -- start start 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20580cddd0 0x7f205815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2058144300 0x7f20581f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 0x7f20581f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205813cdd0 con 0x7f205815aff0 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580ae270 con 0x7f20580cddd0 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.771+0000 7f205ea00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20581f2a10 con 0x7f2058144300 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 0x7f20581f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 0x7f20581f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37144/0 (socket says 172.21.15.139:37144) 2024-09-13T17:24:40.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 -- 172.21.15.139:0/2531794013 learned_addr learned my addr 172.21.15.139:0/2531794013 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:40.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205d600700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20580cddd0 0x7f205815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:40.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205cc00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2058144300 0x7f20581f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:40.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 -- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2058144300 msgr2=0x7f20581f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2058144300 0x7f20581f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 -- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20580cddd0 msgr2=0x7f205815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20580cddd0 0x7f205815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 -- 172.21.15.139:0/2531794013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050009b30 con 0x7f205815aff0 2024-09-13T17:24:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205cc00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2058144300 0x7f20581f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205e000700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 0x7f20581f24d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20580660e0 tx=0x7f2050004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20500048b0 con 0x7f205815aff0 2024-09-13T17:24:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20500092e0 con 0x7f205815aff0 2024-09-13T17:24:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205815ab50 con 0x7f205815aff0 2024-09-13T17:24:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205001c680 con 0x7f205815aff0 2024-09-13T17:24:40.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205813c710 con 0x7f205815aff0 2024-09-13T17:24:40.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205813cf10 con 0x7f205815aff0 2024-09-13T17:24:40.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.775+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f205001c7e0 con 0x7f205815aff0 2024-09-13T17:24:40.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.779+0000 7f2055600700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2038066730 0x7f2038068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:40.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.779+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2050085f20 con 0x7f205815aff0 2024-09-13T17:24:40.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.779+0000 7f205d600700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2038066730 0x7f2038068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:40.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.779+0000 7f205d600700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2038066730 0x7f2038068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f204c009a00 tx=0x7f204c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:40.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:40.783+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f205813cf10 con 0x7f205815aff0 2024-09-13T17:24:41.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.011+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f205813cf10 con 0x7f205815aff0 2024-09-13T17:24:41.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.011+0000 7f2055600700 1 -- 172.21.15.139:0/2531794013 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f205813cf10 con 0x7f205815aff0 2024-09-13T17:24:41.016 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:41.016 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:41.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2038066730 msgr2=0x7f2038068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2038066730 0x7f2038068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f204c009a00 tx=0x7f204c008040 comp rx=0 tx=0).stop 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 msgr2=0x7f20581f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 0x7f20581f24d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20580660e0 tx=0x7f2050004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 shutdown_connections 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2038066730 0x7f2038068bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f205815aff0 0x7f20581f24d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2058144300 0x7f20581f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 --2- 172.21.15.139:0/2531794013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20580cddd0 0x7f205815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 >> 172.21.15.139:0/2531794013 conn(0x7f20580ce9d0 msgr2=0x7f20580ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 shutdown_connections 2024-09-13T17:24:41.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.015+0000 7f205ea00700 1 -- 172.21.15.139:0/2531794013 wait complete. 2024-09-13T17:24:41.020 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:24:41.038 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:41.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4743400700 1 Processor -- start 2024-09-13T17:24:41.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4743400700 1 -- start start 2024-09-13T17:24:41.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4743400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f473c06d430 0x7f473c0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4743400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c0b4a30 con 0x7f473c161240 2024-09-13T17:24:41.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4743400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c0ce8f0 con 0x7f473c0b45e0 2024-09-13T17:24:41.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4740a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f473c161240 0x7f473c0cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47434/0 (socket says 172.21.15.139:47434) 2024-09-13T17:24:41.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4740a00700 1 -- 172.21.15.139:0/2159985183 learned_addr learned my addr 172.21.15.139:0/2159985183 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:41.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f4743400700 1 -- 172.21.15.139:0/2159985183 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c0cdce0 con 0x7f473c06d430 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622532194 0 0) 0x7f4730001110 con 0x7f473c161240 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47240035d0 con 0x7f473c161240 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037457051 0 0) 0x7f47240035d0 con 0x7f473c161240 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 >> v2:172.21.15.176:3300/0 conn(0x7f473c06d430 msgr2=0x7f473c0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.187+0000 7f473be00700 1 --2- 172.21.15.139:0/2159985183 >> v2:172.21.15.176:3300/0 conn(0x7f473c06d430 0x7f473c0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 --2- 172.21.15.139:0/2159985183 >> v2:172.21.15.176:3300/0 conn(0x7f473c06d430 0x7f473c0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 >> v1:172.21.15.176:6789/0 conn(0x7f473c0b45e0 legacy=0x7f473c0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0cdfc0 con 0x7f473c161240 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f4730001800 con 0x7f473c161240 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 >> v1:172.21.15.139:6789/0 conn(0x7f473c161240 legacy=0x7f473c0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f4724003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4724004870 0x7f4724004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4724005350 0x7f472400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0cdce0 con 0x7f4724004870 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472400c250 con 0x7f4724003a20 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472400c410 con 0x7f4724005350 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473be00700 1 --2- 172.21.15.139:0/2159985183 >> v2:172.21.15.176:3300/0 conn(0x7f473c06d430 0x7f473c0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f4724003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4741400700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4724005350 0x7f472400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473be00700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4724004870 0x7f4724004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 -- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4724005350 msgr2=0x7f472400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:41.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4724005350 0x7f472400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 -- 172.21.15.139:0/2159985183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4724004870 msgr2=0x7f4724004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:41.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4724004870 0x7f4724004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4741400700 1 -- 172.21.15.139:0/2159985183 reap_dead start 2024-09-13T17:24:41.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 -- 172.21.15.139:0/2159985183 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240035d0 con 0x7f4724003a20 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4740a00700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f4724003e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f473000c320 tx=0x7f47240058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dd5d6058c565696 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000ce20 con 0x7f4724003a20 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730005980 con 0x7f4724003a20 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f473b400700 1 -- 172.21.15.139:0/2159985183 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730005d30 con 0x7f4724003a20 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4743400700 1 -- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 msgr2=0x7f4724003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4743400700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f4724003e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f473000c320 tx=0x7f47240058a0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4743400700 1 -- 172.21.15.139:0/2159985183 shutdown_connections 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4743400700 1 --2- 172.21.15.139:0/2159985183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f4724003e40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4743400700 1 -- 172.21.15.139:0/2159985183 >> 172.21.15.139:0/2159985183 conn(0x7f473c071170 msgr2=0x7f473c071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.191+0000 7f4743400700 1 -- 172.21.15.139:0/2159985183 shutdown_connections 2024-09-13T17:24:41.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 -- 172.21.15.139:0/2159985183 wait complete. 2024-09-13T17:24:41.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 Processor -- start 2024-09-13T17:24:41.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 -- start start 2024-09-13T17:24:41.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f473c164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 0x7f473c148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f473c1491a0 0x7f473c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c149700 con 0x7f473c14a7a0 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1499e0 con 0x7f4724003a20 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4743400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c149cc0 con 0x7f473c1491a0 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f473be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 0x7f473c148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f473be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 0x7f473c148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37170/0 (socket says 172.21.15.139:37170) 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f473be00700 1 -- 172.21.15.139:0/1291765870 learned_addr learned my addr 172.21.15.139:0/1291765870 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:41.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.195+0000 7f4741400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f473c1491a0 0x7f473c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4740a00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f473c164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f473be00700 1 -- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f473c1491a0 msgr2=0x7f473c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f473be00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f473c1491a0 0x7f473c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f473be00700 1 -- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 msgr2=0x7f473c164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f473be00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f473c164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f473be00700 1 -- 172.21.15.139:0/1291765870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c149fa0 con 0x7f473c14a7a0 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4740a00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f473c164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f473be00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 0x7f473c148c60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f472800f950 tx=0x7f472800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:41.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800dac0 con 0x7f473c14a7a0 2024-09-13T17:24:41.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472800c040 con 0x7f473c14a7a0 2024-09-13T17:24:41.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800de40 con 0x7f473c14a7a0 2024-09-13T17:24:41.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c14a280 con 0x7f473c14a7a0 2024-09-13T17:24:41.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c1594a0 con 0x7f473c14a7a0 2024-09-13T17:24:41.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.199+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c0af740 con 0x7f473c14a7a0 2024-09-13T17:24:41.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.203+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4728013440 con 0x7f473c14a7a0 2024-09-13T17:24:41.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.203+0000 7f4738c00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f471c066730 0x7f471c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.203+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4728084a60 con 0x7f473c14a7a0 2024-09-13T17:24:41.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.203+0000 7f4740a00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f471c066730 0x7f471c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.203+0000 7f4740a00700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f471c066730 0x7f471c068bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4730015040 tx=0x7f4730007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:41.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.211+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4728051a40 con 0x7f473c14a7a0 2024-09-13T17:24:41.370 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:41.374 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:24:41.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.403+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f473c06dee0 con 0x7f473c14a7a0 2024-09-13T17:24:41.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.403+0000 7f4738c00700 1 -- 172.21.15.139:0/1291765870 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f4728020090 con 0x7f473c14a7a0 2024-09-13T17:24:41.408 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:41.409 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f471c066730 msgr2=0x7f471c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f471c066730 0x7f471c068bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4730015040 tx=0x7f4730007000 comp rx=0 tx=0).stop 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 msgr2=0x7f473c148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 0x7f473c148c60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f472800f950 tx=0x7f472800fc60 comp rx=0 tx=0).stop 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 shutdown_connections 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f471c066730 0x7f471c068bf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f473c1491a0 0x7f473c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f473c14a7a0 0x7f473c148c60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 --2- 172.21.15.139:0/1291765870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724003a20 0x7f473c164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 >> 172.21.15.139:0/1291765870 conn(0x7f473c071170 msgr2=0x7f473c15f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 shutdown_connections 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.407+0000 7f4743400700 1 -- 172.21.15.139:0/1291765870 wait complete. 2024-09-13T17:24:41.434 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:24:41.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 Processor -- start 2024-09-13T17:24:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 -- start start 2024-09-13T17:24:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f184c16cf90 0x7f184c0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f184c16aff0 0x7f184c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c070c00 con 0x7f184c08a760 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c071880 con 0x7f184c16aff0 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184b200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c16d370 con 0x7f184c16cf90 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184a800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f184c16aff0 0x7f184c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184a800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f184c16aff0 0x7f184c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37174/0 (socket says 172.21.15.139:37174) 2024-09-13T17:24:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f184a800700 1 -- 172.21.15.139:0/3188353058 learned_addr learned my addr 172.21.15.139:0/3188353058 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.623+0000 7f1849e00700 1 --2- 172.21.15.139:0/3188353058 >> v2:172.21.15.176:3300/0 conn(0x7f184c16cf90 0x7f184c0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.679+0000 7f184a800700 1 -- 172.21.15.139:0/3188353058 >> v2:172.21.15.176:3300/0 conn(0x7f184c16cf90 msgr2=0x7f184c0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.679+0000 7f184a800700 1 --2- 172.21.15.139:0/3188353058 >> v2:172.21.15.176:3300/0 conn(0x7f184c16cf90 0x7f184c0cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184a800700 1 -- 172.21.15.139:0/3188353058 >> v1:172.21.15.176:6789/0 conn(0x7f184c08a760 legacy=0x7f184c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184a800700 1 -- 172.21.15.139:0/3188353058 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c070ee0 con 0x7f184c16aff0 2024-09-13T17:24:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184a800700 1 --2- 172.21.15.139:0/3188353058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c0cd7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f184c067ef0 tx=0x7f184400d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1d22b5533155ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f1848a00700 1 -- 172.21.15.139:0/3188353058 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844012440 con 0x7f184c16aff0 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f1848a00700 1 -- 172.21.15.139:0/3188353058 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440125a0 con 0x7f184c16aff0 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f1848a00700 1 -- 172.21.15.139:0/3188353058 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844012930 con 0x7f184c16aff0 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 -- 172.21.15.139:0/3188353058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 msgr2=0x7f184c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 --2- 172.21.15.139:0/3188353058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c0cd7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f184c067ef0 tx=0x7f184400d480 comp rx=0 tx=0).stop 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 -- 172.21.15.139:0/3188353058 shutdown_connections 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 --2- 172.21.15.139:0/3188353058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c0cd7d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 --2- 172.21.15.139:0/3188353058 >> v2:172.21.15.176:3300/0 conn(0x7f184c16cf90 0x7f184c0cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 -- 172.21.15.139:0/3188353058 >> 172.21.15.139:0/3188353058 conn(0x7f184c0ae6d0 msgr2=0x7f184c0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 -- 172.21.15.139:0/3188353058 shutdown_connections 2024-09-13T17:24:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.683+0000 7f184b200700 1 -- 172.21.15.139:0/3188353058 wait complete. 2024-09-13T17:24:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 Processor -- start 2024-09-13T17:24:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 -- start start 2024-09-13T17:24:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f184c08a760 0x7f184c1671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c1676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f184c16cf90 0x7f184c0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0ab510 con 0x7f184c16aff0 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c159ce0 con 0x7f184c16cf90 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c159fc0 con 0x7f184c08a760 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c1676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c1676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37180/0 (socket says 172.21.15.139:37180) 2024-09-13T17:24:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 -- 172.21.15.139:0/3520129804 learned_addr learned my addr 172.21.15.139:0/3520129804 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849e00700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f184c08a760 0x7f184c1671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f184a800700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f184c16cf90 0x7f184c0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 -- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f184c08a760 msgr2=0x7f184c1671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f184c08a760 0x7f184c1671a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 -- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f184c16cf90 msgr2=0x7f184c0aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f184c16cf90 0x7f184c0aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 -- 172.21.15.139:0/3520129804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844007b10 con 0x7f184c16aff0 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.687+0000 7f1849400700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c1676e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f183800c500 tx=0x7f183800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380052d0 con 0x7f184c16aff0 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838005430 con 0x7f184c16aff0 2024-09-13T17:24:41.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380055a0 con 0x7f184c16aff0 2024-09-13T17:24:41.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c15a2a0 con 0x7f184c16aff0 2024-09-13T17:24:41.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c0ab8e0 con 0x7f184c16aff0 2024-09-13T17:24:41.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c06a9b0 con 0x7f184c16aff0 2024-09-13T17:24:41.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.691+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18380038e0 con 0x7f184c16aff0 2024-09-13T17:24:41.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.695+0000 7f1842000700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f182c066760 0x7f182c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:41.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.695+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1838083950 con 0x7f184c16aff0 2024-09-13T17:24:41.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.695+0000 7f1849e00700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f182c066760 0x7f182c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:41.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.695+0000 7f1849e00700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f182c066760 0x7f182c068c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f183c00b9d0 tx=0x7f183c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.699+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1838050930 con 0x7f184c16aff0 2024-09-13T17:24:41.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.887+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f184c0714a0 con 0x7f182c066760 2024-09-13T17:24:41.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.903+0000 7f1842000700 1 -- 172.21.15.139:0/3520129804 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345017 (secure 0 0 0) 0x7f183c00b5c0 con 0x7f182c066760 2024-09-13T17:24:41.914 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:41.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f182c066760 msgr2=0x7f182c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f182c066760 0x7f182c068c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f183c00b9d0 tx=0x7f183c008040 comp rx=0 tx=0).stop 2024-09-13T17:24:41.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 msgr2=0x7f184c1676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c1676e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f183800c500 tx=0x7f183800c8c0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 shutdown_connections 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f182c066760 0x7f182c068c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f184c16cf90 0x7f184c0aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f184c16aff0 0x7f184c1676e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 --2- 172.21.15.139:0/3520129804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f184c08a760 0x7f184c1671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 >> 172.21.15.139:0/3520129804 conn(0x7f184c0ae6d0 msgr2=0x7f184c0cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 shutdown_connections 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:41.911+0000 7f184b200700 1 -- 172.21.15.139:0/3520129804 wait complete. 2024-09-13T17:24:41.918 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:24:41.934 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-13T17:24:40.093932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005032"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476754+0000","last_change":"2024-09-13T17:24:14.997748+0000","last_active":"2024-09-13T17:24:19.476754+0000","last_peered":"2024-09-13T17:24:19.476754+0000","last_clean":"2024-09-13T17:24:19.476754+0000","last_became_active":"2024-09-13T17:24:14.997395+0000","last_became_peered":"2024-09-13T17:24:14.997395+0000","last_unstale":"2024-09-13T17:24:19.476754+0000","last_undegraded":"2024-09-13T17:24:19.476754+0000","last_fullsized":"2024-09-13T17:24:19.476754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:08.882065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474419+0000","last_change":"2024-09-13T17:24:15.472848+0000","last_active":"2024-09-13T17:24:19.474419+0000","last_peered":"2024-09-13T17:24:19.474419+0000","last_clean":"2024-09-13T17:24:19.474419+0000","last_became_active":"2024-09-13T17:24:15.472568+0000","last_became_peered":"2024-09-13T17:24:15.472568+0000","last_unstale":"2024-09-13T17:24:19.474419+0000","last_undegraded":"2024-09-13T17:24:19.474419+0000","last_fullsized":"2024-09-13T17:24:19.474419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933480+0000","last_change":"2024-09-13T17:24:19.822998+0000","last_active":"2024-09-13T17:24:19.933480+0000","last_peered":"2024-09-13T17:24:19.933480+0000","last_clean":"2024-09-13T17:24:19.933480+0000","last_became_active":"2024-09-13T17:24:19.822588+0000","last_became_peered":"2024-09-13T17:24:19.822588+0000","last_unstale":"2024-09-13T17:24:19.933480+0000","last_undegraded":"2024-09-13T17:24:19.933480+0000","last_fullsized":"2024-09-13T17:24:19.933480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:55.423743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475101+0000","last_change":"2024-09-13T17:24:14.998585+0000","last_active":"2024-09-13T17:24:19.475101+0000","last_peered":"2024-09-13T17:24:19.475101+0000","last_clean":"2024-09-13T17:24:19.475101+0000","last_became_active":"2024-09-13T17:24:14.997238+0000","last_became_peered":"2024-09-13T17:24:14.997238+0000","last_unstale":"2024-09-13T17:24:19.475101+0000","last_undegraded":"2024-09-13T17:24:19.475101+0000","last_fullsized":"2024-09-13T17:24:19.475101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476604+0000","last_change":"2024-09-13T17:24:15.447613+0000","last_active":"2024-09-13T17:24:19.476604+0000","last_peered":"2024-09-13T17:24:19.476604+0000","last_clean":"2024-09-13T17:24:19.476604+0000","last_became_active":"2024-09-13T17:24:15.447292+0000","last_became_peered":"2024-09-13T17:24:15.447292+0000","last_unstale":"2024-09-13T17:24:19.476604+0000","last_undegraded":"2024-09-13T17:24:19.476604+0000","last_fullsized":"2024-09-13T17:24:19.476604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935221+0000","last_change":"2024-09-13T17:24:19.483196+0000","last_active":"2024-09-13T17:24:19.935221+0000","last_peered":"2024-09-13T17:24:19.935221+0000","last_clean":"2024-09-13T17:24:19.935221+0000","last_became_active":"2024-09-13T17:24:19.482655+0000","last_became_peered":"2024-09-13T17:24:19.482655+0000","last_unstale":"2024-09-13T17:24:19.935221+0000","last_undegraded":"2024-09-13T17:24:19.935221+0000","last_fullsized":"2024-09-13T17:24:19.935221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815101+0000","last_change":"2024-09-13T17:24:15.000813+0000","last_active":"2024-09-13T17:24:19.815101+0000","last_peered":"2024-09-13T17:24:19.815101+0000","last_clean":"2024-09-13T17:24:19.815101+0000","last_became_active":"2024-09-13T17:24:15.000349+0000","last_became_peered":"2024-09-13T17:24:15.000349+0000","last_unstale":"2024-09-13T17:24:19.815101+0000","last_undegraded":"2024-09-13T17:24:19.815101+0000","last_fullsized":"2024-09-13T17:24:19.815101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:15.469818+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:15.469543+0000","last_became_peered":"2024-09-13T17:24:15.469543+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935701+0000","last_change":"2024-09-13T17:24:19.493757+0000","last_active":"2024-09-13T17:24:19.935701+0000","last_peered":"2024-09-13T17:24:19.935701+0000","last_clean":"2024-09-13T17:24:19.935701+0000","last_became_active":"2024-09-13T17:24:19.493366+0000","last_became_peered":"2024-09-13T17:24:19.493366+0000","last_unstale":"2024-09-13T17:24:19.935701+0000","last_undegraded":"2024-09-13T17:24:19.935701+0000","last_fullsized":"2024-09-13T17:24:19.935701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:14.535914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814303+0000","last_change":"2024-09-13T17:24:14.999109+0000","last_active":"2024-09-13T17:24:19.814303+0000","last_peered":"2024-09-13T17:24:19.814303+0000","last_clean":"2024-09-13T17:24:19.814303+0000","last_became_active":"2024-09-13T17:24:14.998768+0000","last_became_peered":"2024-09-13T17:24:14.998768+0000","last_unstale":"2024-09-13T17:24:19.814303+0000","last_undegraded":"2024-09-13T17:24:19.814303+0000","last_fullsized":"2024-09-13T17:24:19.814303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471317+0000","last_change":"2024-09-13T17:24:15.455006+0000","last_active":"2024-09-13T17:24:19.471317+0000","last_peered":"2024-09-13T17:24:19.471317+0000","last_clean":"2024-09-13T17:24:19.471317+0000","last_became_active":"2024-09-13T17:24:15.454591+0000","last_became_peered":"2024-09-13T17:24:15.454591+0000","last_unstale":"2024-09-13T17:24:19.471317+0000","last_undegraded":"2024-09-13T17:24:19.471317+0000","last_fullsized":"2024-09-13T17:24:19.471317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935356+0000","last_change":"2024-09-13T17:24:19.484849+0000","last_active":"2024-09-13T17:24:19.935356+0000","last_peered":"2024-09-13T17:24:19.935356+0000","last_clean":"2024-09-13T17:24:19.935356+0000","last_became_active":"2024-09-13T17:24:19.484457+0000","last_became_peered":"2024-09-13T17:24:19.484457+0000","last_unstale":"2024-09-13T17:24:19.935356+0000","last_undegraded":"2024-09-13T17:24:19.935356+0000","last_fullsized":"2024-09-13T17:24:19.935356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471737+0000","last_change":"2024-09-13T17:24:15.471194+0000","last_active":"2024-09-13T17:24:19.471737+0000","last_peered":"2024-09-13T17:24:19.471737+0000","last_clean":"2024-09-13T17:24:19.471737+0000","last_became_active":"2024-09-13T17:24:15.471032+0000","last_became_peered":"2024-09-13T17:24:15.471032+0000","last_unstale":"2024-09-13T17:24:19.471737+0000","last_undegraded":"2024-09-13T17:24:19.471737+0000","last_fullsized":"2024-09-13T17:24:19.471737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814620+0000","last_change":"2024-09-13T17:24:14.999111+0000","last_active":"2024-09-13T17:24:19.814620+0000","last_peered":"2024-09-13T17:24:19.814620+0000","last_clean":"2024-09-13T17:24:19.814620+0000","last_became_active":"2024-09-13T17:24:14.998815+0000","last_became_peered":"2024-09-13T17:24:14.998815+0000","last_unstale":"2024-09-13T17:24:19.814620+0000","last_undegraded":"2024-09-13T17:24:19.814620+0000","last_fullsized":"2024-09-13T17:24:19.814620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936160+0000","last_change":"2024-09-13T17:24:19.482367+0000","last_active":"2024-09-13T17:24:19.936160+0000","last_peered":"2024-09-13T17:24:19.936160+0000","last_clean":"2024-09-13T17:24:19.936160+0000","last_became_active":"2024-09-13T17:24:19.481975+0000","last_became_peered":"2024-09-13T17:24:19.481975+0000","last_unstale":"2024-09-13T17:24:19.936160+0000","last_undegraded":"2024-09-13T17:24:19.936160+0000","last_fullsized":"2024-09-13T17:24:19.936160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:45.002511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471659+0000","last_change":"2024-09-13T17:24:15.460971+0000","last_active":"2024-09-13T17:24:19.471659+0000","last_peered":"2024-09-13T17:24:19.471659+0000","last_clean":"2024-09-13T17:24:19.471659+0000","last_became_active":"2024-09-13T17:24:15.460737+0000","last_became_peered":"2024-09-13T17:24:15.460737+0000","last_unstale":"2024-09-13T17:24:19.471659+0000","last_undegraded":"2024-09-13T17:24:19.471659+0000","last_fullsized":"2024-09-13T17:24:19.471659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.489201+0000","last_change":"2024-09-13T17:24:14.995871+0000","last_active":"2024-09-13T17:24:19.489201+0000","last_peered":"2024-09-13T17:24:19.489201+0000","last_clean":"2024-09-13T17:24:19.489201+0000","last_became_active":"2024-09-13T17:24:14.995587+0000","last_became_peered":"2024-09-13T17:24:14.995587+0000","last_unstale":"2024-09-13T17:24:19.489201+0000","last_undegraded":"2024-09-13T17:24:19.489201+0000","last_fullsized":"2024-09-13T17:24:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936209+0000","last_change":"2024-09-13T17:24:19.485042+0000","last_active":"2024-09-13T17:24:19.936209+0000","last_peered":"2024-09-13T17:24:19.936209+0000","last_clean":"2024-09-13T17:24:19.936209+0000","last_became_active":"2024-09-13T17:24:19.484582+0000","last_became_peered":"2024-09-13T17:24:19.484582+0000","last_unstale":"2024-09-13T17:24:19.936209+0000","last_undegraded":"2024-09-13T17:24:19.936209+0000","last_fullsized":"2024-09-13T17:24:19.936209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466505+0000","last_change":"2024-09-13T17:24:15.451828+0000","last_active":"2024-09-13T17:24:19.466505+0000","last_peered":"2024-09-13T17:24:19.466505+0000","last_clean":"2024-09-13T17:24:19.466505+0000","last_became_active":"2024-09-13T17:24:15.451657+0000","last_became_peered":"2024-09-13T17:24:15.451657+0000","last_unstale":"2024-09-13T17:24:19.466505+0000","last_undegraded":"2024-09-13T17:24:19.466505+0000","last_fullsized":"2024-09-13T17:24:19.466505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488312+0000","last_change":"2024-09-13T17:24:14.990698+0000","last_active":"2024-09-13T17:24:19.488312+0000","last_peered":"2024-09-13T17:24:19.488312+0000","last_clean":"2024-09-13T17:24:19.488312+0000","last_became_active":"2024-09-13T17:24:14.990416+0000","last_became_peered":"2024-09-13T17:24:14.990416+0000","last_unstale":"2024-09-13T17:24:19.488312+0000","last_undegraded":"2024-09-13T17:24:19.488312+0000","last_fullsized":"2024-09-13T17:24:19.488312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161687+0000","last_change":"2024-09-13T17:24:19.820132+0000","last_active":"2024-09-13T17:24:20.161687+0000","last_peered":"2024-09-13T17:24:20.161687+0000","last_clean":"2024-09-13T17:24:20.161687+0000","last_became_active":"2024-09-13T17:24:19.818510+0000","last_became_peered":"2024-09-13T17:24:19.818510+0000","last_unstale":"2024-09-13T17:24:20.161687+0000","last_undegraded":"2024-09-13T17:24:20.161687+0000","last_fullsized":"2024-09-13T17:24:20.161687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463620+0000","last_change":"2024-09-13T17:24:15.463989+0000","last_active":"2024-09-13T17:24:19.463620+0000","last_peered":"2024-09-13T17:24:19.463620+0000","last_clean":"2024-09-13T17:24:19.463620+0000","last_became_active":"2024-09-13T17:24:15.460158+0000","last_became_peered":"2024-09-13T17:24:15.460158+0000","last_unstale":"2024-09-13T17:24:19.463620+0000","last_undegraded":"2024-09-13T17:24:19.463620+0000","last_fullsized":"2024-09-13T17:24:19.463620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:52.267958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.813963+0000","last_change":"2024-09-13T17:24:14.997926+0000","last_active":"2024-09-13T17:24:19.813963+0000","last_peered":"2024-09-13T17:24:19.813963+0000","last_clean":"2024-09-13T17:24:19.813963+0000","last_became_active":"2024-09-13T17:24:14.997676+0000","last_became_peered":"2024-09-13T17:24:14.997676+0000","last_unstale":"2024-09-13T17:24:19.813963+0000","last_undegraded":"2024-09-13T17:24:19.813963+0000","last_fullsized":"2024-09-13T17:24:19.813963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935910+0000","last_change":"2024-09-13T17:24:19.482666+0000","last_active":"2024-09-13T17:24:19.935910+0000","last_peered":"2024-09-13T17:24:19.935910+0000","last_clean":"2024-09-13T17:24:19.935910+0000","last_became_active":"2024-09-13T17:24:19.482094+0000","last_became_peered":"2024-09-13T17:24:19.482094+0000","last_unstale":"2024-09-13T17:24:19.935910+0000","last_undegraded":"2024-09-13T17:24:19.935910+0000","last_fullsized":"2024-09-13T17:24:19.935910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476533+0000","last_change":"2024-09-13T17:24:15.451913+0000","last_active":"2024-09-13T17:24:19.476533+0000","last_peered":"2024-09-13T17:24:19.476533+0000","last_clean":"2024-09-13T17:24:19.476533+0000","last_became_active":"2024-09-13T17:24:15.451613+0000","last_became_peered":"2024-09-13T17:24:15.451613+0000","last_unstale":"2024-09-13T17:24:19.476533+0000","last_undegraded":"2024-09-13T17:24:19.476533+0000","last_fullsized":"2024-09-13T17:24:19.476533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:56.437721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475611+0000","last_change":"2024-09-13T17:24:15.000387+0000","last_active":"2024-09-13T17:24:19.475611+0000","last_peered":"2024-09-13T17:24:19.475611+0000","last_clean":"2024-09-13T17:24:19.475611+0000","last_became_active":"2024-09-13T17:24:14.999607+0000","last_became_peered":"2024-09-13T17:24:14.999607+0000","last_unstale":"2024-09-13T17:24:19.475611+0000","last_undegraded":"2024-09-13T17:24:19.475611+0000","last_fullsized":"2024-09-13T17:24:19.475611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935553+0000","last_change":"2024-09-13T17:24:19.818902+0000","last_active":"2024-09-13T17:24:19.935553+0000","last_peered":"2024-09-13T17:24:19.935553+0000","last_clean":"2024-09-13T17:24:19.935553+0000","last_became_active":"2024-09-13T17:24:19.818460+0000","last_became_peered":"2024-09-13T17:24:19.818460+0000","last_unstale":"2024-09-13T17:24:19.935553+0000","last_undegraded":"2024-09-13T17:24:19.935553+0000","last_fullsized":"2024-09-13T17:24:19.935553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.477603+0000","last_change":"2024-09-13T17:24:15.460686+0000","last_active":"2024-09-13T17:24:19.477603+0000","last_peered":"2024-09-13T17:24:19.477603+0000","last_clean":"2024-09-13T17:24:19.477603+0000","last_became_active":"2024-09-13T17:24:15.455133+0000","last_became_peered":"2024-09-13T17:24:15.455133+0000","last_unstale":"2024-09-13T17:24:19.477603+0000","last_undegraded":"2024-09-13T17:24:19.477603+0000","last_fullsized":"2024-09-13T17:24:19.477603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.407763+0000","last_change":"2024-09-13T17:24:14.987019+0000","last_active":"2024-09-13T17:24:20.407763+0000","last_peered":"2024-09-13T17:24:20.407763+0000","last_clean":"2024-09-13T17:24:20.407763+0000","last_became_active":"2024-09-13T17:24:14.986734+0000","last_became_peered":"2024-09-13T17:24:14.986734+0000","last_unstale":"2024-09-13T17:24:20.407763+0000","last_undegraded":"2024-09-13T17:24:20.407763+0000","last_fullsized":"2024-09-13T17:24:20.407763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933226+0000","last_change":"2024-09-13T17:24:19.819389+0000","last_active":"2024-09-13T17:24:19.933226+0000","last_peered":"2024-09-13T17:24:19.933226+0000","last_clean":"2024-09-13T17:24:19.933226+0000","last_became_active":"2024-09-13T17:24:19.819043+0000","last_became_peered":"2024-09-13T17:24:19.819043+0000","last_unstale":"2024-09-13T17:24:19.933226+0000","last_undegraded":"2024-09-13T17:24:19.933226+0000","last_fullsized":"2024-09-13T17:24:19.933226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:34.882933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488880+0000","last_change":"2024-09-13T17:24:15.454805+0000","last_active":"2024-09-13T17:24:19.488880+0000","last_peered":"2024-09-13T17:24:19.488880+0000","last_clean":"2024-09-13T17:24:19.488880+0000","last_became_active":"2024-09-13T17:24:15.454207+0000","last_became_peered":"2024-09-13T17:24:15.454207+0000","last_unstale":"2024-09-13T17:24:19.488880+0000","last_undegraded":"2024-09-13T17:24:19.488880+0000","last_fullsized":"2024-09-13T17:24:19.488880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815264+0000","last_change":"2024-09-13T17:24:15.005234+0000","last_active":"2024-09-13T17:24:19.815264+0000","last_peered":"2024-09-13T17:24:19.815264+0000","last_clean":"2024-09-13T17:24:19.815264+0000","last_became_active":"2024-09-13T17:24:15.005057+0000","last_became_peered":"2024-09-13T17:24:15.005057+0000","last_unstale":"2024-09-13T17:24:19.815264+0000","last_undegraded":"2024-09-13T17:24:19.815264+0000","last_fullsized":"2024-09-13T17:24:19.815264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:30.054079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162331+0000","last_change":"2024-09-13T17:24:19.818120+0000","last_active":"2024-09-13T17:24:20.162331+0000","last_peered":"2024-09-13T17:24:20.162331+0000","last_clean":"2024-09-13T17:24:20.162331+0000","last_became_active":"2024-09-13T17:24:19.816778+0000","last_became_peered":"2024-09-13T17:24:19.816778+0000","last_unstale":"2024-09-13T17:24:20.162331+0000","last_undegraded":"2024-09-13T17:24:20.162331+0000","last_fullsized":"2024-09-13T17:24:20.162331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471403+0000","last_change":"2024-09-13T17:24:15.469501+0000","last_active":"2024-09-13T17:24:19.471403+0000","last_peered":"2024-09-13T17:24:19.471403+0000","last_clean":"2024-09-13T17:24:19.471403+0000","last_became_active":"2024-09-13T17:24:15.469155+0000","last_became_peered":"2024-09-13T17:24:15.469155+0000","last_unstale":"2024-09-13T17:24:19.471403+0000","last_undegraded":"2024-09-13T17:24:19.471403+0000","last_fullsized":"2024-09-13T17:24:19.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488955+0000","last_change":"2024-09-13T17:24:14.998201+0000","last_active":"2024-09-13T17:24:19.488955+0000","last_peered":"2024-09-13T17:24:19.488955+0000","last_clean":"2024-09-13T17:24:19.488955+0000","last_became_active":"2024-09-13T17:24:14.997869+0000","last_became_peered":"2024-09-13T17:24:14.997869+0000","last_unstale":"2024-09-13T17:24:19.488955+0000","last_undegraded":"2024-09-13T17:24:19.488955+0000","last_fullsized":"2024-09-13T17:24:19.488955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161494+0000","last_change":"2024-09-13T17:24:19.491726+0000","last_active":"2024-09-13T17:24:20.161494+0000","last_peered":"2024-09-13T17:24:20.161494+0000","last_clean":"2024-09-13T17:24:20.161494+0000","last_became_active":"2024-09-13T17:24:19.491286+0000","last_became_peered":"2024-09-13T17:24:19.491286+0000","last_unstale":"2024-09-13T17:24:20.161494+0000","last_undegraded":"2024-09-13T17:24:20.161494+0000","last_fullsized":"2024-09-13T17:24:20.161494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466484+0000","last_change":"2024-09-13T17:24:15.460992+0000","last_active":"2024-09-13T17:24:19.466484+0000","last_peered":"2024-09-13T17:24:19.466484+0000","last_clean":"2024-09-13T17:24:19.466484+0000","last_became_active":"2024-09-13T17:24:15.460669+0000","last_became_peered":"2024-09-13T17:24:15.460669+0000","last_unstale":"2024-09-13T17:24:19.466484+0000","last_undegraded":"2024-09-13T17:24:19.466484+0000","last_fullsized":"2024-09-13T17:24:19.466484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:58.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471042+0000","last_change":"2024-09-13T17:24:14.983936+0000","last_active":"2024-09-13T17:24:19.471042+0000","last_peered":"2024-09-13T17:24:19.471042+0000","last_clean":"2024-09-13T17:24:19.471042+0000","last_became_active":"2024-09-13T17:24:14.983685+0000","last_became_peered":"2024-09-13T17:24:14.983685+0000","last_unstale":"2024-09-13T17:24:19.471042+0000","last_undegraded":"2024-09-13T17:24:19.471042+0000","last_fullsized":"2024-09-13T17:24:19.471042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161572+0000","last_change":"2024-09-13T17:24:19.491752+0000","last_active":"2024-09-13T17:24:20.161572+0000","last_peered":"2024-09-13T17:24:20.161572+0000","last_clean":"2024-09-13T17:24:20.161572+0000","last_became_active":"2024-09-13T17:24:19.491306+0000","last_became_peered":"2024-09-13T17:24:19.491306+0000","last_unstale":"2024-09-13T17:24:20.161572+0000","last_undegraded":"2024-09-13T17:24:20.161572+0000","last_fullsized":"2024-09-13T17:24:20.161572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.450557+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.449789+0000","last_became_peered":"2024-09-13T17:24:15.449789+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462988+0000","last_change":"2024-09-13T17:24:14.993441+0000","last_active":"2024-09-13T17:24:19.462988+0000","last_peered":"2024-09-13T17:24:19.462988+0000","last_clean":"2024-09-13T17:24:19.462988+0000","last_became_active":"2024-09-13T17:24:14.992844+0000","last_became_peered":"2024-09-13T17:24:14.992844+0000","last_unstale":"2024-09-13T17:24:19.462988+0000","last_undegraded":"2024-09-13T17:24:19.462988+0000","last_fullsized":"2024-09-13T17:24:19.462988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:45.269493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161707+0000","last_change":"2024-09-13T17:24:19.495163+0000","last_active":"2024-09-13T17:24:20.161707+0000","last_peered":"2024-09-13T17:24:20.161707+0000","last_clean":"2024-09-13T17:24:20.161707+0000","last_became_active":"2024-09-13T17:24:19.494785+0000","last_became_peered":"2024-09-13T17:24:19.494785+0000","last_unstale":"2024-09-13T17:24:20.161707+0000","last_undegraded":"2024-09-13T17:24:20.161707+0000","last_fullsized":"2024-09-13T17:24:20.161707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:03.723085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469004+0000","last_change":"2024-09-13T17:24:15.446878+0000","last_active":"2024-09-13T17:24:19.469004+0000","last_peered":"2024-09-13T17:24:19.469004+0000","last_clean":"2024-09-13T17:24:19.469004+0000","last_became_active":"2024-09-13T17:24:15.446603+0000","last_became_peered":"2024-09-13T17:24:15.446603+0000","last_unstale":"2024-09-13T17:24:19.469004+0000","last_undegraded":"2024-09-13T17:24:19.469004+0000","last_fullsized":"2024-09-13T17:24:19.469004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814072+0000","last_change":"2024-09-13T17:24:14.994254+0000","last_active":"2024-09-13T17:24:19.814072+0000","last_peered":"2024-09-13T17:24:19.814072+0000","last_clean":"2024-09-13T17:24:19.814072+0000","last_became_active":"2024-09-13T17:24:14.993782+0000","last_became_peered":"2024-09-13T17:24:14.993782+0000","last_unstale":"2024-09-13T17:24:19.814072+0000","last_undegraded":"2024-09-13T17:24:19.814072+0000","last_fullsized":"2024-09-13T17:24:19.814072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162536+0000","last_change":"2024-09-13T17:24:19.817339+0000","last_active":"2024-09-13T17:24:20.162536+0000","last_peered":"2024-09-13T17:24:20.162536+0000","last_clean":"2024-09-13T17:24:20.162536+0000","last_became_active":"2024-09-13T17:24:19.816481+0000","last_became_peered":"2024-09-13T17:24:19.816481+0000","last_unstale":"2024-09-13T17:24:20.162536+0000","last_undegraded":"2024-09-13T17:24:20.162536+0000","last_fullsized":"2024-09-13T17:24:20.162536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470053+0000","last_change":"2024-09-13T17:24:15.460711+0000","last_active":"2024-09-13T17:24:19.470053+0000","last_peered":"2024-09-13T17:24:19.470053+0000","last_clean":"2024-09-13T17:24:19.470053+0000","last_became_active":"2024-09-13T17:24:15.460433+0000","last_became_peered":"2024-09-13T17:24:15.460433+0000","last_unstale":"2024-09-13T17:24:19.470053+0000","last_undegraded":"2024-09-13T17:24:19.470053+0000","last_fullsized":"2024-09-13T17:24:19.470053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470665+0000","last_change":"2024-09-13T17:24:14.982963+0000","last_active":"2024-09-13T17:24:19.470665+0000","last_peered":"2024-09-13T17:24:19.470665+0000","last_clean":"2024-09-13T17:24:19.470665+0000","last_became_active":"2024-09-13T17:24:14.982671+0000","last_became_peered":"2024-09-13T17:24:14.982671+0000","last_unstale":"2024-09-13T17:24:19.470665+0000","last_undegraded":"2024-09-13T17:24:19.470665+0000","last_fullsized":"2024-09-13T17:24:19.470665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814197+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:24:19.814197+0000","last_peered":"2024-09-13T17:24:19.814197+0000","last_clean":"2024-09-13T17:24:19.814197+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:24:19.814197+0000","last_undegraded":"2024-09-13T17:24:19.814197+0000","last_fullsized":"2024-09-13T17:24:19.814197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159775+0000","last_change":"2024-09-13T17:24:19.819311+0000","last_active":"2024-09-13T17:24:20.159775+0000","last_peered":"2024-09-13T17:24:20.159775+0000","last_clean":"2024-09-13T17:24:20.159775+0000","last_became_active":"2024-09-13T17:24:19.818841+0000","last_became_peered":"2024-09-13T17:24:19.818841+0000","last_unstale":"2024-09-13T17:24:20.159775+0000","last_undegraded":"2024-09-13T17:24:20.159775+0000","last_fullsized":"2024-09-13T17:24:20.159775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:24.662706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814915+0000","last_change":"2024-09-13T17:24:15.476542+0000","last_active":"2024-09-13T17:24:19.814915+0000","last_peered":"2024-09-13T17:24:19.814915+0000","last_clean":"2024-09-13T17:24:19.814915+0000","last_became_active":"2024-09-13T17:24:15.476036+0000","last_became_peered":"2024-09-13T17:24:15.476036+0000","last_unstale":"2024-09-13T17:24:19.814915+0000","last_undegraded":"2024-09-13T17:24:19.814915+0000","last_fullsized":"2024-09-13T17:24:19.814915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463290+0000","last_change":"2024-09-13T17:24:14.979602+0000","last_active":"2024-09-13T17:24:19.463290+0000","last_peered":"2024-09-13T17:24:19.463290+0000","last_clean":"2024-09-13T17:24:19.463290+0000","last_became_active":"2024-09-13T17:24:14.979263+0000","last_became_peered":"2024-09-13T17:24:14.979263+0000","last_unstale":"2024-09-13T17:24:19.463290+0000","last_undegraded":"2024-09-13T17:24:19.463290+0000","last_fullsized":"2024-09-13T17:24:19.463290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159668+0000","last_change":"2024-09-13T17:24:19.817514+0000","last_active":"2024-09-13T17:24:20.159668+0000","last_peered":"2024-09-13T17:24:20.159668+0000","last_clean":"2024-09-13T17:24:20.159668+0000","last_became_active":"2024-09-13T17:24:19.816806+0000","last_became_peered":"2024-09-13T17:24:19.816806+0000","last_unstale":"2024-09-13T17:24:20.159668+0000","last_undegraded":"2024-09-13T17:24:20.159668+0000","last_fullsized":"2024-09-13T17:24:20.159668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:16.798179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471041+0000","last_change":"2024-09-13T17:24:15.469593+0000","last_active":"2024-09-13T17:24:19.471041+0000","last_peered":"2024-09-13T17:24:19.471041+0000","last_clean":"2024-09-13T17:24:19.471041+0000","last_became_active":"2024-09-13T17:24:15.469184+0000","last_became_peered":"2024-09-13T17:24:15.469184+0000","last_unstale":"2024-09-13T17:24:19.471041+0000","last_undegraded":"2024-09-13T17:24:19.471041+0000","last_fullsized":"2024-09-13T17:24:19.471041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488746+0000","last_change":"2024-09-13T17:24:14.989442+0000","last_active":"2024-09-13T17:24:19.488746+0000","last_peered":"2024-09-13T17:24:19.488746+0000","last_clean":"2024-09-13T17:24:19.488746+0000","last_became_active":"2024-09-13T17:24:14.988868+0000","last_became_peered":"2024-09-13T17:24:14.988868+0000","last_unstale":"2024-09-13T17:24:19.488746+0000","last_undegraded":"2024-09-13T17:24:19.488746+0000","last_fullsized":"2024-09-13T17:24:19.488746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162394+0000","last_change":"2024-09-13T17:24:19.494393+0000","last_active":"2024-09-13T17:24:20.162394+0000","last_peered":"2024-09-13T17:24:20.162394+0000","last_clean":"2024-09-13T17:24:20.162394+0000","last_became_active":"2024-09-13T17:24:19.493501+0000","last_became_peered":"2024-09-13T17:24:19.493501+0000","last_unstale":"2024-09-13T17:24:20.162394+0000","last_undegraded":"2024-09-13T17:24:20.162394+0000","last_fullsized":"2024-09-13T17:24:20.162394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:33.643683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815260+0000","last_change":"2024-09-13T17:24:15.461926+0000","last_active":"2024-09-13T17:24:19.815260+0000","last_peered":"2024-09-13T17:24:19.815260+0000","last_clean":"2024-09-13T17:24:19.815260+0000","last_became_active":"2024-09-13T17:24:15.459619+0000","last_became_peered":"2024-09-13T17:24:15.459619+0000","last_unstale":"2024-09-13T17:24:19.815260+0000","last_undegraded":"2024-09-13T17:24:19.815260+0000","last_fullsized":"2024-09-13T17:24:19.815260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464733+0000","last_change":"2024-09-13T17:24:14.994961+0000","last_active":"2024-09-13T17:24:19.464733+0000","last_peered":"2024-09-13T17:24:19.464733+0000","last_clean":"2024-09-13T17:24:19.464733+0000","last_became_active":"2024-09-13T17:24:14.994704+0000","last_became_peered":"2024-09-13T17:24:14.994704+0000","last_unstale":"2024-09-13T17:24:19.464733+0000","last_undegraded":"2024-09-13T17:24:19.464733+0000","last_fullsized":"2024-09-13T17:24:19.464733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.937782+0000","last_change":"2024-09-13T17:24:19.818462+0000","last_active":"2024-09-13T17:24:19.937782+0000","last_peered":"2024-09-13T17:24:19.937782+0000","last_clean":"2024-09-13T17:24:19.937782+0000","last_became_active":"2024-09-13T17:24:19.816380+0000","last_became_peered":"2024-09-13T17:24:19.816380+0000","last_unstale":"2024-09-13T17:24:19.937782+0000","last_undegraded":"2024-09-13T17:24:19.937782+0000","last_fullsized":"2024-09-13T17:24:19.937782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815030+0000","last_change":"2024-09-13T17:24:15.448897+0000","last_active":"2024-09-13T17:24:19.815030+0000","last_peered":"2024-09-13T17:24:19.815030+0000","last_clean":"2024-09-13T17:24:19.815030+0000","last_became_active":"2024-09-13T17:24:15.448622+0000","last_became_peered":"2024-09-13T17:24:15.448622+0000","last_unstale":"2024-09-13T17:24:19.815030+0000","last_undegraded":"2024-09-13T17:24:19.815030+0000","last_fullsized":"2024-09-13T17:24:19.815030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463641+0000","last_change":"2024-09-13T17:24:14.997545+0000","last_active":"2024-09-13T17:24:19.463641+0000","last_peered":"2024-09-13T17:24:19.463641+0000","last_clean":"2024-09-13T17:24:19.463641+0000","last_became_active":"2024-09-13T17:24:14.997198+0000","last_became_peered":"2024-09-13T17:24:14.997198+0000","last_unstale":"2024-09-13T17:24:19.463641+0000","last_undegraded":"2024-09-13T17:24:19.463641+0000","last_fullsized":"2024-09-13T17:24:19.463641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:25.033343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935257+0000","last_change":"2024-09-13T17:24:19.480414+0000","last_active":"2024-09-13T17:24:19.935257+0000","last_peered":"2024-09-13T17:24:19.935257+0000","last_clean":"2024-09-13T17:24:19.935257+0000","last_became_active":"2024-09-13T17:24:19.479642+0000","last_became_peered":"2024-09-13T17:24:19.479642+0000","last_unstale":"2024-09-13T17:24:19.935257+0000","last_undegraded":"2024-09-13T17:24:19.935257+0000","last_fullsized":"2024-09-13T17:24:19.935257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:14.017983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814064+0000","last_change":"2024-09-13T17:24:15.450082+0000","last_active":"2024-09-13T17:24:19.814064+0000","last_peered":"2024-09-13T17:24:19.814064+0000","last_clean":"2024-09-13T17:24:19.814064+0000","last_became_active":"2024-09-13T17:24:15.449273+0000","last_became_peered":"2024-09-13T17:24:15.449273+0000","last_unstale":"2024-09-13T17:24:19.814064+0000","last_undegraded":"2024-09-13T17:24:19.814064+0000","last_fullsized":"2024-09-13T17:24:19.814064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462863+0000","last_change":"2024-09-13T17:24:14.983243+0000","last_active":"2024-09-13T17:24:19.462863+0000","last_peered":"2024-09-13T17:24:19.462863+0000","last_clean":"2024-09-13T17:24:19.462863+0000","last_became_active":"2024-09-13T17:24:14.983004+0000","last_became_peered":"2024-09-13T17:24:14.983004+0000","last_unstale":"2024-09-13T17:24:19.462863+0000","last_undegraded":"2024-09-13T17:24:19.462863+0000","last_fullsized":"2024-09-13T17:24:19.462863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162516+0000","last_change":"2024-09-13T17:24:19.488835+0000","last_active":"2024-09-13T17:24:20.162516+0000","last_peered":"2024-09-13T17:24:20.162516+0000","last_clean":"2024-09-13T17:24:20.162516+0000","last_became_active":"2024-09-13T17:24:19.486830+0000","last_became_peered":"2024-09-13T17:24:19.486830+0000","last_unstale":"2024-09-13T17:24:20.162516+0000","last_undegraded":"2024-09-13T17:24:20.162516+0000","last_fullsized":"2024-09-13T17:24:20.162516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470643+0000","last_change":"2024-09-13T17:24:15.461810+0000","last_active":"2024-09-13T17:24:19.470643+0000","last_peered":"2024-09-13T17:24:19.470643+0000","last_clean":"2024-09-13T17:24:19.470643+0000","last_became_active":"2024-09-13T17:24:15.461508+0000","last_became_peered":"2024-09-13T17:24:15.461508+0000","last_unstale":"2024-09-13T17:24:19.470643+0000","last_undegraded":"2024-09-13T17:24:19.470643+0000","last_fullsized":"2024-09-13T17:24:19.470643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471219+0000","last_change":"2024-09-13T17:24:14.987302+0000","last_active":"2024-09-13T17:24:19.471219+0000","last_peered":"2024-09-13T17:24:19.471219+0000","last_clean":"2024-09-13T17:24:19.471219+0000","last_became_active":"2024-09-13T17:24:14.986233+0000","last_became_peered":"2024-09-13T17:24:14.986233+0000","last_unstale":"2024-09-13T17:24:19.471219+0000","last_undegraded":"2024-09-13T17:24:19.471219+0000","last_fullsized":"2024-09-13T17:24:19.471219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934778+0000","last_change":"2024-09-13T17:24:19.818522+0000","last_active":"2024-09-13T17:24:19.934778+0000","last_peered":"2024-09-13T17:24:19.934778+0000","last_clean":"2024-09-13T17:24:19.934778+0000","last_became_active":"2024-09-13T17:24:19.817966+0000","last_became_peered":"2024-09-13T17:24:19.817966+0000","last_unstale":"2024-09-13T17:24:19.934778+0000","last_undegraded":"2024-09-13T17:24:19.934778+0000","last_fullsized":"2024-09-13T17:24:19.934778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:34.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814894+0000","last_change":"2024-09-13T17:24:15.459249+0000","last_active":"2024-09-13T17:24:19.814894+0000","last_peered":"2024-09-13T17:24:19.814894+0000","last_clean":"2024-09-13T17:24:19.814894+0000","last_became_active":"2024-09-13T17:24:15.459011+0000","last_became_peered":"2024-09-13T17:24:15.459011+0000","last_unstale":"2024-09-13T17:24:19.814894+0000","last_undegraded":"2024-09-13T17:24:19.814894+0000","last_fullsized":"2024-09-13T17:24:19.814894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:14.988544+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:14.988212+0000","last_became_peered":"2024-09-13T17:24:14.988212+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934302+0000","last_change":"2024-09-13T17:24:19.815017+0000","last_active":"2024-09-13T17:24:19.934302+0000","last_peered":"2024-09-13T17:24:19.934302+0000","last_clean":"2024-09-13T17:24:19.934302+0000","last_became_active":"2024-09-13T17:24:19.814320+0000","last_became_peered":"2024-09-13T17:24:19.814320+0000","last_unstale":"2024-09-13T17:24:19.934302+0000","last_undegraded":"2024-09-13T17:24:19.934302+0000","last_fullsized":"2024-09-13T17:24:19.934302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468886+0000","last_change":"2024-09-13T17:24:15.456460+0000","last_active":"2024-09-13T17:24:19.468886+0000","last_peered":"2024-09-13T17:24:19.468886+0000","last_clean":"2024-09-13T17:24:19.468886+0000","last_became_active":"2024-09-13T17:24:15.456017+0000","last_became_peered":"2024-09-13T17:24:15.456017+0000","last_unstale":"2024-09-13T17:24:19.468886+0000","last_undegraded":"2024-09-13T17:24:19.468886+0000","last_fullsized":"2024-09-13T17:24:19.468886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476162+0000","last_change":"2024-09-13T17:24:14.990747+0000","last_active":"2024-09-13T17:24:19.476162+0000","last_peered":"2024-09-13T17:24:19.476162+0000","last_clean":"2024-09-13T17:24:19.476162+0000","last_became_active":"2024-09-13T17:24:14.990294+0000","last_became_peered":"2024-09-13T17:24:14.990294+0000","last_unstale":"2024-09-13T17:24:19.476162+0000","last_undegraded":"2024-09-13T17:24:19.476162+0000","last_fullsized":"2024-09-13T17:24:19.476162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.938634+0000","last_change":"2024-09-13T17:24:19.818818+0000","last_active":"2024-09-13T17:24:19.938634+0000","last_peered":"2024-09-13T17:24:19.938634+0000","last_clean":"2024-09-13T17:24:19.938634+0000","last_became_active":"2024-09-13T17:24:19.818382+0000","last_became_peered":"2024-09-13T17:24:19.818382+0000","last_unstale":"2024-09-13T17:24:19.938634+0000","last_undegraded":"2024-09-13T17:24:19.938634+0000","last_fullsized":"2024-09-13T17:24:19.938634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814361+0000","last_change":"2024-09-13T17:24:15.466297+0000","last_active":"2024-09-13T17:24:19.814361+0000","last_peered":"2024-09-13T17:24:19.814361+0000","last_clean":"2024-09-13T17:24:19.814361+0000","last_became_active":"2024-09-13T17:24:15.466044+0000","last_became_peered":"2024-09-13T17:24:15.466044+0000","last_unstale":"2024-09-13T17:24:19.814361+0000","last_undegraded":"2024-09-13T17:24:19.814361+0000","last_fullsized":"2024-09-13T17:24:19.814361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:31.909644+0000","last_change":"2024-09-13T17:24:14.999123+0000","last_active":"2024-09-13T17:24:31.909644+0000","last_peered":"2024-09-13T17:24:31.909644+0000","last_clean":"2024-09-13T17:24:31.909644+0000","last_became_active":"2024-09-13T17:24:14.998510+0000","last_became_peered":"2024-09-13T17:24:14.998510+0000","last_unstale":"2024-09-13T17:24:31.909644+0000","last_undegraded":"2024-09-13T17:24:31.909644+0000","last_fullsized":"2024-09-13T17:24:31.909644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161518+0000","last_change":"2024-09-13T17:24:19.489369+0000","last_active":"2024-09-13T17:24:20.161518+0000","last_peered":"2024-09-13T17:24:20.161518+0000","last_clean":"2024-09-13T17:24:20.161518+0000","last_became_active":"2024-09-13T17:24:19.488726+0000","last_became_peered":"2024-09-13T17:24:19.488726+0000","last_unstale":"2024-09-13T17:24:20.161518+0000","last_undegraded":"2024-09-13T17:24:20.161518+0000","last_fullsized":"2024-09-13T17:24:20.161518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464281+0000","last_change":"2024-09-13T17:24:15.460340+0000","last_active":"2024-09-13T17:24:19.464281+0000","last_peered":"2024-09-13T17:24:19.464281+0000","last_clean":"2024-09-13T17:24:19.464281+0000","last_became_active":"2024-09-13T17:24:15.456798+0000","last_became_peered":"2024-09-13T17:24:15.456798+0000","last_unstale":"2024-09-13T17:24:19.464281+0000","last_undegraded":"2024-09-13T17:24:19.464281+0000","last_fullsized":"2024-09-13T17:24:19.464281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488655+0000","last_change":"2024-09-13T17:24:14.992998+0000","last_active":"2024-09-13T17:24:19.488655+0000","last_peered":"2024-09-13T17:24:19.488655+0000","last_clean":"2024-09-13T17:24:19.488655+0000","last_became_active":"2024-09-13T17:24:14.992739+0000","last_became_peered":"2024-09-13T17:24:14.992739+0000","last_unstale":"2024-09-13T17:24:19.488655+0000","last_undegraded":"2024-09-13T17:24:19.488655+0000","last_fullsized":"2024-09-13T17:24:19.488655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936378+0000","last_change":"2024-09-13T17:24:19.493862+0000","last_active":"2024-09-13T17:24:19.936378+0000","last_peered":"2024-09-13T17:24:19.936378+0000","last_clean":"2024-09-13T17:24:19.936378+0000","last_became_active":"2024-09-13T17:24:19.493509+0000","last_became_peered":"2024-09-13T17:24:19.493509+0000","last_unstale":"2024-09-13T17:24:19.936378+0000","last_undegraded":"2024-09-13T17:24:19.936378+0000","last_fullsized":"2024-09-13T17:24:19.936378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476651+0000","last_change":"2024-09-13T17:24:15.452147+0000","last_active":"2024-09-13T17:24:19.476651+0000","last_peered":"2024-09-13T17:24:19.476651+0000","last_clean":"2024-09-13T17:24:19.476651+0000","last_became_active":"2024-09-13T17:24:15.451907+0000","last_became_peered":"2024-09-13T17:24:15.451907+0000","last_unstale":"2024-09-13T17:24:19.476651+0000","last_undegraded":"2024-09-13T17:24:19.476651+0000","last_fullsized":"2024-09-13T17:24:19.476651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471398+0000","last_change":"2024-09-13T17:24:14.983387+0000","last_active":"2024-09-13T17:24:19.471398+0000","last_peered":"2024-09-13T17:24:19.471398+0000","last_clean":"2024-09-13T17:24:19.471398+0000","last_became_active":"2024-09-13T17:24:14.983068+0000","last_became_peered":"2024-09-13T17:24:14.983068+0000","last_unstale":"2024-09-13T17:24:19.471398+0000","last_undegraded":"2024-09-13T17:24:19.471398+0000","last_fullsized":"2024-09-13T17:24:19.471398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933438+0000","last_change":"2024-09-13T17:24:19.483413+0000","last_active":"2024-09-13T17:24:19.933438+0000","last_peered":"2024-09-13T17:24:19.933438+0000","last_clean":"2024-09-13T17:24:19.933438+0000","last_became_active":"2024-09-13T17:24:19.482969+0000","last_became_peered":"2024-09-13T17:24:19.482969+0000","last_unstale":"2024-09-13T17:24:19.933438+0000","last_undegraded":"2024-09-13T17:24:19.933438+0000","last_fullsized":"2024-09-13T17:24:19.933438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471316+0000","last_change":"2024-09-13T17:24:15.462544+0000","last_active":"2024-09-13T17:24:19.471316+0000","last_peered":"2024-09-13T17:24:19.471316+0000","last_clean":"2024-09-13T17:24:19.471316+0000","last_became_active":"2024-09-13T17:24:15.462281+0000","last_became_peered":"2024-09-13T17:24:15.462281+0000","last_unstale":"2024-09-13T17:24:19.471316+0000","last_undegraded":"2024-09-13T17:24:19.471316+0000","last_fullsized":"2024-09-13T17:24:19.471316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475543+0000","last_change":"2024-09-13T17:24:14.980247+0000","last_active":"2024-09-13T17:24:19.475543+0000","last_peered":"2024-09-13T17:24:19.475543+0000","last_clean":"2024-09-13T17:24:19.475543+0000","last_became_active":"2024-09-13T17:24:14.979718+0000","last_became_peered":"2024-09-13T17:24:14.979718+0000","last_unstale":"2024-09-13T17:24:19.475543+0000","last_undegraded":"2024-09-13T17:24:19.475543+0000","last_fullsized":"2024-09-13T17:24:19.475543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933528+0000","last_change":"2024-09-13T17:24:19.822202+0000","last_active":"2024-09-13T17:24:19.933528+0000","last_peered":"2024-09-13T17:24:19.933528+0000","last_clean":"2024-09-13T17:24:19.933528+0000","last_became_active":"2024-09-13T17:24:19.819258+0000","last_became_peered":"2024-09-13T17:24:19.819258+0000","last_unstale":"2024-09-13T17:24:19.933528+0000","last_undegraded":"2024-09-13T17:24:19.933528+0000","last_fullsized":"2024-09-13T17:24:19.933528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:00.905961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162494+0000","last_change":"2024-09-13T17:24:19.817595+0000","last_active":"2024-09-13T17:24:20.162494+0000","last_peered":"2024-09-13T17:24:20.162494+0000","last_clean":"2024-09-13T17:24:20.162494+0000","last_became_active":"2024-09-13T17:24:19.817002+0000","last_became_peered":"2024-09-13T17:24:19.817002+0000","last_unstale":"2024-09-13T17:24:20.162494+0000","last_undegraded":"2024-09-13T17:24:20.162494+0000","last_fullsized":"2024-09-13T17:24:20.162494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.453433+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.453178+0000","last_became_peered":"2024-09-13T17:24:15.453178+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470382+0000","last_change":"2024-09-13T17:24:14.981327+0000","last_active":"2024-09-13T17:24:19.470382+0000","last_peered":"2024-09-13T17:24:19.470382+0000","last_clean":"2024-09-13T17:24:19.470382+0000","last_became_active":"2024-09-13T17:24:14.980907+0000","last_became_peered":"2024-09-13T17:24:14.980907+0000","last_unstale":"2024-09-13T17:24:19.470382+0000","last_undegraded":"2024-09-13T17:24:19.470382+0000","last_fullsized":"2024-09-13T17:24:19.470382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159850+0000","last_change":"2024-09-13T17:24:19.488756+0000","last_active":"2024-09-13T17:24:20.159850+0000","last_peered":"2024-09-13T17:24:20.159850+0000","last_clean":"2024-09-13T17:24:20.159850+0000","last_became_active":"2024-09-13T17:24:19.488197+0000","last_became_peered":"2024-09-13T17:24:19.488197+0000","last_unstale":"2024-09-13T17:24:20.159850+0000","last_undegraded":"2024-09-13T17:24:20.159850+0000","last_fullsized":"2024-09-13T17:24:20.159850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466419+0000","last_change":"2024-09-13T17:24:15.451443+0000","last_active":"2024-09-13T17:24:19.466419+0000","last_peered":"2024-09-13T17:24:19.466419+0000","last_clean":"2024-09-13T17:24:19.466419+0000","last_became_active":"2024-09-13T17:24:15.449232+0000","last_became_peered":"2024-09-13T17:24:15.449232+0000","last_unstale":"2024-09-13T17:24:19.466419+0000","last_undegraded":"2024-09-13T17:24:19.466419+0000","last_fullsized":"2024-09-13T17:24:19.466419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467931+0000","last_change":"2024-09-13T17:24:14.996368+0000","last_active":"2024-09-13T17:24:19.467931+0000","last_peered":"2024-09-13T17:24:19.467931+0000","last_clean":"2024-09-13T17:24:19.467931+0000","last_became_active":"2024-09-13T17:24:14.996059+0000","last_became_peered":"2024-09-13T17:24:14.996059+0000","last_unstale":"2024-09-13T17:24:19.467931+0000","last_undegraded":"2024-09-13T17:24:19.467931+0000","last_fullsized":"2024-09-13T17:24:19.467931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.472184+0000","last_change":"2024-09-13T17:24:14.985701+0000","last_active":"2024-09-13T17:24:19.472184+0000","last_peered":"2024-09-13T17:24:19.472184+0000","last_clean":"2024-09-13T17:24:19.472184+0000","last_became_active":"2024-09-13T17:24:14.985456+0000","last_became_peered":"2024-09-13T17:24:14.985456+0000","last_unstale":"2024-09-13T17:24:19.472184+0000","last_undegraded":"2024-09-13T17:24:19.472184+0000","last_fullsized":"2024-09-13T17:24:19.472184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476130+0000","last_change":"2024-09-13T17:24:15.455316+0000","last_active":"2024-09-13T17:24:19.476130+0000","last_peered":"2024-09-13T17:24:19.476130+0000","last_clean":"2024-09-13T17:24:19.476130+0000","last_became_active":"2024-09-13T17:24:15.454982+0000","last_became_peered":"2024-09-13T17:24:15.454982+0000","last_unstale":"2024-09-13T17:24:19.476130+0000","last_undegraded":"2024-09-13T17:24:19.476130+0000","last_fullsized":"2024-09-13T17:24:19.476130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.025977+0000","last_change":"2024-09-13T17:24:19.488455+0000","last_active":"2024-09-13T17:24:20.025977+0000","last_peered":"2024-09-13T17:24:20.025977+0000","last_clean":"2024-09-13T17:24:20.025977+0000","last_became_active":"2024-09-13T17:24:19.485870+0000","last_became_peered":"2024-09-13T17:24:19.485870+0000","last_unstale":"2024-09-13T17:24:20.025977+0000","last_undegraded":"2024-09-13T17:24:20.025977+0000","last_fullsized":"2024-09-13T17:24:20.025977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:48.596044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471752+0000","last_change":"2024-09-13T17:24:15.001371+0000","last_active":"2024-09-13T17:24:19.471752+0000","last_peered":"2024-09-13T17:24:19.471752+0000","last_clean":"2024-09-13T17:24:19.471752+0000","last_became_active":"2024-09-13T17:24:15.001103+0000","last_became_peered":"2024-09-13T17:24:15.001103+0000","last_unstale":"2024-09-13T17:24:19.471752+0000","last_undegraded":"2024-09-13T17:24:19.471752+0000","last_fullsized":"2024-09-13T17:24:19.471752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:28.035253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463630+0000","last_change":"2024-09-13T17:24:15.455094+0000","last_active":"2024-09-13T17:24:19.463630+0000","last_peered":"2024-09-13T17:24:19.463630+0000","last_clean":"2024-09-13T17:24:19.463630+0000","last_became_active":"2024-09-13T17:24:15.454651+0000","last_became_peered":"2024-09-13T17:24:15.454651+0000","last_unstale":"2024-09-13T17:24:19.463630+0000","last_undegraded":"2024-09-13T17:24:19.463630+0000","last_fullsized":"2024-09-13T17:24:19.463630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934497+0000","last_change":"2024-09-13T17:24:19.491640+0000","last_active":"2024-09-13T17:24:19.934497+0000","last_peered":"2024-09-13T17:24:19.934497+0000","last_clean":"2024-09-13T17:24:19.934497+0000","last_became_active":"2024-09-13T17:24:19.488532+0000","last_became_peered":"2024-09-13T17:24:19.488532+0000","last_unstale":"2024-09-13T17:24:19.934497+0000","last_undegraded":"2024-09-13T17:24:19.934497+0000","last_fullsized":"2024-09-13T17:24:19.934497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.387959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470302+0000","last_change":"2024-09-13T17:24:15.465966+0000","last_active":"2024-09-13T17:24:19.470302+0000","last_peered":"2024-09-13T17:24:19.470302+0000","last_clean":"2024-09-13T17:24:19.470302+0000","last_became_active":"2024-09-13T17:24:15.465686+0000","last_became_peered":"2024-09-13T17:24:15.465686+0000","last_unstale":"2024-09-13T17:24:19.470302+0000","last_undegraded":"2024-09-13T17:24:19.470302+0000","last_fullsized":"2024-09-13T17:24:19.470302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462822+0000","last_change":"2024-09-13T17:24:15.447576+0000","last_active":"2024-09-13T17:24:19.462822+0000","last_peered":"2024-09-13T17:24:19.462822+0000","last_clean":"2024-09-13T17:24:19.462822+0000","last_became_active":"2024-09-13T17:24:15.447320+0000","last_became_peered":"2024-09-13T17:24:15.447320+0000","last_unstale":"2024-09-13T17:24:19.462822+0000","last_undegraded":"2024-09-13T17:24:19.462822+0000","last_fullsized":"2024-09-13T17:24:19.462822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:26.973977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.462939+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.462315+0000","last_became_peered":"2024-09-13T17:24:15.462315+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469473+0000","last_change":"2024-09-13T17:24:15.465949+0000","last_active":"2024-09-13T17:24:19.469473+0000","last_peered":"2024-09-13T17:24:19.469473+0000","last_clean":"2024-09-13T17:24:19.469473+0000","last_became_active":"2024-09-13T17:24:15.465644+0000","last_became_peered":"2024-09-13T17:24:15.465644+0000","last_unstale":"2024-09-13T17:24:19.469473+0000","last_undegraded":"2024-09-13T17:24:19.469473+0000","last_fullsized":"2024-09-13T17:24:19.469473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476759+0000","last_change":"2024-09-13T17:24:15.454116+0000","last_active":"2024-09-13T17:24:19.476759+0000","last_peered":"2024-09-13T17:24:19.476759+0000","last_clean":"2024-09-13T17:24:19.476759+0000","last_became_active":"2024-09-13T17:24:15.453864+0000","last_became_peered":"2024-09-13T17:24:15.453864+0000","last_unstale":"2024-09-13T17:24:19.476759+0000","last_undegraded":"2024-09-13T17:24:19.476759+0000","last_fullsized":"2024-09-13T17:24:19.476759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488559+0000","last_change":"2024-09-13T17:24:15.456865+0000","last_active":"2024-09-13T17:24:19.488559+0000","last_peered":"2024-09-13T17:24:19.488559+0000","last_clean":"2024-09-13T17:24:19.488559+0000","last_became_active":"2024-09-13T17:24:15.456631+0000","last_became_peered":"2024-09-13T17:24:15.456631+0000","last_unstale":"2024-09-13T17:24:19.488559+0000","last_undegraded":"2024-09-13T17:24:19.488559+0000","last_fullsized":"2024-09-13T17:24:19.488559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475054+0000","last_change":"2024-09-13T17:24:15.471072+0000","last_active":"2024-09-13T17:24:19.475054+0000","last_peered":"2024-09-13T17:24:19.475054+0000","last_clean":"2024-09-13T17:24:19.475054+0000","last_became_active":"2024-09-13T17:24:15.470861+0000","last_became_peered":"2024-09-13T17:24:15.470861+0000","last_unstale":"2024-09-13T17:24:19.475054+0000","last_undegraded":"2024-09-13T17:24:19.475054+0000","last_fullsized":"2024-09-13T17:24:19.475054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471745+0000","last_change":"2024-09-13T17:24:15.474755+0000","last_active":"2024-09-13T17:24:19.471745+0000","last_peered":"2024-09-13T17:24:19.471745+0000","last_clean":"2024-09-13T17:24:19.471745+0000","last_became_active":"2024-09-13T17:24:15.474492+0000","last_became_peered":"2024-09-13T17:24:15.474492+0000","last_unstale":"2024-09-13T17:24:19.471745+0000","last_undegraded":"2024-09-13T17:24:19.471745+0000","last_fullsized":"2024-09-13T17:24:19.471745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470293+0000","last_change":"2024-09-13T17:24:15.466413+0000","last_active":"2024-09-13T17:24:19.470293+0000","last_peered":"2024-09-13T17:24:19.470293+0000","last_clean":"2024-09-13T17:24:19.470293+0000","last_became_active":"2024-09-13T17:24:15.466175+0000","last_became_peered":"2024-09-13T17:24:15.466175+0000","last_unstale":"2024-09-13T17:24:19.470293+0000","last_undegraded":"2024-09-13T17:24:19.470293+0000","last_fullsized":"2024-09-13T17:24:19.470293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467831+0000","last_change":"2024-09-13T17:24:15.477779+0000","last_active":"2024-09-13T17:24:19.467831+0000","last_peered":"2024-09-13T17:24:19.467831+0000","last_clean":"2024-09-13T17:24:19.467831+0000","last_became_active":"2024-09-13T17:24:15.477570+0000","last_became_peered":"2024-09-13T17:24:15.477570+0000","last_unstale":"2024-09-13T17:24:19.467831+0000","last_undegraded":"2024-09-13T17:24:19.467831+0000","last_fullsized":"2024-09-13T17:24:19.467831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470760+0000","last_change":"2024-09-13T17:24:15.462997+0000","last_active":"2024-09-13T17:24:19.470760+0000","last_peered":"2024-09-13T17:24:19.470760+0000","last_clean":"2024-09-13T17:24:19.470760+0000","last_became_active":"2024-09-13T17:24:15.462681+0000","last_became_peered":"2024-09-13T17:24:15.462681+0000","last_unstale":"2024-09-13T17:24:19.470760+0000","last_undegraded":"2024-09-13T17:24:19.470760+0000","last_fullsized":"2024-09-13T17:24:19.470760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:25.475650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469238+0000","last_change":"2024-09-13T17:24:15.456978+0000","last_active":"2024-09-13T17:24:19.469238+0000","last_peered":"2024-09-13T17:24:19.469238+0000","last_clean":"2024-09-13T17:24:19.469238+0000","last_became_active":"2024-09-13T17:24:15.456755+0000","last_became_peered":"2024-09-13T17:24:15.456755+0000","last_unstale":"2024-09-13T17:24:19.469238+0000","last_undegraded":"2024-09-13T17:24:19.469238+0000","last_fullsized":"2024-09-13T17:24:19.469238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473078+0000","last_change":"2024-09-13T17:24:15.473844+0000","last_active":"2024-09-13T17:24:19.473078+0000","last_peered":"2024-09-13T17:24:19.473078+0000","last_clean":"2024-09-13T17:24:19.473078+0000","last_became_active":"2024-09-13T17:24:15.473173+0000","last_became_peered":"2024-09-13T17:24:15.473173+0000","last_unstale":"2024-09-13T17:24:19.473078+0000","last_undegraded":"2024-09-13T17:24:19.473078+0000","last_fullsized":"2024-09-13T17:24:19.473078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815161+0000","last_change":"2024-09-13T17:24:15.470097+0000","last_active":"2024-09-13T17:24:19.815161+0000","last_peered":"2024-09-13T17:24:19.815161+0000","last_clean":"2024-09-13T17:24:19.815161+0000","last_became_active":"2024-09-13T17:24:15.469838+0000","last_became_peered":"2024-09-13T17:24:15.469838+0000","last_unstale":"2024-09-13T17:24:19.815161+0000","last_undegraded":"2024-09-13T17:24:19.815161+0000","last_fullsized":"2024-09-13T17:24:19.815161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464607+0000","last_change":"2024-09-13T17:24:15.473774+0000","last_active":"2024-09-13T17:24:19.464607+0000","last_peered":"2024-09-13T17:24:19.464607+0000","last_clean":"2024-09-13T17:24:19.464607+0000","last_became_active":"2024-09-13T17:24:15.473399+0000","last_became_peered":"2024-09-13T17:24:15.473399+0000","last_unstale":"2024-09-13T17:24:19.464607+0000","last_undegraded":"2024-09-13T17:24:19.464607+0000","last_fullsized":"2024-09-13T17:24:19.464607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:26.844852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473438+0000","last_change":"2024-09-13T17:24:15.462760+0000","last_active":"2024-09-13T17:24:19.473438+0000","last_peered":"2024-09-13T17:24:19.473438+0000","last_clean":"2024-09-13T17:24:19.473438+0000","last_became_active":"2024-09-13T17:24:15.462524+0000","last_became_peered":"2024-09-13T17:24:15.462524+0000","last_unstale":"2024-09-13T17:24:19.473438+0000","last_undegraded":"2024-09-13T17:24:19.473438+0000","last_fullsized":"2024-09-13T17:24:19.473438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470212+0000","last_change":"2024-09-13T17:24:15.457282+0000","last_active":"2024-09-13T17:24:19.470212+0000","last_peered":"2024-09-13T17:24:19.470212+0000","last_clean":"2024-09-13T17:24:19.470212+0000","last_became_active":"2024-09-13T17:24:15.456356+0000","last_became_peered":"2024-09-13T17:24:15.456356+0000","last_unstale":"2024-09-13T17:24:19.470212+0000","last_undegraded":"2024-09-13T17:24:19.470212+0000","last_fullsized":"2024-09-13T17:24:19.470212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488232+0000","last_change":"2024-09-13T17:24:15.446263+0000","last_active":"2024-09-13T17:24:19.488232+0000","last_peered":"2024-09-13T17:24:19.488232+0000","last_clean":"2024-09-13T17:24:19.488232+0000","last_became_active":"2024-09-13T17:24:15.445995+0000","last_became_peered":"2024-09-13T17:24:15.445995+0000","last_unstale":"2024-09-13T17:24:19.488232+0000","last_undegraded":"2024-09-13T17:24:19.488232+0000","last_fullsized":"2024-09-13T17:24:19.488232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468673+0000","last_change":"2024-09-13T17:24:15.456257+0000","last_active":"2024-09-13T17:24:19.468673+0000","last_peered":"2024-09-13T17:24:19.468673+0000","last_clean":"2024-09-13T17:24:19.468673+0000","last_became_active":"2024-09-13T17:24:15.455665+0000","last_became_peered":"2024-09-13T17:24:15.455665+0000","last_unstale":"2024-09-13T17:24:19.468673+0000","last_undegraded":"2024-09-13T17:24:19.468673+0000","last_fullsized":"2024-09-13T17:24:19.468673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471558+0000","last_change":"2024-09-13T17:24:15.461978+0000","last_active":"2024-09-13T17:24:19.471558+0000","last_peered":"2024-09-13T17:24:19.471558+0000","last_clean":"2024-09-13T17:24:19.471558+0000","last_became_active":"2024-09-13T17:24:15.461755+0000","last_became_peered":"2024-09-13T17:24:15.461755+0000","last_unstale":"2024-09-13T17:24:19.471558+0000","last_undegraded":"2024-09-13T17:24:19.471558+0000","last_fullsized":"2024-09-13T17:24:19.471558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464237+0000","last_change":"2024-09-13T17:24:15.475629+0000","last_active":"2024-09-13T17:24:19.464237+0000","last_peered":"2024-09-13T17:24:19.464237+0000","last_clean":"2024-09-13T17:24:19.464237+0000","last_became_active":"2024-09-13T17:24:15.475274+0000","last_became_peered":"2024-09-13T17:24:15.475274+0000","last_unstale":"2024-09-13T17:24:19.464237+0000","last_undegraded":"2024-09-13T17:24:19.464237+0000","last_fullsized":"2024-09-13T17:24:19.464237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:10.483625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473012+0000","last_change":"2024-09-13T17:24:15.456332+0000","last_active":"2024-09-13T17:24:19.473012+0000","last_peered":"2024-09-13T17:24:19.473012+0000","last_clean":"2024-09-13T17:24:19.473012+0000","last_became_active":"2024-09-13T17:24:15.456082+0000","last_became_peered":"2024-09-13T17:24:15.456082+0000","last_unstale":"2024-09-13T17:24:19.473012+0000","last_undegraded":"2024-09-13T17:24:19.473012+0000","last_fullsized":"2024-09-13T17:24:19.473012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474972+0000","last_change":"2024-09-13T17:24:15.471584+0000","last_active":"2024-09-13T17:24:19.474972+0000","last_peered":"2024-09-13T17:24:19.474972+0000","last_clean":"2024-09-13T17:24:19.474972+0000","last_became_active":"2024-09-13T17:24:15.471359+0000","last_became_peered":"2024-09-13T17:24:15.471359+0000","last_unstale":"2024-09-13T17:24:19.474972+0000","last_undegraded":"2024-09-13T17:24:19.474972+0000","last_fullsized":"2024-09-13T17:24:19.474972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815205+0000","last_change":"2024-09-13T17:24:15.472777+0000","last_active":"2024-09-13T17:24:19.815205+0000","last_peered":"2024-09-13T17:24:19.815205+0000","last_clean":"2024-09-13T17:24:19.815205+0000","last_became_active":"2024-09-13T17:24:15.472470+0000","last_became_peered":"2024-09-13T17:24:15.472470+0000","last_unstale":"2024-09-13T17:24:19.815205+0000","last_undegraded":"2024-09-13T17:24:19.815205+0000","last_fullsized":"2024-09-13T17:24:19.815205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466323+0000","last_change":"2024-09-13T17:24:15.452755+0000","last_active":"2024-09-13T17:24:19.466323+0000","last_peered":"2024-09-13T17:24:19.466323+0000","last_clean":"2024-09-13T17:24:19.466323+0000","last_became_active":"2024-09-13T17:24:15.452538+0000","last_became_peered":"2024-09-13T17:24:15.452538+0000","last_unstale":"2024-09-13T17:24:19.466323+0000","last_undegraded":"2024-09-13T17:24:19.466323+0000","last_fullsized":"2024-09-13T17:24:19.466323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814329+0000","last_change":"2024-09-13T17:24:15.464963+0000","last_active":"2024-09-13T17:24:19.814329+0000","last_peered":"2024-09-13T17:24:19.814329+0000","last_clean":"2024-09-13T17:24:19.814329+0000","last_became_active":"2024-09-13T17:24:15.464655+0000","last_became_peered":"2024-09-13T17:24:15.464655+0000","last_unstale":"2024-09-13T17:24:19.814329+0000","last_undegraded":"2024-09-13T17:24:19.814329+0000","last_fullsized":"2024-09-13T17:24:19.814329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471402+0000","last_change":"2024-09-13T17:24:15.466816+0000","last_active":"2024-09-13T17:24:19.471402+0000","last_peered":"2024-09-13T17:24:19.471402+0000","last_clean":"2024-09-13T17:24:19.471402+0000","last_became_active":"2024-09-13T17:24:15.464574+0000","last_became_peered":"2024-09-13T17:24:15.464574+0000","last_unstale":"2024-09-13T17:24:19.471402+0000","last_undegraded":"2024-09-13T17:24:19.471402+0000","last_fullsized":"2024-09-13T17:24:19.471402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814245+0000","last_change":"2024-09-13T17:24:15.470250+0000","last_active":"2024-09-13T17:24:19.814245+0000","last_peered":"2024-09-13T17:24:19.814245+0000","last_clean":"2024-09-13T17:24:19.814245+0000","last_became_active":"2024-09-13T17:24:15.469321+0000","last_became_peered":"2024-09-13T17:24:15.469321+0000","last_unstale":"2024-09-13T17:24:19.814245+0000","last_undegraded":"2024-09-13T17:24:19.814245+0000","last_fullsized":"2024-09-13T17:24:19.814245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.469790+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.469232+0000","last_became_peered":"2024-09-13T17:24:15.469232+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476283+0000","last_change":"2024-09-13T17:24:15.454215+0000","last_active":"2024-09-13T17:24:19.476283+0000","last_peered":"2024-09-13T17:24:19.476283+0000","last_clean":"2024-09-13T17:24:19.476283+0000","last_became_active":"2024-09-13T17:24:15.451536+0000","last_became_peered":"2024-09-13T17:24:15.451536+0000","last_unstale":"2024-09-13T17:24:19.476283+0000","last_undegraded":"2024-09-13T17:24:19.476283+0000","last_fullsized":"2024-09-13T17:24:19.476283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.491024+0000","last_change":"2024-09-13T17:24:15.443088+0000","last_active":"2024-09-13T17:24:19.491024+0000","last_peered":"2024-09-13T17:24:19.491024+0000","last_clean":"2024-09-13T17:24:19.491024+0000","last_became_active":"2024-09-13T17:24:15.442849+0000","last_became_peered":"2024-09-13T17:24:15.442849+0000","last_unstale":"2024-09-13T17:24:19.491024+0000","last_undegraded":"2024-09-13T17:24:19.491024+0000","last_fullsized":"2024-09-13T17:24:19.491024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814892+0000","last_change":"2024-09-13T17:24:15.462869+0000","last_active":"2024-09-13T17:24:19.814892+0000","last_peered":"2024-09-13T17:24:19.814892+0000","last_clean":"2024-09-13T17:24:19.814892+0000","last_became_active":"2024-09-13T17:24:15.462623+0000","last_became_peered":"2024-09-13T17:24:15.462623+0000","last_unstale":"2024-09-13T17:24:19.814892+0000","last_undegraded":"2024-09-13T17:24:19.814892+0000","last_fullsized":"2024-09-13T17:24:19.814892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:41.941 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:42.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 Processor -- start 2024-09-13T17:24:42.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 -- start start 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e8406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4e8415aff0 0x7f4e840cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e84070140 con 0x7f4e8406db60 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e84070420 con 0x7f4e8415aff0 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e8bc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84070700 con 0x7f4e84144300 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e83e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4e8415aff0 0x7f4e840cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e89c00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f4e8406db60 0x7f4e840b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51736/0 (socket says 172.21.15.139:51736) 2024-09-13T17:24:42.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e89c00700 1 -- 172.21.15.139:0/2089816384 learned_addr learned my addr 172.21.15.139:0/2089816384 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:42.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.123+0000 7f4e89200700 1 --2- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e8406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83e00700 1 -- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 msgr2=0x7f4e8406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:42.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83e00700 1 --2- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e8406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83e00700 1 -- 172.21.15.139:0/2089816384 >> v1:172.21.15.176:6789/0 conn(0x7f4e8406db60 legacy=0x7f4e840b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83e00700 1 -- 172.21.15.139:0/2089816384 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840709e0 con 0x7f4e8415aff0 2024-09-13T17:24:42.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83e00700 1 --2- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840cd6c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009850 tx=0x7f4e74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2adc031139b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:42.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83400700 1 -- 172.21.15.139:0/2089816384 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011830 con 0x7f4e8415aff0 2024-09-13T17:24:42.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83400700 1 -- 172.21.15.139:0/2089816384 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74011990 con 0x7f4e8415aff0 2024-09-13T17:24:42.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e83400700 1 -- 172.21.15.139:0/2089816384 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011d40 con 0x7f4e8415aff0 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 -- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 msgr2=0x7f4e840cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840cd6c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009850 tx=0x7f4e74009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 -- 172.21.15.139:0/2089816384 shutdown_connections 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840cd6c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/2089816384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e8406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 -- 172.21.15.139:0/2089816384 >> 172.21.15.139:0/2089816384 conn(0x7f4e840ce9d0 msgr2=0x7f4e840cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 -- 172.21.15.139:0/2089816384 shutdown_connections 2024-09-13T17:24:42.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.127+0000 7f4e8bc00700 1 -- 172.21.15.139:0/2089816384 wait complete. 2024-09-13T17:24:42.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 Processor -- start 2024-09-13T17:24:42.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 -- start start 2024-09-13T17:24:42.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 0x7f4e841589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e840a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840ab800 con 0x7f4e8406db60 2024-09-13T17:24:42.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840aa3a0 con 0x7f4e8415aff0 2024-09-13T17:24:42.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840a9790 con 0x7f4e84144300 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 0x7f4e841589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 0x7f4e841589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37184/0 (socket says 172.21.15.139:37184) 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 -- 172.21.15.139:0/1871622250 learned_addr learned my addr 172.21.15.139:0/1871622250 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e83e00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e840a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89c00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 -- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 msgr2=0x7f4e840a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e840a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 -- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 msgr2=0x7f4e840abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 -- 172.21.15.139:0/1871622250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740094b0 con 0x7f4e8406db60 2024-09-13T17:24:42.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e89200700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 0x7f4e841589e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800ea00 tx=0x7f4e7800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:42.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78009720 con 0x7f4e8406db60 2024-09-13T17:24:42.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800eea0 con 0x7f4e8406db60 2024-09-13T17:24:42.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840a9a70 con 0x7f4e8406db60 2024-09-13T17:24:42.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800ca50 con 0x7f4e8406db60 2024-09-13T17:24:42.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.131+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e840aa030 con 0x7f4e8406db60 2024-09-13T17:24:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.135+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8406d620 con 0x7f4e8406db60 2024-09-13T17:24:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.135+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e7800cbb0 con 0x7f4e8406db60 2024-09-13T17:24:42.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.135+0000 7f4e80c00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4e68066730 0x7f4e68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.135+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e78084400 con 0x7f4e8406db60 2024-09-13T17:24:42.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.135+0000 7f4e83e00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4e68066730 0x7f4e68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.135+0000 7f4e83e00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4e68066730 0x7f4e68068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009850 tx=0x7f4e7401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:42.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.139+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e78051510 con 0x7f4e8406db60 2024-09-13T17:24:42.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.319+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e8406fe10 con 0x7f4e68066730 2024-09-13T17:24:42.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.327+0000 7f4e80c00700 1 -- 172.21.15.139:0/1871622250 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345007 (secure 0 0 0) 0x7f4e74011b00 con 0x7f4e68066730 2024-09-13T17:24:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:42.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4e68066730 msgr2=0x7f4e68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4e68066730 0x7f4e68068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009850 tx=0x7f4e7401c040 comp rx=0 tx=0).stop 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 msgr2=0x7f4e841589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 0x7f4e841589e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800ea00 tx=0x7f4e7800ed10 comp rx=0 tx=0).stop 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 shutdown_connections 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4e68066730 0x7f4e68068bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e8415aff0 0x7f4e840abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e84144300 0x7f4e840a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 --2- 172.21.15.139:0/1871622250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e8406db60 0x7f4e841589e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 >> 172.21.15.139:0/1871622250 conn(0x7f4e840ce9d0 msgr2=0x7f4e840ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 shutdown_connections 2024-09-13T17:24:42.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.335+0000 7f4e8bc00700 1 -- 172.21.15.139:0/1871622250 wait complete. 2024-09-13T17:24:42.343 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:24:42.357 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-13T17:24:42.094456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005107"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476754+0000","last_change":"2024-09-13T17:24:14.997748+0000","last_active":"2024-09-13T17:24:19.476754+0000","last_peered":"2024-09-13T17:24:19.476754+0000","last_clean":"2024-09-13T17:24:19.476754+0000","last_became_active":"2024-09-13T17:24:14.997395+0000","last_became_peered":"2024-09-13T17:24:14.997395+0000","last_unstale":"2024-09-13T17:24:19.476754+0000","last_undegraded":"2024-09-13T17:24:19.476754+0000","last_fullsized":"2024-09-13T17:24:19.476754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:08.882065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474419+0000","last_change":"2024-09-13T17:24:15.472848+0000","last_active":"2024-09-13T17:24:19.474419+0000","last_peered":"2024-09-13T17:24:19.474419+0000","last_clean":"2024-09-13T17:24:19.474419+0000","last_became_active":"2024-09-13T17:24:15.472568+0000","last_became_peered":"2024-09-13T17:24:15.472568+0000","last_unstale":"2024-09-13T17:24:19.474419+0000","last_undegraded":"2024-09-13T17:24:19.474419+0000","last_fullsized":"2024-09-13T17:24:19.474419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933480+0000","last_change":"2024-09-13T17:24:19.822998+0000","last_active":"2024-09-13T17:24:19.933480+0000","last_peered":"2024-09-13T17:24:19.933480+0000","last_clean":"2024-09-13T17:24:19.933480+0000","last_became_active":"2024-09-13T17:24:19.822588+0000","last_became_peered":"2024-09-13T17:24:19.822588+0000","last_unstale":"2024-09-13T17:24:19.933480+0000","last_undegraded":"2024-09-13T17:24:19.933480+0000","last_fullsized":"2024-09-13T17:24:19.933480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:55.423743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475101+0000","last_change":"2024-09-13T17:24:14.998585+0000","last_active":"2024-09-13T17:24:19.475101+0000","last_peered":"2024-09-13T17:24:19.475101+0000","last_clean":"2024-09-13T17:24:19.475101+0000","last_became_active":"2024-09-13T17:24:14.997238+0000","last_became_peered":"2024-09-13T17:24:14.997238+0000","last_unstale":"2024-09-13T17:24:19.475101+0000","last_undegraded":"2024-09-13T17:24:19.475101+0000","last_fullsized":"2024-09-13T17:24:19.475101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476604+0000","last_change":"2024-09-13T17:24:15.447613+0000","last_active":"2024-09-13T17:24:19.476604+0000","last_peered":"2024-09-13T17:24:19.476604+0000","last_clean":"2024-09-13T17:24:19.476604+0000","last_became_active":"2024-09-13T17:24:15.447292+0000","last_became_peered":"2024-09-13T17:24:15.447292+0000","last_unstale":"2024-09-13T17:24:19.476604+0000","last_undegraded":"2024-09-13T17:24:19.476604+0000","last_fullsized":"2024-09-13T17:24:19.476604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935221+0000","last_change":"2024-09-13T17:24:19.483196+0000","last_active":"2024-09-13T17:24:19.935221+0000","last_peered":"2024-09-13T17:24:19.935221+0000","last_clean":"2024-09-13T17:24:19.935221+0000","last_became_active":"2024-09-13T17:24:19.482655+0000","last_became_peered":"2024-09-13T17:24:19.482655+0000","last_unstale":"2024-09-13T17:24:19.935221+0000","last_undegraded":"2024-09-13T17:24:19.935221+0000","last_fullsized":"2024-09-13T17:24:19.935221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815101+0000","last_change":"2024-09-13T17:24:15.000813+0000","last_active":"2024-09-13T17:24:19.815101+0000","last_peered":"2024-09-13T17:24:19.815101+0000","last_clean":"2024-09-13T17:24:19.815101+0000","last_became_active":"2024-09-13T17:24:15.000349+0000","last_became_peered":"2024-09-13T17:24:15.000349+0000","last_unstale":"2024-09-13T17:24:19.815101+0000","last_undegraded":"2024-09-13T17:24:19.815101+0000","last_fullsized":"2024-09-13T17:24:19.815101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:15.469818+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:15.469543+0000","last_became_peered":"2024-09-13T17:24:15.469543+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935701+0000","last_change":"2024-09-13T17:24:19.493757+0000","last_active":"2024-09-13T17:24:19.935701+0000","last_peered":"2024-09-13T17:24:19.935701+0000","last_clean":"2024-09-13T17:24:19.935701+0000","last_became_active":"2024-09-13T17:24:19.493366+0000","last_became_peered":"2024-09-13T17:24:19.493366+0000","last_unstale":"2024-09-13T17:24:19.935701+0000","last_undegraded":"2024-09-13T17:24:19.935701+0000","last_fullsized":"2024-09-13T17:24:19.935701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:14.535914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814303+0000","last_change":"2024-09-13T17:24:14.999109+0000","last_active":"2024-09-13T17:24:19.814303+0000","last_peered":"2024-09-13T17:24:19.814303+0000","last_clean":"2024-09-13T17:24:19.814303+0000","last_became_active":"2024-09-13T17:24:14.998768+0000","last_became_peered":"2024-09-13T17:24:14.998768+0000","last_unstale":"2024-09-13T17:24:19.814303+0000","last_undegraded":"2024-09-13T17:24:19.814303+0000","last_fullsized":"2024-09-13T17:24:19.814303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471317+0000","last_change":"2024-09-13T17:24:15.455006+0000","last_active":"2024-09-13T17:24:19.471317+0000","last_peered":"2024-09-13T17:24:19.471317+0000","last_clean":"2024-09-13T17:24:19.471317+0000","last_became_active":"2024-09-13T17:24:15.454591+0000","last_became_peered":"2024-09-13T17:24:15.454591+0000","last_unstale":"2024-09-13T17:24:19.471317+0000","last_undegraded":"2024-09-13T17:24:19.471317+0000","last_fullsized":"2024-09-13T17:24:19.471317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935356+0000","last_change":"2024-09-13T17:24:19.484849+0000","last_active":"2024-09-13T17:24:19.935356+0000","last_peered":"2024-09-13T17:24:19.935356+0000","last_clean":"2024-09-13T17:24:19.935356+0000","last_became_active":"2024-09-13T17:24:19.484457+0000","last_became_peered":"2024-09-13T17:24:19.484457+0000","last_unstale":"2024-09-13T17:24:19.935356+0000","last_undegraded":"2024-09-13T17:24:19.935356+0000","last_fullsized":"2024-09-13T17:24:19.935356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471737+0000","last_change":"2024-09-13T17:24:15.471194+0000","last_active":"2024-09-13T17:24:19.471737+0000","last_peered":"2024-09-13T17:24:19.471737+0000","last_clean":"2024-09-13T17:24:19.471737+0000","last_became_active":"2024-09-13T17:24:15.471032+0000","last_became_peered":"2024-09-13T17:24:15.471032+0000","last_unstale":"2024-09-13T17:24:19.471737+0000","last_undegraded":"2024-09-13T17:24:19.471737+0000","last_fullsized":"2024-09-13T17:24:19.471737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814620+0000","last_change":"2024-09-13T17:24:14.999111+0000","last_active":"2024-09-13T17:24:19.814620+0000","last_peered":"2024-09-13T17:24:19.814620+0000","last_clean":"2024-09-13T17:24:19.814620+0000","last_became_active":"2024-09-13T17:24:14.998815+0000","last_became_peered":"2024-09-13T17:24:14.998815+0000","last_unstale":"2024-09-13T17:24:19.814620+0000","last_undegraded":"2024-09-13T17:24:19.814620+0000","last_fullsized":"2024-09-13T17:24:19.814620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936160+0000","last_change":"2024-09-13T17:24:19.482367+0000","last_active":"2024-09-13T17:24:19.936160+0000","last_peered":"2024-09-13T17:24:19.936160+0000","last_clean":"2024-09-13T17:24:19.936160+0000","last_became_active":"2024-09-13T17:24:19.481975+0000","last_became_peered":"2024-09-13T17:24:19.481975+0000","last_unstale":"2024-09-13T17:24:19.936160+0000","last_undegraded":"2024-09-13T17:24:19.936160+0000","last_fullsized":"2024-09-13T17:24:19.936160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:45.002511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471659+0000","last_change":"2024-09-13T17:24:15.460971+0000","last_active":"2024-09-13T17:24:19.471659+0000","last_peered":"2024-09-13T17:24:19.471659+0000","last_clean":"2024-09-13T17:24:19.471659+0000","last_became_active":"2024-09-13T17:24:15.460737+0000","last_became_peered":"2024-09-13T17:24:15.460737+0000","last_unstale":"2024-09-13T17:24:19.471659+0000","last_undegraded":"2024-09-13T17:24:19.471659+0000","last_fullsized":"2024-09-13T17:24:19.471659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.489201+0000","last_change":"2024-09-13T17:24:14.995871+0000","last_active":"2024-09-13T17:24:19.489201+0000","last_peered":"2024-09-13T17:24:19.489201+0000","last_clean":"2024-09-13T17:24:19.489201+0000","last_became_active":"2024-09-13T17:24:14.995587+0000","last_became_peered":"2024-09-13T17:24:14.995587+0000","last_unstale":"2024-09-13T17:24:19.489201+0000","last_undegraded":"2024-09-13T17:24:19.489201+0000","last_fullsized":"2024-09-13T17:24:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936209+0000","last_change":"2024-09-13T17:24:19.485042+0000","last_active":"2024-09-13T17:24:19.936209+0000","last_peered":"2024-09-13T17:24:19.936209+0000","last_clean":"2024-09-13T17:24:19.936209+0000","last_became_active":"2024-09-13T17:24:19.484582+0000","last_became_peered":"2024-09-13T17:24:19.484582+0000","last_unstale":"2024-09-13T17:24:19.936209+0000","last_undegraded":"2024-09-13T17:24:19.936209+0000","last_fullsized":"2024-09-13T17:24:19.936209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466505+0000","last_change":"2024-09-13T17:24:15.451828+0000","last_active":"2024-09-13T17:24:19.466505+0000","last_peered":"2024-09-13T17:24:19.466505+0000","last_clean":"2024-09-13T17:24:19.466505+0000","last_became_active":"2024-09-13T17:24:15.451657+0000","last_became_peered":"2024-09-13T17:24:15.451657+0000","last_unstale":"2024-09-13T17:24:19.466505+0000","last_undegraded":"2024-09-13T17:24:19.466505+0000","last_fullsized":"2024-09-13T17:24:19.466505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488312+0000","last_change":"2024-09-13T17:24:14.990698+0000","last_active":"2024-09-13T17:24:19.488312+0000","last_peered":"2024-09-13T17:24:19.488312+0000","last_clean":"2024-09-13T17:24:19.488312+0000","last_became_active":"2024-09-13T17:24:14.990416+0000","last_became_peered":"2024-09-13T17:24:14.990416+0000","last_unstale":"2024-09-13T17:24:19.488312+0000","last_undegraded":"2024-09-13T17:24:19.488312+0000","last_fullsized":"2024-09-13T17:24:19.488312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161687+0000","last_change":"2024-09-13T17:24:19.820132+0000","last_active":"2024-09-13T17:24:20.161687+0000","last_peered":"2024-09-13T17:24:20.161687+0000","last_clean":"2024-09-13T17:24:20.161687+0000","last_became_active":"2024-09-13T17:24:19.818510+0000","last_became_peered":"2024-09-13T17:24:19.818510+0000","last_unstale":"2024-09-13T17:24:20.161687+0000","last_undegraded":"2024-09-13T17:24:20.161687+0000","last_fullsized":"2024-09-13T17:24:20.161687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463620+0000","last_change":"2024-09-13T17:24:15.463989+0000","last_active":"2024-09-13T17:24:19.463620+0000","last_peered":"2024-09-13T17:24:19.463620+0000","last_clean":"2024-09-13T17:24:19.463620+0000","last_became_active":"2024-09-13T17:24:15.460158+0000","last_became_peered":"2024-09-13T17:24:15.460158+0000","last_unstale":"2024-09-13T17:24:19.463620+0000","last_undegraded":"2024-09-13T17:24:19.463620+0000","last_fullsized":"2024-09-13T17:24:19.463620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:52.267958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.813963+0000","last_change":"2024-09-13T17:24:14.997926+0000","last_active":"2024-09-13T17:24:19.813963+0000","last_peered":"2024-09-13T17:24:19.813963+0000","last_clean":"2024-09-13T17:24:19.813963+0000","last_became_active":"2024-09-13T17:24:14.997676+0000","last_became_peered":"2024-09-13T17:24:14.997676+0000","last_unstale":"2024-09-13T17:24:19.813963+0000","last_undegraded":"2024-09-13T17:24:19.813963+0000","last_fullsized":"2024-09-13T17:24:19.813963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935910+0000","last_change":"2024-09-13T17:24:19.482666+0000","last_active":"2024-09-13T17:24:19.935910+0000","last_peered":"2024-09-13T17:24:19.935910+0000","last_clean":"2024-09-13T17:24:19.935910+0000","last_became_active":"2024-09-13T17:24:19.482094+0000","last_became_peered":"2024-09-13T17:24:19.482094+0000","last_unstale":"2024-09-13T17:24:19.935910+0000","last_undegraded":"2024-09-13T17:24:19.935910+0000","last_fullsized":"2024-09-13T17:24:19.935910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476533+0000","last_change":"2024-09-13T17:24:15.451913+0000","last_active":"2024-09-13T17:24:19.476533+0000","last_peered":"2024-09-13T17:24:19.476533+0000","last_clean":"2024-09-13T17:24:19.476533+0000","last_became_active":"2024-09-13T17:24:15.451613+0000","last_became_peered":"2024-09-13T17:24:15.451613+0000","last_unstale":"2024-09-13T17:24:19.476533+0000","last_undegraded":"2024-09-13T17:24:19.476533+0000","last_fullsized":"2024-09-13T17:24:19.476533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:56.437721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475611+0000","last_change":"2024-09-13T17:24:15.000387+0000","last_active":"2024-09-13T17:24:19.475611+0000","last_peered":"2024-09-13T17:24:19.475611+0000","last_clean":"2024-09-13T17:24:19.475611+0000","last_became_active":"2024-09-13T17:24:14.999607+0000","last_became_peered":"2024-09-13T17:24:14.999607+0000","last_unstale":"2024-09-13T17:24:19.475611+0000","last_undegraded":"2024-09-13T17:24:19.475611+0000","last_fullsized":"2024-09-13T17:24:19.475611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935553+0000","last_change":"2024-09-13T17:24:19.818902+0000","last_active":"2024-09-13T17:24:19.935553+0000","last_peered":"2024-09-13T17:24:19.935553+0000","last_clean":"2024-09-13T17:24:19.935553+0000","last_became_active":"2024-09-13T17:24:19.818460+0000","last_became_peered":"2024-09-13T17:24:19.818460+0000","last_unstale":"2024-09-13T17:24:19.935553+0000","last_undegraded":"2024-09-13T17:24:19.935553+0000","last_fullsized":"2024-09-13T17:24:19.935553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.477603+0000","last_change":"2024-09-13T17:24:15.460686+0000","last_active":"2024-09-13T17:24:19.477603+0000","last_peered":"2024-09-13T17:24:19.477603+0000","last_clean":"2024-09-13T17:24:19.477603+0000","last_became_active":"2024-09-13T17:24:15.455133+0000","last_became_peered":"2024-09-13T17:24:15.455133+0000","last_unstale":"2024-09-13T17:24:19.477603+0000","last_undegraded":"2024-09-13T17:24:19.477603+0000","last_fullsized":"2024-09-13T17:24:19.477603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.407763+0000","last_change":"2024-09-13T17:24:14.987019+0000","last_active":"2024-09-13T17:24:20.407763+0000","last_peered":"2024-09-13T17:24:20.407763+0000","last_clean":"2024-09-13T17:24:20.407763+0000","last_became_active":"2024-09-13T17:24:14.986734+0000","last_became_peered":"2024-09-13T17:24:14.986734+0000","last_unstale":"2024-09-13T17:24:20.407763+0000","last_undegraded":"2024-09-13T17:24:20.407763+0000","last_fullsized":"2024-09-13T17:24:20.407763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933226+0000","last_change":"2024-09-13T17:24:19.819389+0000","last_active":"2024-09-13T17:24:19.933226+0000","last_peered":"2024-09-13T17:24:19.933226+0000","last_clean":"2024-09-13T17:24:19.933226+0000","last_became_active":"2024-09-13T17:24:19.819043+0000","last_became_peered":"2024-09-13T17:24:19.819043+0000","last_unstale":"2024-09-13T17:24:19.933226+0000","last_undegraded":"2024-09-13T17:24:19.933226+0000","last_fullsized":"2024-09-13T17:24:19.933226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:34.882933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488880+0000","last_change":"2024-09-13T17:24:15.454805+0000","last_active":"2024-09-13T17:24:19.488880+0000","last_peered":"2024-09-13T17:24:19.488880+0000","last_clean":"2024-09-13T17:24:19.488880+0000","last_became_active":"2024-09-13T17:24:15.454207+0000","last_became_peered":"2024-09-13T17:24:15.454207+0000","last_unstale":"2024-09-13T17:24:19.488880+0000","last_undegraded":"2024-09-13T17:24:19.488880+0000","last_fullsized":"2024-09-13T17:24:19.488880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815264+0000","last_change":"2024-09-13T17:24:15.005234+0000","last_active":"2024-09-13T17:24:19.815264+0000","last_peered":"2024-09-13T17:24:19.815264+0000","last_clean":"2024-09-13T17:24:19.815264+0000","last_became_active":"2024-09-13T17:24:15.005057+0000","last_became_peered":"2024-09-13T17:24:15.005057+0000","last_unstale":"2024-09-13T17:24:19.815264+0000","last_undegraded":"2024-09-13T17:24:19.815264+0000","last_fullsized":"2024-09-13T17:24:19.815264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:30.054079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162331+0000","last_change":"2024-09-13T17:24:19.818120+0000","last_active":"2024-09-13T17:24:20.162331+0000","last_peered":"2024-09-13T17:24:20.162331+0000","last_clean":"2024-09-13T17:24:20.162331+0000","last_became_active":"2024-09-13T17:24:19.816778+0000","last_became_peered":"2024-09-13T17:24:19.816778+0000","last_unstale":"2024-09-13T17:24:20.162331+0000","last_undegraded":"2024-09-13T17:24:20.162331+0000","last_fullsized":"2024-09-13T17:24:20.162331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471403+0000","last_change":"2024-09-13T17:24:15.469501+0000","last_active":"2024-09-13T17:24:19.471403+0000","last_peered":"2024-09-13T17:24:19.471403+0000","last_clean":"2024-09-13T17:24:19.471403+0000","last_became_active":"2024-09-13T17:24:15.469155+0000","last_became_peered":"2024-09-13T17:24:15.469155+0000","last_unstale":"2024-09-13T17:24:19.471403+0000","last_undegraded":"2024-09-13T17:24:19.471403+0000","last_fullsized":"2024-09-13T17:24:19.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488955+0000","last_change":"2024-09-13T17:24:14.998201+0000","last_active":"2024-09-13T17:24:19.488955+0000","last_peered":"2024-09-13T17:24:19.488955+0000","last_clean":"2024-09-13T17:24:19.488955+0000","last_became_active":"2024-09-13T17:24:14.997869+0000","last_became_peered":"2024-09-13T17:24:14.997869+0000","last_unstale":"2024-09-13T17:24:19.488955+0000","last_undegraded":"2024-09-13T17:24:19.488955+0000","last_fullsized":"2024-09-13T17:24:19.488955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161494+0000","last_change":"2024-09-13T17:24:19.491726+0000","last_active":"2024-09-13T17:24:20.161494+0000","last_peered":"2024-09-13T17:24:20.161494+0000","last_clean":"2024-09-13T17:24:20.161494+0000","last_became_active":"2024-09-13T17:24:19.491286+0000","last_became_peered":"2024-09-13T17:24:19.491286+0000","last_unstale":"2024-09-13T17:24:20.161494+0000","last_undegraded":"2024-09-13T17:24:20.161494+0000","last_fullsized":"2024-09-13T17:24:20.161494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466484+0000","last_change":"2024-09-13T17:24:15.460992+0000","last_active":"2024-09-13T17:24:19.466484+0000","last_peered":"2024-09-13T17:24:19.466484+0000","last_clean":"2024-09-13T17:24:19.466484+0000","last_became_active":"2024-09-13T17:24:15.460669+0000","last_became_peered":"2024-09-13T17:24:15.460669+0000","last_unstale":"2024-09-13T17:24:19.466484+0000","last_undegraded":"2024-09-13T17:24:19.466484+0000","last_fullsized":"2024-09-13T17:24:19.466484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:58.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471042+0000","last_change":"2024-09-13T17:24:14.983936+0000","last_active":"2024-09-13T17:24:19.471042+0000","last_peered":"2024-09-13T17:24:19.471042+0000","last_clean":"2024-09-13T17:24:19.471042+0000","last_became_active":"2024-09-13T17:24:14.983685+0000","last_became_peered":"2024-09-13T17:24:14.983685+0000","last_unstale":"2024-09-13T17:24:19.471042+0000","last_undegraded":"2024-09-13T17:24:19.471042+0000","last_fullsized":"2024-09-13T17:24:19.471042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161572+0000","last_change":"2024-09-13T17:24:19.491752+0000","last_active":"2024-09-13T17:24:20.161572+0000","last_peered":"2024-09-13T17:24:20.161572+0000","last_clean":"2024-09-13T17:24:20.161572+0000","last_became_active":"2024-09-13T17:24:19.491306+0000","last_became_peered":"2024-09-13T17:24:19.491306+0000","last_unstale":"2024-09-13T17:24:20.161572+0000","last_undegraded":"2024-09-13T17:24:20.161572+0000","last_fullsized":"2024-09-13T17:24:20.161572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.450557+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.449789+0000","last_became_peered":"2024-09-13T17:24:15.449789+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462988+0000","last_change":"2024-09-13T17:24:14.993441+0000","last_active":"2024-09-13T17:24:19.462988+0000","last_peered":"2024-09-13T17:24:19.462988+0000","last_clean":"2024-09-13T17:24:19.462988+0000","last_became_active":"2024-09-13T17:24:14.992844+0000","last_became_peered":"2024-09-13T17:24:14.992844+0000","last_unstale":"2024-09-13T17:24:19.462988+0000","last_undegraded":"2024-09-13T17:24:19.462988+0000","last_fullsized":"2024-09-13T17:24:19.462988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:45.269493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161707+0000","last_change":"2024-09-13T17:24:19.495163+0000","last_active":"2024-09-13T17:24:20.161707+0000","last_peered":"2024-09-13T17:24:20.161707+0000","last_clean":"2024-09-13T17:24:20.161707+0000","last_became_active":"2024-09-13T17:24:19.494785+0000","last_became_peered":"2024-09-13T17:24:19.494785+0000","last_unstale":"2024-09-13T17:24:20.161707+0000","last_undegraded":"2024-09-13T17:24:20.161707+0000","last_fullsized":"2024-09-13T17:24:20.161707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:03.723085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469004+0000","last_change":"2024-09-13T17:24:15.446878+0000","last_active":"2024-09-13T17:24:19.469004+0000","last_peered":"2024-09-13T17:24:19.469004+0000","last_clean":"2024-09-13T17:24:19.469004+0000","last_became_active":"2024-09-13T17:24:15.446603+0000","last_became_peered":"2024-09-13T17:24:15.446603+0000","last_unstale":"2024-09-13T17:24:19.469004+0000","last_undegraded":"2024-09-13T17:24:19.469004+0000","last_fullsized":"2024-09-13T17:24:19.469004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814072+0000","last_change":"2024-09-13T17:24:14.994254+0000","last_active":"2024-09-13T17:24:19.814072+0000","last_peered":"2024-09-13T17:24:19.814072+0000","last_clean":"2024-09-13T17:24:19.814072+0000","last_became_active":"2024-09-13T17:24:14.993782+0000","last_became_peered":"2024-09-13T17:24:14.993782+0000","last_unstale":"2024-09-13T17:24:19.814072+0000","last_undegraded":"2024-09-13T17:24:19.814072+0000","last_fullsized":"2024-09-13T17:24:19.814072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162536+0000","last_change":"2024-09-13T17:24:19.817339+0000","last_active":"2024-09-13T17:24:20.162536+0000","last_peered":"2024-09-13T17:24:20.162536+0000","last_clean":"2024-09-13T17:24:20.162536+0000","last_became_active":"2024-09-13T17:24:19.816481+0000","last_became_peered":"2024-09-13T17:24:19.816481+0000","last_unstale":"2024-09-13T17:24:20.162536+0000","last_undegraded":"2024-09-13T17:24:20.162536+0000","last_fullsized":"2024-09-13T17:24:20.162536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470053+0000","last_change":"2024-09-13T17:24:15.460711+0000","last_active":"2024-09-13T17:24:19.470053+0000","last_peered":"2024-09-13T17:24:19.470053+0000","last_clean":"2024-09-13T17:24:19.470053+0000","last_became_active":"2024-09-13T17:24:15.460433+0000","last_became_peered":"2024-09-13T17:24:15.460433+0000","last_unstale":"2024-09-13T17:24:19.470053+0000","last_undegraded":"2024-09-13T17:24:19.470053+0000","last_fullsized":"2024-09-13T17:24:19.470053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470665+0000","last_change":"2024-09-13T17:24:14.982963+0000","last_active":"2024-09-13T17:24:19.470665+0000","last_peered":"2024-09-13T17:24:19.470665+0000","last_clean":"2024-09-13T17:24:19.470665+0000","last_became_active":"2024-09-13T17:24:14.982671+0000","last_became_peered":"2024-09-13T17:24:14.982671+0000","last_unstale":"2024-09-13T17:24:19.470665+0000","last_undegraded":"2024-09-13T17:24:19.470665+0000","last_fullsized":"2024-09-13T17:24:19.470665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814197+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:24:19.814197+0000","last_peered":"2024-09-13T17:24:19.814197+0000","last_clean":"2024-09-13T17:24:19.814197+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:24:19.814197+0000","last_undegraded":"2024-09-13T17:24:19.814197+0000","last_fullsized":"2024-09-13T17:24:19.814197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159775+0000","last_change":"2024-09-13T17:24:19.819311+0000","last_active":"2024-09-13T17:24:20.159775+0000","last_peered":"2024-09-13T17:24:20.159775+0000","last_clean":"2024-09-13T17:24:20.159775+0000","last_became_active":"2024-09-13T17:24:19.818841+0000","last_became_peered":"2024-09-13T17:24:19.818841+0000","last_unstale":"2024-09-13T17:24:20.159775+0000","last_undegraded":"2024-09-13T17:24:20.159775+0000","last_fullsized":"2024-09-13T17:24:20.159775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:24.662706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814915+0000","last_change":"2024-09-13T17:24:15.476542+0000","last_active":"2024-09-13T17:24:19.814915+0000","last_peered":"2024-09-13T17:24:19.814915+0000","last_clean":"2024-09-13T17:24:19.814915+0000","last_became_active":"2024-09-13T17:24:15.476036+0000","last_became_peered":"2024-09-13T17:24:15.476036+0000","last_unstale":"2024-09-13T17:24:19.814915+0000","last_undegraded":"2024-09-13T17:24:19.814915+0000","last_fullsized":"2024-09-13T17:24:19.814915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463290+0000","last_change":"2024-09-13T17:24:14.979602+0000","last_active":"2024-09-13T17:24:19.463290+0000","last_peered":"2024-09-13T17:24:19.463290+0000","last_clean":"2024-09-13T17:24:19.463290+0000","last_became_active":"2024-09-13T17:24:14.979263+0000","last_became_peered":"2024-09-13T17:24:14.979263+0000","last_unstale":"2024-09-13T17:24:19.463290+0000","last_undegraded":"2024-09-13T17:24:19.463290+0000","last_fullsized":"2024-09-13T17:24:19.463290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159668+0000","last_change":"2024-09-13T17:24:19.817514+0000","last_active":"2024-09-13T17:24:20.159668+0000","last_peered":"2024-09-13T17:24:20.159668+0000","last_clean":"2024-09-13T17:24:20.159668+0000","last_became_active":"2024-09-13T17:24:19.816806+0000","last_became_peered":"2024-09-13T17:24:19.816806+0000","last_unstale":"2024-09-13T17:24:20.159668+0000","last_undegraded":"2024-09-13T17:24:20.159668+0000","last_fullsized":"2024-09-13T17:24:20.159668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:16.798179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471041+0000","last_change":"2024-09-13T17:24:15.469593+0000","last_active":"2024-09-13T17:24:19.471041+0000","last_peered":"2024-09-13T17:24:19.471041+0000","last_clean":"2024-09-13T17:24:19.471041+0000","last_became_active":"2024-09-13T17:24:15.469184+0000","last_became_peered":"2024-09-13T17:24:15.469184+0000","last_unstale":"2024-09-13T17:24:19.471041+0000","last_undegraded":"2024-09-13T17:24:19.471041+0000","last_fullsized":"2024-09-13T17:24:19.471041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488746+0000","last_change":"2024-09-13T17:24:14.989442+0000","last_active":"2024-09-13T17:24:19.488746+0000","last_peered":"2024-09-13T17:24:19.488746+0000","last_clean":"2024-09-13T17:24:19.488746+0000","last_became_active":"2024-09-13T17:24:14.988868+0000","last_became_peered":"2024-09-13T17:24:14.988868+0000","last_unstale":"2024-09-13T17:24:19.488746+0000","last_undegraded":"2024-09-13T17:24:19.488746+0000","last_fullsized":"2024-09-13T17:24:19.488746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162394+0000","last_change":"2024-09-13T17:24:19.494393+0000","last_active":"2024-09-13T17:24:20.162394+0000","last_peered":"2024-09-13T17:24:20.162394+0000","last_clean":"2024-09-13T17:24:20.162394+0000","last_became_active":"2024-09-13T17:24:19.493501+0000","last_became_peered":"2024-09-13T17:24:19.493501+0000","last_unstale":"2024-09-13T17:24:20.162394+0000","last_undegraded":"2024-09-13T17:24:20.162394+0000","last_fullsized":"2024-09-13T17:24:20.162394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:33.643683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815260+0000","last_change":"2024-09-13T17:24:15.461926+0000","last_active":"2024-09-13T17:24:19.815260+0000","last_peered":"2024-09-13T17:24:19.815260+0000","last_clean":"2024-09-13T17:24:19.815260+0000","last_became_active":"2024-09-13T17:24:15.459619+0000","last_became_peered":"2024-09-13T17:24:15.459619+0000","last_unstale":"2024-09-13T17:24:19.815260+0000","last_undegraded":"2024-09-13T17:24:19.815260+0000","last_fullsized":"2024-09-13T17:24:19.815260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464733+0000","last_change":"2024-09-13T17:24:14.994961+0000","last_active":"2024-09-13T17:24:19.464733+0000","last_peered":"2024-09-13T17:24:19.464733+0000","last_clean":"2024-09-13T17:24:19.464733+0000","last_became_active":"2024-09-13T17:24:14.994704+0000","last_became_peered":"2024-09-13T17:24:14.994704+0000","last_unstale":"2024-09-13T17:24:19.464733+0000","last_undegraded":"2024-09-13T17:24:19.464733+0000","last_fullsized":"2024-09-13T17:24:19.464733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.937782+0000","last_change":"2024-09-13T17:24:19.818462+0000","last_active":"2024-09-13T17:24:19.937782+0000","last_peered":"2024-09-13T17:24:19.937782+0000","last_clean":"2024-09-13T17:24:19.937782+0000","last_became_active":"2024-09-13T17:24:19.816380+0000","last_became_peered":"2024-09-13T17:24:19.816380+0000","last_unstale":"2024-09-13T17:24:19.937782+0000","last_undegraded":"2024-09-13T17:24:19.937782+0000","last_fullsized":"2024-09-13T17:24:19.937782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815030+0000","last_change":"2024-09-13T17:24:15.448897+0000","last_active":"2024-09-13T17:24:19.815030+0000","last_peered":"2024-09-13T17:24:19.815030+0000","last_clean":"2024-09-13T17:24:19.815030+0000","last_became_active":"2024-09-13T17:24:15.448622+0000","last_became_peered":"2024-09-13T17:24:15.448622+0000","last_unstale":"2024-09-13T17:24:19.815030+0000","last_undegraded":"2024-09-13T17:24:19.815030+0000","last_fullsized":"2024-09-13T17:24:19.815030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463641+0000","last_change":"2024-09-13T17:24:14.997545+0000","last_active":"2024-09-13T17:24:19.463641+0000","last_peered":"2024-09-13T17:24:19.463641+0000","last_clean":"2024-09-13T17:24:19.463641+0000","last_became_active":"2024-09-13T17:24:14.997198+0000","last_became_peered":"2024-09-13T17:24:14.997198+0000","last_unstale":"2024-09-13T17:24:19.463641+0000","last_undegraded":"2024-09-13T17:24:19.463641+0000","last_fullsized":"2024-09-13T17:24:19.463641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:25.033343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935257+0000","last_change":"2024-09-13T17:24:19.480414+0000","last_active":"2024-09-13T17:24:19.935257+0000","last_peered":"2024-09-13T17:24:19.935257+0000","last_clean":"2024-09-13T17:24:19.935257+0000","last_became_active":"2024-09-13T17:24:19.479642+0000","last_became_peered":"2024-09-13T17:24:19.479642+0000","last_unstale":"2024-09-13T17:24:19.935257+0000","last_undegraded":"2024-09-13T17:24:19.935257+0000","last_fullsized":"2024-09-13T17:24:19.935257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:14.017983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814064+0000","last_change":"2024-09-13T17:24:15.450082+0000","last_active":"2024-09-13T17:24:19.814064+0000","last_peered":"2024-09-13T17:24:19.814064+0000","last_clean":"2024-09-13T17:24:19.814064+0000","last_became_active":"2024-09-13T17:24:15.449273+0000","last_became_peered":"2024-09-13T17:24:15.449273+0000","last_unstale":"2024-09-13T17:24:19.814064+0000","last_undegraded":"2024-09-13T17:24:19.814064+0000","last_fullsized":"2024-09-13T17:24:19.814064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462863+0000","last_change":"2024-09-13T17:24:14.983243+0000","last_active":"2024-09-13T17:24:19.462863+0000","last_peered":"2024-09-13T17:24:19.462863+0000","last_clean":"2024-09-13T17:24:19.462863+0000","last_became_active":"2024-09-13T17:24:14.983004+0000","last_became_peered":"2024-09-13T17:24:14.983004+0000","last_unstale":"2024-09-13T17:24:19.462863+0000","last_undegraded":"2024-09-13T17:24:19.462863+0000","last_fullsized":"2024-09-13T17:24:19.462863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162516+0000","last_change":"2024-09-13T17:24:19.488835+0000","last_active":"2024-09-13T17:24:20.162516+0000","last_peered":"2024-09-13T17:24:20.162516+0000","last_clean":"2024-09-13T17:24:20.162516+0000","last_became_active":"2024-09-13T17:24:19.486830+0000","last_became_peered":"2024-09-13T17:24:19.486830+0000","last_unstale":"2024-09-13T17:24:20.162516+0000","last_undegraded":"2024-09-13T17:24:20.162516+0000","last_fullsized":"2024-09-13T17:24:20.162516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470643+0000","last_change":"2024-09-13T17:24:15.461810+0000","last_active":"2024-09-13T17:24:19.470643+0000","last_peered":"2024-09-13T17:24:19.470643+0000","last_clean":"2024-09-13T17:24:19.470643+0000","last_became_active":"2024-09-13T17:24:15.461508+0000","last_became_peered":"2024-09-13T17:24:15.461508+0000","last_unstale":"2024-09-13T17:24:19.470643+0000","last_undegraded":"2024-09-13T17:24:19.470643+0000","last_fullsized":"2024-09-13T17:24:19.470643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471219+0000","last_change":"2024-09-13T17:24:14.987302+0000","last_active":"2024-09-13T17:24:19.471219+0000","last_peered":"2024-09-13T17:24:19.471219+0000","last_clean":"2024-09-13T17:24:19.471219+0000","last_became_active":"2024-09-13T17:24:14.986233+0000","last_became_peered":"2024-09-13T17:24:14.986233+0000","last_unstale":"2024-09-13T17:24:19.471219+0000","last_undegraded":"2024-09-13T17:24:19.471219+0000","last_fullsized":"2024-09-13T17:24:19.471219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934778+0000","last_change":"2024-09-13T17:24:19.818522+0000","last_active":"2024-09-13T17:24:19.934778+0000","last_peered":"2024-09-13T17:24:19.934778+0000","last_clean":"2024-09-13T17:24:19.934778+0000","last_became_active":"2024-09-13T17:24:19.817966+0000","last_became_peered":"2024-09-13T17:24:19.817966+0000","last_unstale":"2024-09-13T17:24:19.934778+0000","last_undegraded":"2024-09-13T17:24:19.934778+0000","last_fullsized":"2024-09-13T17:24:19.934778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:34.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814894+0000","last_change":"2024-09-13T17:24:15.459249+0000","last_active":"2024-09-13T17:24:19.814894+0000","last_peered":"2024-09-13T17:24:19.814894+0000","last_clean":"2024-09-13T17:24:19.814894+0000","last_became_active":"2024-09-13T17:24:15.459011+0000","last_became_peered":"2024-09-13T17:24:15.459011+0000","last_unstale":"2024-09-13T17:24:19.814894+0000","last_undegraded":"2024-09-13T17:24:19.814894+0000","last_fullsized":"2024-09-13T17:24:19.814894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:14.988544+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:14.988212+0000","last_became_peered":"2024-09-13T17:24:14.988212+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934302+0000","last_change":"2024-09-13T17:24:19.815017+0000","last_active":"2024-09-13T17:24:19.934302+0000","last_peered":"2024-09-13T17:24:19.934302+0000","last_clean":"2024-09-13T17:24:19.934302+0000","last_became_active":"2024-09-13T17:24:19.814320+0000","last_became_peered":"2024-09-13T17:24:19.814320+0000","last_unstale":"2024-09-13T17:24:19.934302+0000","last_undegraded":"2024-09-13T17:24:19.934302+0000","last_fullsized":"2024-09-13T17:24:19.934302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468886+0000","last_change":"2024-09-13T17:24:15.456460+0000","last_active":"2024-09-13T17:24:19.468886+0000","last_peered":"2024-09-13T17:24:19.468886+0000","last_clean":"2024-09-13T17:24:19.468886+0000","last_became_active":"2024-09-13T17:24:15.456017+0000","last_became_peered":"2024-09-13T17:24:15.456017+0000","last_unstale":"2024-09-13T17:24:19.468886+0000","last_undegraded":"2024-09-13T17:24:19.468886+0000","last_fullsized":"2024-09-13T17:24:19.468886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476162+0000","last_change":"2024-09-13T17:24:14.990747+0000","last_active":"2024-09-13T17:24:19.476162+0000","last_peered":"2024-09-13T17:24:19.476162+0000","last_clean":"2024-09-13T17:24:19.476162+0000","last_became_active":"2024-09-13T17:24:14.990294+0000","last_became_peered":"2024-09-13T17:24:14.990294+0000","last_unstale":"2024-09-13T17:24:19.476162+0000","last_undegraded":"2024-09-13T17:24:19.476162+0000","last_fullsized":"2024-09-13T17:24:19.476162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.938634+0000","last_change":"2024-09-13T17:24:19.818818+0000","last_active":"2024-09-13T17:24:19.938634+0000","last_peered":"2024-09-13T17:24:19.938634+0000","last_clean":"2024-09-13T17:24:19.938634+0000","last_became_active":"2024-09-13T17:24:19.818382+0000","last_became_peered":"2024-09-13T17:24:19.818382+0000","last_unstale":"2024-09-13T17:24:19.938634+0000","last_undegraded":"2024-09-13T17:24:19.938634+0000","last_fullsized":"2024-09-13T17:24:19.938634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814361+0000","last_change":"2024-09-13T17:24:15.466297+0000","last_active":"2024-09-13T17:24:19.814361+0000","last_peered":"2024-09-13T17:24:19.814361+0000","last_clean":"2024-09-13T17:24:19.814361+0000","last_became_active":"2024-09-13T17:24:15.466044+0000","last_became_peered":"2024-09-13T17:24:15.466044+0000","last_unstale":"2024-09-13T17:24:19.814361+0000","last_undegraded":"2024-09-13T17:24:19.814361+0000","last_fullsized":"2024-09-13T17:24:19.814361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:31.909644+0000","last_change":"2024-09-13T17:24:14.999123+0000","last_active":"2024-09-13T17:24:31.909644+0000","last_peered":"2024-09-13T17:24:31.909644+0000","last_clean":"2024-09-13T17:24:31.909644+0000","last_became_active":"2024-09-13T17:24:14.998510+0000","last_became_peered":"2024-09-13T17:24:14.998510+0000","last_unstale":"2024-09-13T17:24:31.909644+0000","last_undegraded":"2024-09-13T17:24:31.909644+0000","last_fullsized":"2024-09-13T17:24:31.909644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161518+0000","last_change":"2024-09-13T17:24:19.489369+0000","last_active":"2024-09-13T17:24:20.161518+0000","last_peered":"2024-09-13T17:24:20.161518+0000","last_clean":"2024-09-13T17:24:20.161518+0000","last_became_active":"2024-09-13T17:24:19.488726+0000","last_became_peered":"2024-09-13T17:24:19.488726+0000","last_unstale":"2024-09-13T17:24:20.161518+0000","last_undegraded":"2024-09-13T17:24:20.161518+0000","last_fullsized":"2024-09-13T17:24:20.161518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464281+0000","last_change":"2024-09-13T17:24:15.460340+0000","last_active":"2024-09-13T17:24:19.464281+0000","last_peered":"2024-09-13T17:24:19.464281+0000","last_clean":"2024-09-13T17:24:19.464281+0000","last_became_active":"2024-09-13T17:24:15.456798+0000","last_became_peered":"2024-09-13T17:24:15.456798+0000","last_unstale":"2024-09-13T17:24:19.464281+0000","last_undegraded":"2024-09-13T17:24:19.464281+0000","last_fullsized":"2024-09-13T17:24:19.464281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488655+0000","last_change":"2024-09-13T17:24:14.992998+0000","last_active":"2024-09-13T17:24:19.488655+0000","last_peered":"2024-09-13T17:24:19.488655+0000","last_clean":"2024-09-13T17:24:19.488655+0000","last_became_active":"2024-09-13T17:24:14.992739+0000","last_became_peered":"2024-09-13T17:24:14.992739+0000","last_unstale":"2024-09-13T17:24:19.488655+0000","last_undegraded":"2024-09-13T17:24:19.488655+0000","last_fullsized":"2024-09-13T17:24:19.488655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936378+0000","last_change":"2024-09-13T17:24:19.493862+0000","last_active":"2024-09-13T17:24:19.936378+0000","last_peered":"2024-09-13T17:24:19.936378+0000","last_clean":"2024-09-13T17:24:19.936378+0000","last_became_active":"2024-09-13T17:24:19.493509+0000","last_became_peered":"2024-09-13T17:24:19.493509+0000","last_unstale":"2024-09-13T17:24:19.936378+0000","last_undegraded":"2024-09-13T17:24:19.936378+0000","last_fullsized":"2024-09-13T17:24:19.936378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476651+0000","last_change":"2024-09-13T17:24:15.452147+0000","last_active":"2024-09-13T17:24:19.476651+0000","last_peered":"2024-09-13T17:24:19.476651+0000","last_clean":"2024-09-13T17:24:19.476651+0000","last_became_active":"2024-09-13T17:24:15.451907+0000","last_became_peered":"2024-09-13T17:24:15.451907+0000","last_unstale":"2024-09-13T17:24:19.476651+0000","last_undegraded":"2024-09-13T17:24:19.476651+0000","last_fullsized":"2024-09-13T17:24:19.476651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471398+0000","last_change":"2024-09-13T17:24:14.983387+0000","last_active":"2024-09-13T17:24:19.471398+0000","last_peered":"2024-09-13T17:24:19.471398+0000","last_clean":"2024-09-13T17:24:19.471398+0000","last_became_active":"2024-09-13T17:24:14.983068+0000","last_became_peered":"2024-09-13T17:24:14.983068+0000","last_unstale":"2024-09-13T17:24:19.471398+0000","last_undegraded":"2024-09-13T17:24:19.471398+0000","last_fullsized":"2024-09-13T17:24:19.471398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933438+0000","last_change":"2024-09-13T17:24:19.483413+0000","last_active":"2024-09-13T17:24:19.933438+0000","last_peered":"2024-09-13T17:24:19.933438+0000","last_clean":"2024-09-13T17:24:19.933438+0000","last_became_active":"2024-09-13T17:24:19.482969+0000","last_became_peered":"2024-09-13T17:24:19.482969+0000","last_unstale":"2024-09-13T17:24:19.933438+0000","last_undegraded":"2024-09-13T17:24:19.933438+0000","last_fullsized":"2024-09-13T17:24:19.933438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471316+0000","last_change":"2024-09-13T17:24:15.462544+0000","last_active":"2024-09-13T17:24:19.471316+0000","last_peered":"2024-09-13T17:24:19.471316+0000","last_clean":"2024-09-13T17:24:19.471316+0000","last_became_active":"2024-09-13T17:24:15.462281+0000","last_became_peered":"2024-09-13T17:24:15.462281+0000","last_unstale":"2024-09-13T17:24:19.471316+0000","last_undegraded":"2024-09-13T17:24:19.471316+0000","last_fullsized":"2024-09-13T17:24:19.471316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475543+0000","last_change":"2024-09-13T17:24:14.980247+0000","last_active":"2024-09-13T17:24:19.475543+0000","last_peered":"2024-09-13T17:24:19.475543+0000","last_clean":"2024-09-13T17:24:19.475543+0000","last_became_active":"2024-09-13T17:24:14.979718+0000","last_became_peered":"2024-09-13T17:24:14.979718+0000","last_unstale":"2024-09-13T17:24:19.475543+0000","last_undegraded":"2024-09-13T17:24:19.475543+0000","last_fullsized":"2024-09-13T17:24:19.475543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933528+0000","last_change":"2024-09-13T17:24:19.822202+0000","last_active":"2024-09-13T17:24:19.933528+0000","last_peered":"2024-09-13T17:24:19.933528+0000","last_clean":"2024-09-13T17:24:19.933528+0000","last_became_active":"2024-09-13T17:24:19.819258+0000","last_became_peered":"2024-09-13T17:24:19.819258+0000","last_unstale":"2024-09-13T17:24:19.933528+0000","last_undegraded":"2024-09-13T17:24:19.933528+0000","last_fullsized":"2024-09-13T17:24:19.933528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:00.905961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162494+0000","last_change":"2024-09-13T17:24:19.817595+0000","last_active":"2024-09-13T17:24:20.162494+0000","last_peered":"2024-09-13T17:24:20.162494+0000","last_clean":"2024-09-13T17:24:20.162494+0000","last_became_active":"2024-09-13T17:24:19.817002+0000","last_became_peered":"2024-09-13T17:24:19.817002+0000","last_unstale":"2024-09-13T17:24:20.162494+0000","last_undegraded":"2024-09-13T17:24:20.162494+0000","last_fullsized":"2024-09-13T17:24:20.162494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.453433+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.453178+0000","last_became_peered":"2024-09-13T17:24:15.453178+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470382+0000","last_change":"2024-09-13T17:24:14.981327+0000","last_active":"2024-09-13T17:24:19.470382+0000","last_peered":"2024-09-13T17:24:19.470382+0000","last_clean":"2024-09-13T17:24:19.470382+0000","last_became_active":"2024-09-13T17:24:14.980907+0000","last_became_peered":"2024-09-13T17:24:14.980907+0000","last_unstale":"2024-09-13T17:24:19.470382+0000","last_undegraded":"2024-09-13T17:24:19.470382+0000","last_fullsized":"2024-09-13T17:24:19.470382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159850+0000","last_change":"2024-09-13T17:24:19.488756+0000","last_active":"2024-09-13T17:24:20.159850+0000","last_peered":"2024-09-13T17:24:20.159850+0000","last_clean":"2024-09-13T17:24:20.159850+0000","last_became_active":"2024-09-13T17:24:19.488197+0000","last_became_peered":"2024-09-13T17:24:19.488197+0000","last_unstale":"2024-09-13T17:24:20.159850+0000","last_undegraded":"2024-09-13T17:24:20.159850+0000","last_fullsized":"2024-09-13T17:24:20.159850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466419+0000","last_change":"2024-09-13T17:24:15.451443+0000","last_active":"2024-09-13T17:24:19.466419+0000","last_peered":"2024-09-13T17:24:19.466419+0000","last_clean":"2024-09-13T17:24:19.466419+0000","last_became_active":"2024-09-13T17:24:15.449232+0000","last_became_peered":"2024-09-13T17:24:15.449232+0000","last_unstale":"2024-09-13T17:24:19.466419+0000","last_undegraded":"2024-09-13T17:24:19.466419+0000","last_fullsized":"2024-09-13T17:24:19.466419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467931+0000","last_change":"2024-09-13T17:24:14.996368+0000","last_active":"2024-09-13T17:24:19.467931+0000","last_peered":"2024-09-13T17:24:19.467931+0000","last_clean":"2024-09-13T17:24:19.467931+0000","last_became_active":"2024-09-13T17:24:14.996059+0000","last_became_peered":"2024-09-13T17:24:14.996059+0000","last_unstale":"2024-09-13T17:24:19.467931+0000","last_undegraded":"2024-09-13T17:24:19.467931+0000","last_fullsized":"2024-09-13T17:24:19.467931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.472184+0000","last_change":"2024-09-13T17:24:14.985701+0000","last_active":"2024-09-13T17:24:19.472184+0000","last_peered":"2024-09-13T17:24:19.472184+0000","last_clean":"2024-09-13T17:24:19.472184+0000","last_became_active":"2024-09-13T17:24:14.985456+0000","last_became_peered":"2024-09-13T17:24:14.985456+0000","last_unstale":"2024-09-13T17:24:19.472184+0000","last_undegraded":"2024-09-13T17:24:19.472184+0000","last_fullsized":"2024-09-13T17:24:19.472184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476130+0000","last_change":"2024-09-13T17:24:15.455316+0000","last_active":"2024-09-13T17:24:19.476130+0000","last_peered":"2024-09-13T17:24:19.476130+0000","last_clean":"2024-09-13T17:24:19.476130+0000","last_became_active":"2024-09-13T17:24:15.454982+0000","last_became_peered":"2024-09-13T17:24:15.454982+0000","last_unstale":"2024-09-13T17:24:19.476130+0000","last_undegraded":"2024-09-13T17:24:19.476130+0000","last_fullsized":"2024-09-13T17:24:19.476130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.025977+0000","last_change":"2024-09-13T17:24:19.488455+0000","last_active":"2024-09-13T17:24:20.025977+0000","last_peered":"2024-09-13T17:24:20.025977+0000","last_clean":"2024-09-13T17:24:20.025977+0000","last_became_active":"2024-09-13T17:24:19.485870+0000","last_became_peered":"2024-09-13T17:24:19.485870+0000","last_unstale":"2024-09-13T17:24:20.025977+0000","last_undegraded":"2024-09-13T17:24:20.025977+0000","last_fullsized":"2024-09-13T17:24:20.025977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:48.596044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471752+0000","last_change":"2024-09-13T17:24:15.001371+0000","last_active":"2024-09-13T17:24:19.471752+0000","last_peered":"2024-09-13T17:24:19.471752+0000","last_clean":"2024-09-13T17:24:19.471752+0000","last_became_active":"2024-09-13T17:24:15.001103+0000","last_became_peered":"2024-09-13T17:24:15.001103+0000","last_unstale":"2024-09-13T17:24:19.471752+0000","last_undegraded":"2024-09-13T17:24:19.471752+0000","last_fullsized":"2024-09-13T17:24:19.471752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:28.035253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463630+0000","last_change":"2024-09-13T17:24:15.455094+0000","last_active":"2024-09-13T17:24:19.463630+0000","last_peered":"2024-09-13T17:24:19.463630+0000","last_clean":"2024-09-13T17:24:19.463630+0000","last_became_active":"2024-09-13T17:24:15.454651+0000","last_became_peered":"2024-09-13T17:24:15.454651+0000","last_unstale":"2024-09-13T17:24:19.463630+0000","last_undegraded":"2024-09-13T17:24:19.463630+0000","last_fullsized":"2024-09-13T17:24:19.463630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934497+0000","last_change":"2024-09-13T17:24:19.491640+0000","last_active":"2024-09-13T17:24:19.934497+0000","last_peered":"2024-09-13T17:24:19.934497+0000","last_clean":"2024-09-13T17:24:19.934497+0000","last_became_active":"2024-09-13T17:24:19.488532+0000","last_became_peered":"2024-09-13T17:24:19.488532+0000","last_unstale":"2024-09-13T17:24:19.934497+0000","last_undegraded":"2024-09-13T17:24:19.934497+0000","last_fullsized":"2024-09-13T17:24:19.934497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.387959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470302+0000","last_change":"2024-09-13T17:24:15.465966+0000","last_active":"2024-09-13T17:24:19.470302+0000","last_peered":"2024-09-13T17:24:19.470302+0000","last_clean":"2024-09-13T17:24:19.470302+0000","last_became_active":"2024-09-13T17:24:15.465686+0000","last_became_peered":"2024-09-13T17:24:15.465686+0000","last_unstale":"2024-09-13T17:24:19.470302+0000","last_undegraded":"2024-09-13T17:24:19.470302+0000","last_fullsized":"2024-09-13T17:24:19.470302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462822+0000","last_change":"2024-09-13T17:24:15.447576+0000","last_active":"2024-09-13T17:24:19.462822+0000","last_peered":"2024-09-13T17:24:19.462822+0000","last_clean":"2024-09-13T17:24:19.462822+0000","last_became_active":"2024-09-13T17:24:15.447320+0000","last_became_peered":"2024-09-13T17:24:15.447320+0000","last_unstale":"2024-09-13T17:24:19.462822+0000","last_undegraded":"2024-09-13T17:24:19.462822+0000","last_fullsized":"2024-09-13T17:24:19.462822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:26.973977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.462939+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.462315+0000","last_became_peered":"2024-09-13T17:24:15.462315+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469473+0000","last_change":"2024-09-13T17:24:15.465949+0000","last_active":"2024-09-13T17:24:19.469473+0000","last_peered":"2024-09-13T17:24:19.469473+0000","last_clean":"2024-09-13T17:24:19.469473+0000","last_became_active":"2024-09-13T17:24:15.465644+0000","last_became_peered":"2024-09-13T17:24:15.465644+0000","last_unstale":"2024-09-13T17:24:19.469473+0000","last_undegraded":"2024-09-13T17:24:19.469473+0000","last_fullsized":"2024-09-13T17:24:19.469473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476759+0000","last_change":"2024-09-13T17:24:15.454116+0000","last_active":"2024-09-13T17:24:19.476759+0000","last_peered":"2024-09-13T17:24:19.476759+0000","last_clean":"2024-09-13T17:24:19.476759+0000","last_became_active":"2024-09-13T17:24:15.453864+0000","last_became_peered":"2024-09-13T17:24:15.453864+0000","last_unstale":"2024-09-13T17:24:19.476759+0000","last_undegraded":"2024-09-13T17:24:19.476759+0000","last_fullsized":"2024-09-13T17:24:19.476759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488559+0000","last_change":"2024-09-13T17:24:15.456865+0000","last_active":"2024-09-13T17:24:19.488559+0000","last_peered":"2024-09-13T17:24:19.488559+0000","last_clean":"2024-09-13T17:24:19.488559+0000","last_became_active":"2024-09-13T17:24:15.456631+0000","last_became_peered":"2024-09-13T17:24:15.456631+0000","last_unstale":"2024-09-13T17:24:19.488559+0000","last_undegraded":"2024-09-13T17:24:19.488559+0000","last_fullsized":"2024-09-13T17:24:19.488559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475054+0000","last_change":"2024-09-13T17:24:15.471072+0000","last_active":"2024-09-13T17:24:19.475054+0000","last_peered":"2024-09-13T17:24:19.475054+0000","last_clean":"2024-09-13T17:24:19.475054+0000","last_became_active":"2024-09-13T17:24:15.470861+0000","last_became_peered":"2024-09-13T17:24:15.470861+0000","last_unstale":"2024-09-13T17:24:19.475054+0000","last_undegraded":"2024-09-13T17:24:19.475054+0000","last_fullsized":"2024-09-13T17:24:19.475054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471745+0000","last_change":"2024-09-13T17:24:15.474755+0000","last_active":"2024-09-13T17:24:19.471745+0000","last_peered":"2024-09-13T17:24:19.471745+0000","last_clean":"2024-09-13T17:24:19.471745+0000","last_became_active":"2024-09-13T17:24:15.474492+0000","last_became_peered":"2024-09-13T17:24:15.474492+0000","last_unstale":"2024-09-13T17:24:19.471745+0000","last_undegraded":"2024-09-13T17:24:19.471745+0000","last_fullsized":"2024-09-13T17:24:19.471745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470293+0000","last_change":"2024-09-13T17:24:15.466413+0000","last_active":"2024-09-13T17:24:19.470293+0000","last_peered":"2024-09-13T17:24:19.470293+0000","last_clean":"2024-09-13T17:24:19.470293+0000","last_became_active":"2024-09-13T17:24:15.466175+0000","last_became_peered":"2024-09-13T17:24:15.466175+0000","last_unstale":"2024-09-13T17:24:19.470293+0000","last_undegraded":"2024-09-13T17:24:19.470293+0000","last_fullsized":"2024-09-13T17:24:19.470293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467831+0000","last_change":"2024-09-13T17:24:15.477779+0000","last_active":"2024-09-13T17:24:19.467831+0000","last_peered":"2024-09-13T17:24:19.467831+0000","last_clean":"2024-09-13T17:24:19.467831+0000","last_became_active":"2024-09-13T17:24:15.477570+0000","last_became_peered":"2024-09-13T17:24:15.477570+0000","last_unstale":"2024-09-13T17:24:19.467831+0000","last_undegraded":"2024-09-13T17:24:19.467831+0000","last_fullsized":"2024-09-13T17:24:19.467831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470760+0000","last_change":"2024-09-13T17:24:15.462997+0000","last_active":"2024-09-13T17:24:19.470760+0000","last_peered":"2024-09-13T17:24:19.470760+0000","last_clean":"2024-09-13T17:24:19.470760+0000","last_became_active":"2024-09-13T17:24:15.462681+0000","last_became_peered":"2024-09-13T17:24:15.462681+0000","last_unstale":"2024-09-13T17:24:19.470760+0000","last_undegraded":"2024-09-13T17:24:19.470760+0000","last_fullsized":"2024-09-13T17:24:19.470760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:25.475650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469238+0000","last_change":"2024-09-13T17:24:15.456978+0000","last_active":"2024-09-13T17:24:19.469238+0000","last_peered":"2024-09-13T17:24:19.469238+0000","last_clean":"2024-09-13T17:24:19.469238+0000","last_became_active":"2024-09-13T17:24:15.456755+0000","last_became_peered":"2024-09-13T17:24:15.456755+0000","last_unstale":"2024-09-13T17:24:19.469238+0000","last_undegraded":"2024-09-13T17:24:19.469238+0000","last_fullsized":"2024-09-13T17:24:19.469238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473078+0000","last_change":"2024-09-13T17:24:15.473844+0000","last_active":"2024-09-13T17:24:19.473078+0000","last_peered":"2024-09-13T17:24:19.473078+0000","last_clean":"2024-09-13T17:24:19.473078+0000","last_became_active":"2024-09-13T17:24:15.473173+0000","last_became_peered":"2024-09-13T17:24:15.473173+0000","last_unstale":"2024-09-13T17:24:19.473078+0000","last_undegraded":"2024-09-13T17:24:19.473078+0000","last_fullsized":"2024-09-13T17:24:19.473078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815161+0000","last_change":"2024-09-13T17:24:15.470097+0000","last_active":"2024-09-13T17:24:19.815161+0000","last_peered":"2024-09-13T17:24:19.815161+0000","last_clean":"2024-09-13T17:24:19.815161+0000","last_became_active":"2024-09-13T17:24:15.469838+0000","last_became_peered":"2024-09-13T17:24:15.469838+0000","last_unstale":"2024-09-13T17:24:19.815161+0000","last_undegraded":"2024-09-13T17:24:19.815161+0000","last_fullsized":"2024-09-13T17:24:19.815161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464607+0000","last_change":"2024-09-13T17:24:15.473774+0000","last_active":"2024-09-13T17:24:19.464607+0000","last_peered":"2024-09-13T17:24:19.464607+0000","last_clean":"2024-09-13T17:24:19.464607+0000","last_became_active":"2024-09-13T17:24:15.473399+0000","last_became_peered":"2024-09-13T17:24:15.473399+0000","last_unstale":"2024-09-13T17:24:19.464607+0000","last_undegraded":"2024-09-13T17:24:19.464607+0000","last_fullsized":"2024-09-13T17:24:19.464607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:26.844852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473438+0000","last_change":"2024-09-13T17:24:15.462760+0000","last_active":"2024-09-13T17:24:19.473438+0000","last_peered":"2024-09-13T17:24:19.473438+0000","last_clean":"2024-09-13T17:24:19.473438+0000","last_became_active":"2024-09-13T17:24:15.462524+0000","last_became_peered":"2024-09-13T17:24:15.462524+0000","last_unstale":"2024-09-13T17:24:19.473438+0000","last_undegraded":"2024-09-13T17:24:19.473438+0000","last_fullsized":"2024-09-13T17:24:19.473438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470212+0000","last_change":"2024-09-13T17:24:15.457282+0000","last_active":"2024-09-13T17:24:19.470212+0000","last_peered":"2024-09-13T17:24:19.470212+0000","last_clean":"2024-09-13T17:24:19.470212+0000","last_became_active":"2024-09-13T17:24:15.456356+0000","last_became_peered":"2024-09-13T17:24:15.456356+0000","last_unstale":"2024-09-13T17:24:19.470212+0000","last_undegraded":"2024-09-13T17:24:19.470212+0000","last_fullsized":"2024-09-13T17:24:19.470212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488232+0000","last_change":"2024-09-13T17:24:15.446263+0000","last_active":"2024-09-13T17:24:19.488232+0000","last_peered":"2024-09-13T17:24:19.488232+0000","last_clean":"2024-09-13T17:24:19.488232+0000","last_became_active":"2024-09-13T17:24:15.445995+0000","last_became_peered":"2024-09-13T17:24:15.445995+0000","last_unstale":"2024-09-13T17:24:19.488232+0000","last_undegraded":"2024-09-13T17:24:19.488232+0000","last_fullsized":"2024-09-13T17:24:19.488232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468673+0000","last_change":"2024-09-13T17:24:15.456257+0000","last_active":"2024-09-13T17:24:19.468673+0000","last_peered":"2024-09-13T17:24:19.468673+0000","last_clean":"2024-09-13T17:24:19.468673+0000","last_became_active":"2024-09-13T17:24:15.455665+0000","last_became_peered":"2024-09-13T17:24:15.455665+0000","last_unstale":"2024-09-13T17:24:19.468673+0000","last_undegraded":"2024-09-13T17:24:19.468673+0000","last_fullsized":"2024-09-13T17:24:19.468673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471558+0000","last_change":"2024-09-13T17:24:15.461978+0000","last_active":"2024-09-13T17:24:19.471558+0000","last_peered":"2024-09-13T17:24:19.471558+0000","last_clean":"2024-09-13T17:24:19.471558+0000","last_became_active":"2024-09-13T17:24:15.461755+0000","last_became_peered":"2024-09-13T17:24:15.461755+0000","last_unstale":"2024-09-13T17:24:19.471558+0000","last_undegraded":"2024-09-13T17:24:19.471558+0000","last_fullsized":"2024-09-13T17:24:19.471558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464237+0000","last_change":"2024-09-13T17:24:15.475629+0000","last_active":"2024-09-13T17:24:19.464237+0000","last_peered":"2024-09-13T17:24:19.464237+0000","last_clean":"2024-09-13T17:24:19.464237+0000","last_became_active":"2024-09-13T17:24:15.475274+0000","last_became_peered":"2024-09-13T17:24:15.475274+0000","last_unstale":"2024-09-13T17:24:19.464237+0000","last_undegraded":"2024-09-13T17:24:19.464237+0000","last_fullsized":"2024-09-13T17:24:19.464237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:10.483625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473012+0000","last_change":"2024-09-13T17:24:15.456332+0000","last_active":"2024-09-13T17:24:19.473012+0000","last_peered":"2024-09-13T17:24:19.473012+0000","last_clean":"2024-09-13T17:24:19.473012+0000","last_became_active":"2024-09-13T17:24:15.456082+0000","last_became_peered":"2024-09-13T17:24:15.456082+0000","last_unstale":"2024-09-13T17:24:19.473012+0000","last_undegraded":"2024-09-13T17:24:19.473012+0000","last_fullsized":"2024-09-13T17:24:19.473012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474972+0000","last_change":"2024-09-13T17:24:15.471584+0000","last_active":"2024-09-13T17:24:19.474972+0000","last_peered":"2024-09-13T17:24:19.474972+0000","last_clean":"2024-09-13T17:24:19.474972+0000","last_became_active":"2024-09-13T17:24:15.471359+0000","last_became_peered":"2024-09-13T17:24:15.471359+0000","last_unstale":"2024-09-13T17:24:19.474972+0000","last_undegraded":"2024-09-13T17:24:19.474972+0000","last_fullsized":"2024-09-13T17:24:19.474972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815205+0000","last_change":"2024-09-13T17:24:15.472777+0000","last_active":"2024-09-13T17:24:19.815205+0000","last_peered":"2024-09-13T17:24:19.815205+0000","last_clean":"2024-09-13T17:24:19.815205+0000","last_became_active":"2024-09-13T17:24:15.472470+0000","last_became_peered":"2024-09-13T17:24:15.472470+0000","last_unstale":"2024-09-13T17:24:19.815205+0000","last_undegraded":"2024-09-13T17:24:19.815205+0000","last_fullsized":"2024-09-13T17:24:19.815205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466323+0000","last_change":"2024-09-13T17:24:15.452755+0000","last_active":"2024-09-13T17:24:19.466323+0000","last_peered":"2024-09-13T17:24:19.466323+0000","last_clean":"2024-09-13T17:24:19.466323+0000","last_became_active":"2024-09-13T17:24:15.452538+0000","last_became_peered":"2024-09-13T17:24:15.452538+0000","last_unstale":"2024-09-13T17:24:19.466323+0000","last_undegraded":"2024-09-13T17:24:19.466323+0000","last_fullsized":"2024-09-13T17:24:19.466323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814329+0000","last_change":"2024-09-13T17:24:15.464963+0000","last_active":"2024-09-13T17:24:19.814329+0000","last_peered":"2024-09-13T17:24:19.814329+0000","last_clean":"2024-09-13T17:24:19.814329+0000","last_became_active":"2024-09-13T17:24:15.464655+0000","last_became_peered":"2024-09-13T17:24:15.464655+0000","last_unstale":"2024-09-13T17:24:19.814329+0000","last_undegraded":"2024-09-13T17:24:19.814329+0000","last_fullsized":"2024-09-13T17:24:19.814329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471402+0000","last_change":"2024-09-13T17:24:15.466816+0000","last_active":"2024-09-13T17:24:19.471402+0000","last_peered":"2024-09-13T17:24:19.471402+0000","last_clean":"2024-09-13T17:24:19.471402+0000","last_became_active":"2024-09-13T17:24:15.464574+0000","last_became_peered":"2024-09-13T17:24:15.464574+0000","last_unstale":"2024-09-13T17:24:19.471402+0000","last_undegraded":"2024-09-13T17:24:19.471402+0000","last_fullsized":"2024-09-13T17:24:19.471402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814245+0000","last_change":"2024-09-13T17:24:15.470250+0000","last_active":"2024-09-13T17:24:19.814245+0000","last_peered":"2024-09-13T17:24:19.814245+0000","last_clean":"2024-09-13T17:24:19.814245+0000","last_became_active":"2024-09-13T17:24:15.469321+0000","last_became_peered":"2024-09-13T17:24:15.469321+0000","last_unstale":"2024-09-13T17:24:19.814245+0000","last_undegraded":"2024-09-13T17:24:19.814245+0000","last_fullsized":"2024-09-13T17:24:19.814245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.469790+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.469232+0000","last_became_peered":"2024-09-13T17:24:15.469232+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476283+0000","last_change":"2024-09-13T17:24:15.454215+0000","last_active":"2024-09-13T17:24:19.476283+0000","last_peered":"2024-09-13T17:24:19.476283+0000","last_clean":"2024-09-13T17:24:19.476283+0000","last_became_active":"2024-09-13T17:24:15.451536+0000","last_became_peered":"2024-09-13T17:24:15.451536+0000","last_unstale":"2024-09-13T17:24:19.476283+0000","last_undegraded":"2024-09-13T17:24:19.476283+0000","last_fullsized":"2024-09-13T17:24:19.476283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.491024+0000","last_change":"2024-09-13T17:24:15.443088+0000","last_active":"2024-09-13T17:24:19.491024+0000","last_peered":"2024-09-13T17:24:19.491024+0000","last_clean":"2024-09-13T17:24:19.491024+0000","last_became_active":"2024-09-13T17:24:15.442849+0000","last_became_peered":"2024-09-13T17:24:15.442849+0000","last_unstale":"2024-09-13T17:24:19.491024+0000","last_undegraded":"2024-09-13T17:24:19.491024+0000","last_fullsized":"2024-09-13T17:24:19.491024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814892+0000","last_change":"2024-09-13T17:24:15.462869+0000","last_active":"2024-09-13T17:24:19.814892+0000","last_peered":"2024-09-13T17:24:19.814892+0000","last_clean":"2024-09-13T17:24:19.814892+0000","last_became_active":"2024-09-13T17:24:15.462623+0000","last_became_peered":"2024-09-13T17:24:15.462623+0000","last_unstale":"2024-09-13T17:24:19.814892+0000","last_undegraded":"2024-09-13T17:24:19.814892+0000","last_fullsized":"2024-09-13T17:24:19.814892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.637}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:42.367 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:24:42.367 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:24:42.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:24:42.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T17:24:42.369 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T17:24:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5ee00700 1 Processor -- start 2024-09-13T17:24:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5ee00700 1 -- start start 2024-09-13T17:24:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5ee00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b58146690 0x7f6b580d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5ee00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580b1740 con 0x7f6b5815e030 2024-09-13T17:24:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5ee00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5815e4c0 con 0x7f6b580d1740 2024-09-13T17:24:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5ee00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580d08c0 con 0x7f6b58146690 2024-09-13T17:24:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5d000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6b5815e030 0x7f6b580d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47442/0 (socket says 172.21.15.139:47442) 2024-09-13T17:24:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5d000700 1 -- 172.21.15.139:0/1533345932 learned_addr learned my addr 172.21.15.139:0/1533345932 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.595+0000 7f6b5da00700 1 --2- 172.21.15.139:0/1533345932 >> v2:172.21.15.176:3300/0 conn(0x7f6b58146690 0x7f6b580d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b57e00700 1 -- 172.21.15.139:0/1533345932 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551012511 0 0) 0x7f6b580b1740 con 0x7f6b5815e030 2024-09-13T17:24:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b57e00700 1 -- 172.21.15.139:0/1533345932 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b400035d0 con 0x7f6b5815e030 2024-09-13T17:24:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b57e00700 1 -- 172.21.15.139:0/1533345932 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662606801 0 0) 0x7f6b5815e4c0 con 0x7f6b580d1740 2024-09-13T17:24:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5da00700 1 -- 172.21.15.139:0/1533345932 >> v1:172.21.15.176:6789/0 conn(0x7f6b580d1740 legacy=0x7f6b580b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5da00700 1 -- 172.21.15.139:0/1533345932 >> v1:172.21.15.139:6789/0 conn(0x7f6b5815e030 legacy=0x7f6b580d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5da00700 1 -- 172.21.15.139:0/1533345932 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580b1990 con 0x7f6b58146690 2024-09-13T17:24:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5da00700 1 --2- 172.21.15.139:0/1533345932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b580d0380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009850 tx=0x7f6b4c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d907069a546c6744 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b57e00700 1 -- 172.21.15.139:0/1533345932 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c011830 con 0x7f6b58146690 2024-09-13T17:24:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b57e00700 1 -- 172.21.15.139:0/1533345932 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c011990 con 0x7f6b58146690 2024-09-13T17:24:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b57e00700 1 -- 172.21.15.139:0/1533345932 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c011d40 con 0x7f6b58146690 2024-09-13T17:24:42.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 -- 172.21.15.139:0/1533345932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 msgr2=0x7f6b580d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/1533345932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b580d0380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009850 tx=0x7f6b4c009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:42.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 -- 172.21.15.139:0/1533345932 shutdown_connections 2024-09-13T17:24:42.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/1533345932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b580d0380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 -- 172.21.15.139:0/1533345932 >> 172.21.15.139:0/1533345932 conn(0x7f6b58071fa0 msgr2=0x7f6b58072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:42.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 -- 172.21.15.139:0/1533345932 shutdown_connections 2024-09-13T17:24:42.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.599+0000 7f6b5ee00700 1 -- 172.21.15.139:0/1533345932 wait complete. 2024-09-13T17:24:42.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 Processor -- start 2024-09-13T17:24:42.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 -- start start 2024-09-13T17:24:42.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b580d1740 0x7f6b580ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b581374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 0x7f6b5806e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580cd2c0 con 0x7f6b5815e030 2024-09-13T17:24:42.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58144410 con 0x7f6b58146690 2024-09-13T17:24:42.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5ee00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b581379e0 con 0x7f6b580d1740 2024-09-13T17:24:42.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5e400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 0x7f6b5806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5e400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 0x7f6b5806e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37198/0 (socket says 172.21.15.139:37198) 2024-09-13T17:24:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5e400700 1 -- 172.21.15.139:0/3642274556 learned_addr learned my addr 172.21.15.139:0/3642274556 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5da00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b580d1740 0x7f6b580ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.603+0000 7f6b5d000700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b581374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5e400700 1 -- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b580d1740 msgr2=0x7f6b580ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5e400700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b580d1740 0x7f6b580ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5e400700 1 -- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 msgr2=0x7f6b581374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5e400700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b581374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5e400700 1 -- 172.21.15.139:0/3642274556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0094b0 con 0x7f6b5815e030 2024-09-13T17:24:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5d000700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b581374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5e400700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 0x7f6b5806e560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000cc70 tx=0x7f6b5000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50003e50 con 0x7f6b5815e030 2024-09-13T17:24:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b581446b0 con 0x7f6b5815e030 2024-09-13T17:24:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5000a7a0 con 0x7f6b5815e030 2024-09-13T17:24:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000ab50 con 0x7f6b5815e030 2024-09-13T17:24:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58144c70 con 0x7f6b5815e030 2024-09-13T17:24:42.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b580677e0 con 0x7f6b5815e030 2024-09-13T17:24:42.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.607+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b5000acb0 con 0x7f6b5815e030 2024-09-13T17:24:42.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.611+0000 7f6b55600700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6b38066730 0x7f6b38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:42.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.611+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b50084110 con 0x7f6b5815e030 2024-09-13T17:24:42.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.611+0000 7f6b5da00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6b38066730 0x7f6b38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:42.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.611+0000 7f6b5da00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6b38066730 0x7f6b38068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0090b0 tx=0x7f6b4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.619+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b50050fe0 con 0x7f6b5815e030 2024-09-13T17:24:42.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.847+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6b58144e90 con 0x7f6b5815e030 2024-09-13T17:24:42.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.851+0000 7f6b55600700 1 -- 172.21.15.139:0/3642274556 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164906 (secure 0 0 0) 0x7f6b50054600 con 0x7f6b5815e030 2024-09-13T17:24:42.860 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:42.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6b38066730 msgr2=0x7f6b38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6b38066730 0x7f6b38068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0090b0 tx=0x7f6b4c008030 comp rx=0 tx=0).stop 2024-09-13T17:24:42.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 msgr2=0x7f6b5806e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:42.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 0x7f6b5806e560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000cc70 tx=0x7f6b5000cf80 comp rx=0 tx=0).stop 2024-09-13T17:24:42.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 shutdown_connections 2024-09-13T17:24:42.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6b38066730 0x7f6b38068bf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b5815e030 0x7f6b5806e560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b58146690 0x7f6b581374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 --2- 172.21.15.139:0/3642274556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b580d1740 0x7f6b580ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:42.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 >> 172.21.15.139:0/3642274556 conn(0x7f6b58071fa0 msgr2=0x7f6b5806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:42.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 shutdown_connections 2024-09-13T17:24:42.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:42.859+0000 7f6b5ee00700 1 -- 172.21.15.139:0/3642274556 wait complete. 2024-09-13T17:24:42.882 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3612810800},{"type":"v1","addr":"172.21.15.139:6833","nonce":3612810800}]},"active_addr":"172.21.15.139:6833/3612810800","active_change":"2024-09-13T17:23:58.059758+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":1151495076}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":3153492983}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":312835695}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":2707869445}]}]} 2024-09-13T17:24:42.889 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T17:24:42.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T17:24:42.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:43.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.059+0000 7f6756a00700 1 Processor -- start 2024-09-13T17:24:43.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.059+0000 7f6756a00700 1 -- start start 2024-09-13T17:24:43.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6756a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071190 0x7f675015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6756a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f675013f810 0x7f675013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6756a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675013f0c0 con 0x7f6750071570 2024-09-13T17:24:43.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6756a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675015a720 con 0x7f675013f810 2024-09-13T17:24:43.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6756a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675015aa00 con 0x7f6750071190 2024-09-13T17:24:43.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6755600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071190 0x7f675015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6754c00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6750071570 0x7f6750159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47454/0 (socket says 172.21.15.139:47454) 2024-09-13T17:24:43.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6754c00700 1 -- 172.21.15.139:0/4176718788 learned_addr learned my addr 172.21.15.139:0/4176718788 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:43.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6756000700 1 --2- 172.21.15.139:0/4176718788 >> v2:172.21.15.176:3300/0 conn(0x7f675013f810 0x7f675013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6755600700 1 -- 172.21.15.139:0/4176718788 >> v2:172.21.15.176:3300/0 conn(0x7f675013f810 msgr2=0x7f675013fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:43.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6755600700 1 --2- 172.21.15.139:0/4176718788 >> v2:172.21.15.176:3300/0 conn(0x7f675013f810 0x7f675013fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6755600700 1 -- 172.21.15.139:0/4176718788 >> v1:172.21.15.139:6789/0 conn(0x7f6750071570 legacy=0x7f6750159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6755600700 1 -- 172.21.15.139:0/4176718788 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675015ace0 con 0x7f6750071190 2024-09-13T17:24:43.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.063+0000 7f6755600700 1 --2- 172.21.15.139:0/4176718788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071190 0x7f675015dfd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6744009850 tx=0x7f6744009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3794870a920a24d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f674fe00700 1 -- 172.21.15.139:0/4176718788 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744011830 con 0x7f6750071190 2024-09-13T17:24:43.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f674fe00700 1 -- 172.21.15.139:0/4176718788 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6744011990 con 0x7f6750071190 2024-09-13T17:24:43.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f674fe00700 1 -- 172.21.15.139:0/4176718788 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744011d20 con 0x7f6750071190 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 -- 172.21.15.139:0/4176718788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071190 msgr2=0x7f675015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 --2- 172.21.15.139:0/4176718788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071190 0x7f675015dfd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6744009850 tx=0x7f6744009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 -- 172.21.15.139:0/4176718788 shutdown_connections 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 --2- 172.21.15.139:0/4176718788 >> v2:172.21.15.176:3300/0 conn(0x7f675013f810 0x7f675013fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 --2- 172.21.15.139:0/4176718788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071190 0x7f675015dfd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 -- 172.21.15.139:0/4176718788 >> 172.21.15.139:0/4176718788 conn(0x7f67500ce9d0 msgr2=0x7f67500cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 -- 172.21.15.139:0/4176718788 shutdown_connections 2024-09-13T17:24:43.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 -- 172.21.15.139:0/4176718788 wait complete. 2024-09-13T17:24:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.067+0000 7f6756a00700 1 Processor -- start 2024-09-13T17:24:43.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 -- start start 2024-09-13T17:24:43.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 0x7f67501413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071570 0x7f6750158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f675013f810 0x7f67500c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501f3900 con 0x7f6750071190 2024-09-13T17:24:43.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501f2cf0 con 0x7f675013f810 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67501f2fd0 con 0x7f6750071570 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 0x7f67501413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 0x7f67501413f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37210/0 (socket says 172.21.15.139:37210) 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 -- 172.21.15.139:0/1030676413 learned_addr learned my addr 172.21.15.139:0/1030676413 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6754c00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071570 0x7f6750158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756000700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f675013f810 0x7f67500c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 -- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071570 msgr2=0x7f6750158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071570 0x7f6750158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 -- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f675013f810 msgr2=0x7f67500c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f675013f810 0x7f67500c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 -- 172.21.15.139:0/1030676413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440094b0 con 0x7f6750071190 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756000700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f675013f810 0x7f67500c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6755600700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 0x7f67501413f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6744000c00 tx=0x7f6744004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744004570 con 0x7f6750071190 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67501f32b0 con 0x7f6750071190 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.071+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674401f070 con 0x7f6750071190 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.075+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67440038c0 con 0x7f6750071190 2024-09-13T17:24:43.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.075+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6750141930 con 0x7f6750071190 2024-09-13T17:24:43.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.075+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6750073020 con 0x7f6750071190 2024-09-13T17:24:43.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.075+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6744021030 con 0x7f6750071190 2024-09-13T17:24:43.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.079+0000 7f674d600700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6730066730 0x7f6730068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.079+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6744085b20 con 0x7f6750071190 2024-09-13T17:24:43.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.079+0000 7f6754c00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6730066730 0x7f6730068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.079+0000 7f6754c00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6730066730 0x7f6730068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67500cb7c0 tx=0x7f673c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.087+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6744052b10 con 0x7f6750071190 2024-09-13T17:24:43.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.279+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f675013d6b0 con 0x7f6750071190 2024-09-13T17:24:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.279+0000 7f674d600700 1 -- 172.21.15.139:0/1030676413 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f6744056130 con 0x7f6750071190 2024-09-13T17:24:43.285 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:43.285 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:43.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6730066730 msgr2=0x7f6730068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6730066730 0x7f6730068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67500cb7c0 tx=0x7f673c009040 comp rx=0 tx=0).stop 2024-09-13T17:24:43.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 msgr2=0x7f67501413f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 0x7f67501413f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6744000c00 tx=0x7f6744004770 comp rx=0 tx=0).stop 2024-09-13T17:24:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 shutdown_connections 2024-09-13T17:24:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6730066730 0x7f6730068bf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f675013f810 0x7f67500c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750071570 0x7f6750158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 --2- 172.21.15.139:0/1030676413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6750071190 0x7f67501413f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.283+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 >> 172.21.15.139:0/1030676413 conn(0x7f67500ce9d0 msgr2=0x7f67500b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:43.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.287+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 shutdown_connections 2024-09-13T17:24:43.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.287+0000 7f6756a00700 1 -- 172.21.15.139:0/1030676413 wait complete. 2024-09-13T17:24:43.312 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T17:24:43.313 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:43.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.487+0000 7fa652c00700 1 Processor -- start 2024-09-13T17:24:43.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.487+0000 7fa652c00700 1 -- start start 2024-09-13T17:24:43.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.487+0000 7fa652c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 0x7fa64c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa64c06bc30 0x7fa64c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c06c570 con 0x7fa64c0cdd60 2024-09-13T17:24:43.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c0cbef0 con 0x7fa64c06bc30 2024-09-13T17:24:43.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c1400b0 con 0x7fa64c13ed40 2024-09-13T17:24:43.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 0x7fa64c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 0x7fa64c0cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44120/0 (socket says 172.21.15.139:44120) 2024-09-13T17:24:43.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 -- 172.21.15.139:0/143848601 learned_addr learned my addr 172.21.15.139:0/143848601 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:43.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64b400700 1 --2- 172.21.15.139:0/143848601 >> v2:172.21.15.176:3300/0 conn(0x7fa64c06bc30 0x7fa64c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 -- 172.21.15.139:0/143848601 >> v2:172.21.15.176:3300/0 conn(0x7fa64c06bc30 msgr2=0x7fa64c06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:43.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 --2- 172.21.15.139:0/143848601 >> v2:172.21.15.176:3300/0 conn(0x7fa64c06bc30 0x7fa64c06c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 -- 172.21.15.139:0/143848601 >> v1:172.21.15.176:6789/0 conn(0x7fa64c0cdd60 legacy=0x7fa64c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 -- 172.21.15.139:0/143848601 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0cb830 con 0x7fa64c13ed40 2024-09-13T17:24:43.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64be00700 1 --2- 172.21.15.139:0/143848601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 0x7fa64c0cc310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009910 tx=0x7fa63c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150c986c07a3aa76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64aa00700 1 -- 172.21.15.139:0/143848601 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c011830 con 0x7fa64c13ed40 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64aa00700 1 -- 172.21.15.139:0/143848601 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c011990 con 0x7fa64c13ed40 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa64aa00700 1 -- 172.21.15.139:0/143848601 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c011d40 con 0x7fa64c13ed40 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- 172.21.15.139:0/143848601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 msgr2=0x7fa64c0cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 --2- 172.21.15.139:0/143848601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 0x7fa64c0cc310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009910 tx=0x7fa63c009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- 172.21.15.139:0/143848601 shutdown_connections 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 --2- 172.21.15.139:0/143848601 >> v2:172.21.15.176:3300/0 conn(0x7fa64c06bc30 0x7fa64c06c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 --2- 172.21.15.139:0/143848601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c13ed40 0x7fa64c0cc310 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- 172.21.15.139:0/143848601 >> 172.21.15.139:0/143848601 conn(0x7fa64c070b70 msgr2=0x7fa64c070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- 172.21.15.139:0/143848601 shutdown_connections 2024-09-13T17:24:43.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.491+0000 7fa652c00700 1 -- 172.21.15.139:0/143848601 wait complete. 2024-09-13T17:24:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 Processor -- start 2024-09-13T17:24:43.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 -- start start 2024-09-13T17:24:43.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa64c06bc30 0x7fa64c15f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c0cdd60 0x7fa64c155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 0x7fa64c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c13e520 con 0x7fa64c13ed40 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c160b80 con 0x7fa64c06bc30 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.495+0000 7fa652c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c15eb40 con 0x7fa64c0cdd60 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 0x7fa64c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 0x7fa64c1571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37216/0 (socket says 172.21.15.139:37216) 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 -- 172.21.15.139:0/1466818508 learned_addr learned my addr 172.21.15.139:0/1466818508 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa64be00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa64c06bc30 0x7fa64c15f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa64b400700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c0cdd60 0x7fa64c155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 -- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c0cdd60 msgr2=0x7fa64c155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c0cdd60 0x7fa64c155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 -- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa64c06bc30 msgr2=0x7fa64c15f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa64c06bc30 0x7fa64c15f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 -- 172.21.15.139:0/1466818508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009570 con 0x7fa64c13ed40 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa650c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 0x7fa64c1571b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa64400cc50 tx=0x7fa64400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644003c20 con 0x7fa64c13ed40 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644003d80 con 0x7fa64c13ed40 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c15ee20 con 0x7fa64c13ed40 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64400aab0 con 0x7fa64c13ed40 2024-09-13T17:24:43.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c1564b0 con 0x7fa64c13ed40 2024-09-13T17:24:43.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.499+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c15e9a0 con 0x7fa64c13ed40 2024-09-13T17:24:43.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.503+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa64400ac10 con 0x7fa64c13ed40 2024-09-13T17:24:43.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.503+0000 7fa643e00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa62c066730 0x7fa62c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.503+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa6440844d0 con 0x7fa64c13ed40 2024-09-13T17:24:43.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.503+0000 7fa64be00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa62c066730 0x7fa62c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.503+0000 7fa64be00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa62c066730 0x7fa62c068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa63c000c00 tx=0x7fa63c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.511+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa64c15e9a0 con 0x7fa64c13ed40 2024-09-13T17:24:43.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.707+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa64c15e9a0 con 0x7fa64c13ed40 2024-09-13T17:24:43.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.711+0000 7fa643e00700 1 -- 172.21.15.139:0/1466818508 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7fa64c15e9a0 con 0x7fa64c13ed40 2024-09-13T17:24:43.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:43.714 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:43.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa62c066730 msgr2=0x7fa62c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa62c066730 0x7fa62c068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa63c000c00 tx=0x7fa63c008030 comp rx=0 tx=0).stop 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 msgr2=0x7fa64c1571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 0x7fa64c1571b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa64400cc50 tx=0x7fa64400cf60 comp rx=0 tx=0).stop 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 shutdown_connections 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa62c066730 0x7fa62c068bf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c13ed40 0x7fa64c1571b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa64c0cdd60 0x7fa64c155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 --2- 172.21.15.139:0/1466818508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa64c06bc30 0x7fa64c15f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 >> 172.21.15.139:0/1466818508 conn(0x7fa64c070b70 msgr2=0x7fa64c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 shutdown_connections 2024-09-13T17:24:43.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.715+0000 7fa652c00700 1 -- 172.21.15.139:0/1466818508 wait complete. 2024-09-13T17:24:43.742 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T17:24:43.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T17:24:43.744 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T17:24:43.744 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T17:24:43.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T17:24:43.746 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T17:24:43.746 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T17:24:43.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T17:24:43.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.975+0000 7f8966200700 1 Processor -- start 2024-09-13T17:24:43.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.975+0000 7f8966200700 1 -- start start 2024-09-13T17:24:43.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.975+0000 7f55f6400700 1 Processor -- start 2024-09-13T17:24:43.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.975+0000 7f55f6400700 1 -- start start 2024-09-13T17:24:43.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.975+0000 7fd1f2a00700 1 Processor -- start 2024-09-13T17:24:43.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2a00700 1 -- start start 2024-09-13T17:24:43.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f6400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55e8033640 0x7f55e804ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fcee5a00700 1 Processor -- start 2024-09-13T17:24:43.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f5000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f55e80360d0 0x7f55e80364b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47470/0 (socket says 172.21.15.139:47470) 2024-09-13T17:24:43.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8964e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f896013e510 0x7f896013bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51774/0 (socket says 172.21.15.139:51774) 2024-09-13T17:24:43.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f6400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e80071c0 con 0x7f55e80360d0 2024-09-13T17:24:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f6400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e8006e90 con 0x7f55e8033b90 2024-09-13T17:24:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 0x7fd1ec13bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd1ec06fe10 0x7fd1ec070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f6400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e80e2f80 con 0x7f55e8033640 2024-09-13T17:24:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f5000700 1 -- 172.21.15.139:0/112615498 learned_addr learned my addr 172.21.15.139:0/112615498 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8966200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f896013e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd1ec13e480 0x7fd1ec15c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47478/0 (socket says 172.21.15.139:47478) 2024-09-13T17:24:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fcee5a00700 1 -- start start 2024-09-13T17:24:43.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8966200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f896006fe10 0x7f8960070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2000700 1 -- 172.21.15.139:0/3729224168 learned_addr learned my addr 172.21.15.139:0/3729224168 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:43.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8966200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896013f1f0 con 0x7f896013e510 2024-09-13T17:24:43.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8966200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89600707a0 con 0x7f896006fe10 2024-09-13T17:24:43.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8966200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8960070980 con 0x7f89600b01d0 2024-09-13T17:24:43.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f1600700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 0x7fd1ec13bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8964e00700 1 -- 172.21.15.139:0/3838809899 learned_addr learned my addr 172.21.15.139:0/3838809899 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:43.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fe86ca00700 1 Processor -- start 2024-09-13T17:24:43.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f55f5a00700 1 --2- 172.21.15.139:0/112615498 >> v2:172.21.15.176:3300/0 conn(0x7f55e8033640 0x7f55e804ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec15f9e0 con 0x7fd1ec13e480 2024-09-13T17:24:43.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f895fe00700 1 --2- 172.21.15.139:0/3838809899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f896013e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/3729224168 >> v2:172.21.15.139:3300/0 conn(0x7fd1ec06fe10 0x7fd1ec070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7f8965800700 1 --2- 172.21.15.139:0/3838809899 >> v2:172.21.15.139:3300/0 conn(0x7f896006fe10 0x7f8960070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.979+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec070790 con 0x7fd1ec06fe10 2024-09-13T17:24:43.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec13f1f0 con 0x7fd1ec0b01d0 2024-09-13T17:24:43.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f6441000700 1 Processor -- start 2024-09-13T17:24:43.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854903536 0 0) 0x7fd1ec15f9e0 con 0x7fd1ec13e480 2024-09-13T17:24:43.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe86ca00700 1 -- start start 2024-09-13T17:24:43.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d40035d0 con 0x7fd1ec13e480 2024-09-13T17:24:43.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498852633 0 0) 0x7f55e8006e90 con 0x7f55e8033b90 2024-09-13T17:24:43.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d80035d0 con 0x7f55e8033b90 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199502643 0 0) 0x7fd1d40035d0 con 0x7fd1ec13e480 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 msgr2=0x7fd1ec13bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 0x7fd1ec13bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 >> v2:172.21.15.139:3300/0 conn(0x7fd1ec06fe10 msgr2=0x7fd1ec070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 --2- 172.21.15.139:0/3729224168 >> v2:172.21.15.139:3300/0 conn(0x7fd1ec06fe10 0x7fd1ec070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec070980 con 0x7fd1ec13e480 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7fd1e40019f0 con 0x7fd1ec13e480 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 >> v1:172.21.15.139:6789/0 conn(0x7fd1ec13e480 legacy=0x7fd1ec15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4003a20 0x7fd1d4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1d4004870 0x7fd1d4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 0x7fd1d4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec13f1f0 con 0x7fd1d4003a20 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d400ba30 con 0x7fd1d4004870 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d400bb70 con 0x7fd1ec0b01d0 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fab44a00700 1 Processor -- start 2024-09-13T17:24:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554938439 0 0) 0x7f55e80071c0 con 0x7f55e80360d0 2024-09-13T17:24:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e8006e90 con 0x7f55e80360d0 2024-09-13T17:24:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f895fe00700 1 -- 172.21.15.139:0/3838809899 >> v2:172.21.15.139:3300/0 conn(0x7f896006fe10 msgr2=0x7f8960070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f895fe00700 1 --2- 172.21.15.139:0/3838809899 >> v2:172.21.15.139:3300/0 conn(0x7f896006fe10 0x7f8960070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f895fe00700 1 -- 172.21.15.139:0/3838809899 >> v1:172.21.15.176:6789/0 conn(0x7f896013e510 legacy=0x7f896013bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f895fe00700 1 -- 172.21.15.139:0/3838809899 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960070c60 con 0x7f89600b01d0 2024-09-13T17:24:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55f5a00700 1 -- 172.21.15.139:0/112615498 >> v1:172.21.15.176:6789/0 conn(0x7f55e8033b90 legacy=0x7f55e8009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71013269 0 0) 0x7f55d80035d0 con 0x7f55e8033b90 2024-09-13T17:24:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55f5a00700 1 -- 172.21.15.139:0/112615498 >> v1:172.21.15.139:6789/0 conn(0x7f55e80360d0 legacy=0x7f55e80364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1d4004870 0x7fd1d4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55f5a00700 1 -- 172.21.15.139:0/112615498 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80552c0 con 0x7f55e8033640 2024-09-13T17:24:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f1600700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4003a20 0x7fd1d4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f0c00700 1 -- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 msgr2=0x7fd1d4005230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:24:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b01d0 0x7fd1d4005230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f0c00700 1 -- 172.21.15.139:0/3729224168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4003a20 msgr2=0x7fd1d4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4003a20 0x7fd1d4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fd1f0c00700 1 -- 172.21.15.139:0/3729224168 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40035d0 con 0x7fd1d4004870 2024-09-13T17:24:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55f5a00700 1 --2- 172.21.15.139:0/112615498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e8033640 0x7f55e804ec10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55f0063cf0 tx=0x7f55f00675a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d7088faf8c9e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f6441000700 1 -- start start 2024-09-13T17:24:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc001670 con 0x7f55e8033640 2024-09-13T17:24:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe86ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 0x7fe86815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe86ca00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680ad080 con 0x7fe8680b3650 2024-09-13T17:24:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe86ca00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86806dab0 con 0x7fe86815dbf0 2024-09-13T17:24:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe86ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86806dd90 con 0x7fe8680ad510 2024-09-13T17:24:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f0067610 con 0x7f55e8033640 2024-09-13T17:24:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fcee5a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcee013e8f0 0x7fcee006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fcee5a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee0070750 con 0x7fcee013e510 2024-09-13T17:24:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fcee5a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee013f220 con 0x7fcee0070350 2024-09-13T17:24:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fcee5a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee013ed60 con 0x7fcee013e8f0 2024-09-13T17:24:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f6441000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f643c06b810 0x7f643c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe85fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 0x7fe86815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe85fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 0x7fe86815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44142/0 (socket says 172.21.15.139:44142) 2024-09-13T17:24:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fe85fe00700 1 -- 172.21.15.139:0/386726462 learned_addr learned my addr 172.21.15.139:0/386726462 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f55ef400700 1 -- 172.21.15.139:0/112615498 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f004ef50 con 0x7f55e8033640 2024-09-13T17:24:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f6441000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c06a770 con 0x7f643c0672c0 2024-09-13T17:24:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f6441000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c06aa50 con 0x7f643c158cd0 2024-09-13T17:24:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f6441000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c06b3f0 con 0x7f643c06b810 2024-09-13T17:24:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f643b400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f643c158cd0 0x7f643c0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51810/0 (socket says 172.21.15.139:51810) 2024-09-13T17:24:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7f643b400700 1 -- 172.21.15.139:0/575593377 learned_addr learned my addr 172.21.15.139:0/575593377 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fcee5000700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fcee0070350 0x7fcee013c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51798/0 (socket says 172.21.15.139:51798) 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fcee5000700 1 -- 172.21.15.139:0/434109695 learned_addr learned my addr 172.21.15.139:0/434109695 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.983+0000 7fab44a00700 1 -- start start 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab44a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fab4013d440 0x7fab40163a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab44a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4013f220 con 0x7fab4013e510 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab44a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4013ed60 con 0x7fab4013e8f0 2024-09-13T17:24:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab44a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab40070980 con 0x7fab4013d440 2024-09-13T17:24:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6433e00700 1 --2- 172.21.15.139:0/575593377 >> v2:172.21.15.139:3300/0 conn(0x7f643c06b810 0x7f643c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedf400700 1 --2- 172.21.15.139:0/434109695 >> v2:172.21.15.176:3300/0 conn(0x7fcee013e8f0 0x7fcee006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe85fe00700 1 -- 172.21.15.139:0/386726462 >> v1:172.21.15.176:6789/0 conn(0x7fe86815dbf0 legacy=0x7fe86806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe85fe00700 1 -- 172.21.15.139:0/386726462 >> v1:172.21.15.139:6789/0 conn(0x7fe8680b3650 legacy=0x7fe868071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe85fe00700 1 -- 172.21.15.139:0/386726462 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8680aca30 con 0x7fe8680ad510 2024-09-13T17:24:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3de00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fab4013e8f0 0x7fab4006fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51824/0 (socket says 172.21.15.139:51824) 2024-09-13T17:24:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6433e00700 1 -- 172.21.15.139:0/575593377 >> v1:172.21.15.176:6789/0 conn(0x7f643c158cd0 legacy=0x7f643c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6433e00700 1 -- 172.21.15.139:0/575593377 >> v1:172.21.15.139:6789/0 conn(0x7f643c0672c0 legacy=0x7f643c163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6433e00700 1 -- 172.21.15.139:0/575593377 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c06ad30 con 0x7f643c06b810 2024-09-13T17:24:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f895fe00700 1 --2- 172.21.15.139:0/3838809899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f896013e8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8950009850 tx=0x7f8950009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc8a98acac38362 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f895f400700 1 -- 172.21.15.139:0/3838809899 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011830 con 0x7f89600b01d0 2024-09-13T17:24:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 -- 172.21.15.139:0/112615498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e8033640 msgr2=0x7f55e804ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 --2- 172.21.15.139:0/112615498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e8033640 0x7f55e804ec10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55f0063cf0 tx=0x7f55f00675a0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f895f400700 1 -- 172.21.15.139:0/3838809899 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950011990 con 0x7f89600b01d0 2024-09-13T17:24:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f895f400700 1 -- 172.21.15.139:0/3838809899 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011d40 con 0x7f89600b01d0 2024-09-13T17:24:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1d4004870 0x7fd1d4004cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009b70 tx=0x7fd1d40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b986ce5e1c94ce50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3de00700 1 -- 172.21.15.139:0/1498835496 learned_addr learned my addr 172.21.15.139:0/1498835496 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 -- 172.21.15.139:0/112615498 shutdown_connections 2024-09-13T17:24:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 --2- 172.21.15.139:0/112615498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e8033640 0x7f55e804ec10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 -- 172.21.15.139:0/112615498 >> 172.21.15.139:0/112615498 conn(0x7f55e801d9e0 msgr2=0x7f55e8054650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3f200700 1 --2- 172.21.15.139:0/1498835496 >> v2:172.21.15.139:3300/0 conn(0x7fab4013d440 0x7fab40163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6433e00700 1 --2- 172.21.15.139:0/575593377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c06b810 0x7f643c0705c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6424009850 tx=0x7f6424009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0d66db3585312d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800e6c0 con 0x7fd1d4004870 2024-09-13T17:24:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800e820 con 0x7fd1d4004870 2024-09-13T17:24:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1ebe00700 1 -- 172.21.15.139:0/3729224168 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800eb90 con 0x7fd1d4004870 2024-09-13T17:24:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f643aa00700 1 -- 172.21.15.139:0/575593377 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400b830 con 0x7f643c06b810 2024-09-13T17:24:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299226815 0 0) 0x7fcee013f220 con 0x7fcee0070350 2024-09-13T17:24:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec40035d0 con 0x7fcee0070350 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404600785 0 0) 0x7fcee0070750 con 0x7fcee013e510 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee013f220 con 0x7fcee013e510 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedf400700 1 -- 172.21.15.139:0/434109695 >> v1:172.21.15.176:6789/0 conn(0x7fcee0070350 legacy=0x7fcee013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedf400700 1 -- 172.21.15.139:0/434109695 >> v1:172.21.15.139:6789/0 conn(0x7fcee013e510 legacy=0x7fcee013bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedf400700 1 -- 172.21.15.139:0/434109695 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0070980 con 0x7fcee013e8f0 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 -- 172.21.15.139:0/112615498 shutdown_connections 2024-09-13T17:24:44.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 -- 172.21.15.139:0/3838809899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 msgr2=0x7f896013e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 --2- 172.21.15.139:0/3838809899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f896013e8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8950009850 tx=0x7f8950009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f643aa00700 1 -- 172.21.15.139:0/575593377 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642400b990 con 0x7f643c06b810 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f643aa00700 1 -- 172.21.15.139:0/575593377 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400bd00 con 0x7f643c06b810 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 -- 172.21.15.139:0/3838809899 shutdown_connections 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 --2- 172.21.15.139:0/3838809899 >> v2:172.21.15.139:3300/0 conn(0x7f896006fe10 0x7f8960070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 --2- 172.21.15.139:0/3838809899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f896013e8f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 -- 172.21.15.139:0/3838809899 >> 172.21.15.139:0/3838809899 conn(0x7f89600ae6d0 msgr2=0x7f89600aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3d400700 1 -- 172.21.15.139:0/1498835496 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237438970 0 0) 0x7fab4013ed60 con 0x7fab4013e8f0 2024-09-13T17:24:44.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3d400700 1 -- 172.21.15.139:0/1498835496 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab240057e0 con 0x7fab4013e8f0 2024-09-13T17:24:44.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedf400700 1 --2- 172.21.15.139:0/434109695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee013e8f0 0x7fcee006fe10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009850 tx=0x7fcecc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=149ac5df27fea63f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1d4004870 msgr2=0x7fd1d4004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f2a00700 1 --2- 172.21.15.139:0/3729224168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1d4004870 0x7fd1d4004cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009b70 tx=0x7fd1d40058a0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f2000700 1 -- 172.21.15.139:0/3729224168 reap_dead start 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3f200700 1 -- 172.21.15.139:0/1498835496 >> v1:172.21.15.176:6789/0 conn(0x7fab4013e8f0 legacy=0x7fab4006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3f200700 1 -- 172.21.15.139:0/1498835496 >> v1:172.21.15.139:6789/0 conn(0x7fab4013e510 legacy=0x7fab4013bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3f200700 1 -- 172.21.15.139:0/1498835496 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40070c60 con 0x7fab4013d440 2024-09-13T17:24:44.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f55f6400700 1 -- 172.21.15.139:0/112615498 wait complete. 2024-09-13T17:24:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 -- 172.21.15.139:0/3838809899 shutdown_connections 2024-09-13T17:24:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f8966200700 1 -- 172.21.15.139:0/3838809899 wait complete. 2024-09-13T17:24:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 shutdown_connections 2024-09-13T17:24:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 >> 172.21.15.139:0/3729224168 conn(0x7fd1ec0ae6d0 msgr2=0x7fd1ec0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 shutdown_connections 2024-09-13T17:24:44.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe85fe00700 1 --2- 172.21.15.139:0/386726462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 0x7fe86815dfd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe850009940 tx=0x7fe850009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece19b23eb9d44a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe865400700 1 -- 172.21.15.139:0/386726462 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850004230 con 0x7fe8680ad510 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe865400700 1 -- 172.21.15.139:0/386726462 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850009e90 con 0x7fe8680ad510 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fe865400700 1 -- 172.21.15.139:0/386726462 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500045b0 con 0x7fe8680ad510 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fab3f200700 1 --2- 172.21.15.139:0/1498835496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013d440 0x7fab40163a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fab38009260 tx=0x7fab38009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5559d9a7a65aff10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6441000700 1 -- 172.21.15.139:0/575593377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c06b810 msgr2=0x7f643c0705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6441000700 1 --2- 172.21.15.139:0/575593377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c06b810 0x7f643c0705c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6424009850 tx=0x7f6424009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6441000700 1 -- 172.21.15.139:0/575593377 shutdown_connections 2024-09-13T17:24:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6441000700 1 --2- 172.21.15.139:0/575593377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c06b810 0x7f643c0705c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7f6441000700 1 -- 172.21.15.139:0/575593377 >> 172.21.15.139:0/575593377 conn(0x7f643c0cbc50 msgr2=0x7f643c0cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00c880 con 0x7fcee013e8f0 2024-09-13T17:24:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00c9e0 con 0x7fcee013e8f0 2024-09-13T17:24:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.987+0000 7fcedea00700 1 -- 172.21.15.139:0/434109695 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00cd90 con 0x7fcee013e8f0 2024-09-13T17:24:44.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab3d400700 1 -- 172.21.15.139:0/1498835496 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38010830 con 0x7fab4013d440 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab3d400700 1 -- 172.21.15.139:0/1498835496 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38010990 con 0x7fab4013d440 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab3d400700 1 -- 172.21.15.139:0/1498835496 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38010d40 con 0x7fab4013d440 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f6441000700 1 -- 172.21.15.139:0/575593377 shutdown_connections 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 -- 172.21.15.139:0/386726462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 msgr2=0x7fe86815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 --2- 172.21.15.139:0/386726462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 0x7fe86815dfd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe850009940 tx=0x7fe850009c50 comp rx=0 tx=0).stop 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 -- 172.21.15.139:0/386726462 shutdown_connections 2024-09-13T17:24:44.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 --2- 172.21.15.139:0/386726462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8680ad510 0x7fe86815dfd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 -- 172.21.15.139:0/386726462 >> 172.21.15.139:0/386726462 conn(0x7fe86806b1e0 msgr2=0x7fe86806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 Processor -- start 2024-09-13T17:24:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 Processor -- start 2024-09-13T17:24:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 -- 172.21.15.139:0/434109695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee013e8f0 msgr2=0x7fcee006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 --2- 172.21.15.139:0/434109695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee013e8f0 0x7fcee006fe10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009850 tx=0x7fcecc009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 -- 172.21.15.139:0/386726462 shutdown_connections 2024-09-13T17:24:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 -- start start 2024-09-13T17:24:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f6441000700 1 -- 172.21.15.139:0/575593377 wait complete. 2024-09-13T17:24:44.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 -- start start 2024-09-13T17:24:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 -- 172.21.15.139:0/434109695 shutdown_connections 2024-09-13T17:24:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 --2- 172.21.15.139:0/434109695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee013e8f0 0x7fcee006fe10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 -- 172.21.15.139:0/434109695 >> 172.21.15.139:0/434109695 conn(0x7fcee00ae6d0 msgr2=0x7fcee00aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab44a00700 1 -- 172.21.15.139:0/1498835496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013d440 msgr2=0x7fab40163a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab44a00700 1 --2- 172.21.15.139:0/1498835496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013d440 0x7fab40163a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fab38009260 tx=0x7fab38009570 comp rx=0 tx=0).stop 2024-09-13T17:24:44.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab44a00700 1 -- 172.21.15.139:0/1498835496 shutdown_connections 2024-09-13T17:24:44.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab44a00700 1 --2- 172.21.15.139:0/1498835496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013d440 0x7fab40163a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab44a00700 1 -- 172.21.15.139:0/1498835496 >> 172.21.15.139:0/1498835496 conn(0x7fab400ae6d0 msgr2=0x7fab400aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 -- 172.21.15.139:0/386726462 wait complete. 2024-09-13T17:24:44.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 -- 172.21.15.139:0/434109695 shutdown_connections 2024-09-13T17:24:44.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fcee5a00700 1 -- 172.21.15.139:0/434109695 wait complete. 2024-09-13T17:24:44.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e8033640 0x7f55e80dc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55e8033b90 0x7f55e804fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e80360d0 0x7f55e817c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e817bcd0 con 0x7f55e8033640 2024-09-13T17:24:44.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e80dc780 con 0x7f55e80360d0 2024-09-13T17:24:44.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f6400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e817b930 con 0x7f55e8033b90 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e8033640 0x7f55e80dc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e8033640 0x7f55e80dc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37276/0 (socket says 172.21.15.139:37276) 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 -- 172.21.15.139:0/3972836646 learned_addr learned my addr 172.21.15.139:0/3972836646 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41b80cc370 0x7f41b80cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f41b806d2a0 0x7f41b806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b806dbf0 con 0x7f41b81612a0 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80ccd20 con 0x7f41b806d2a0 2024-09-13T17:24:44.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41bd000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b8070410 con 0x7f41b80cc370 2024-09-13T17:24:44.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f6441000700 1 Processor -- start 2024-09-13T17:24:44.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41b6800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f41b806d2a0 0x7f41b806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41b5e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f41b81612a0 0x7f41b80b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51832/0 (socket says 172.21.15.139:51832) 2024-09-13T17:24:44.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41b5e00700 1 -- 172.21.15.139:0/4251232718 learned_addr learned my addr 172.21.15.139:0/4251232718 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f41b5400700 1 --2- 172.21.15.139:0/4251232718 >> v2:172.21.15.176:3300/0 conn(0x7f41b80cc370 0x7f41b80cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55efe00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55e8033b90 0x7f55e804fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 -- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55e8033b90 msgr2=0x7f55e804fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55e8033b90 0x7f55e804fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 -- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e80360d0 msgr2=0x7f55e817c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55e80360d0 0x7f55e817c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7f55f5000700 1 -- 172.21.15.139:0/3972836646 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0074090 con 0x7f55e8033640 2024-09-13T17:24:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fe86ca00700 1 Processor -- start 2024-09-13T17:24:44.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fd1f2a00700 1 -- 172.21.15.139:0/3729224168 wait complete. 2024-09-13T17:24:44.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 -- start start 2024-09-13T17:24:44.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 -- start start 2024-09-13T17:24:44.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 Processor -- start 2024-09-13T17:24:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b5400700 1 -- 172.21.15.139:0/4251232718 >> v2:172.21.15.139:3300/0 conn(0x7f41b806d2a0 msgr2=0x7f41b806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b5400700 1 --2- 172.21.15.139:0/4251232718 >> v2:172.21.15.139:3300/0 conn(0x7f41b806d2a0 0x7f41b806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b5400700 1 -- 172.21.15.139:0/4251232718 >> v1:172.21.15.176:6789/0 conn(0x7f41b81612a0 legacy=0x7f41b80b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b4a00700 1 -- 172.21.15.139:0/4251232718 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163667685 0 0) 0x7f41b806dbf0 con 0x7f41b81612a0 2024-09-13T17:24:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 Processor -- start 2024-09-13T17:24:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55f5000700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e8033640 0x7f55e80dc240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55e4004cb0 tx=0x7f55e400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 -- start start 2024-09-13T17:24:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.991+0000 7fab44a00700 1 -- 172.21.15.139:0/1498835496 shutdown_connections 2024-09-13T17:24:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 -- start start 2024-09-13T17:24:44.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b5400700 1 -- 172.21.15.139:0/4251232718 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80706f0 con 0x7f41b80cc370 2024-09-13T17:24:44.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b6800700 1 --2- 172.21.15.139:0/4251232718 >> v2:172.21.15.139:3300/0 conn(0x7f41b806d2a0 0x7f41b806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:44.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fcee5a00700 1 Processor -- start 2024-09-13T17:24:44.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4005d90 con 0x7f55e8033640 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f896006fe10 0x7f89600a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f8960157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f896013e510 0x7f896015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896015b310 con 0x7f896006fe10 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600a95d0 con 0x7f896013e510 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8966200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896015b030 con 0x7f89600b01d0 2024-09-13T17:24:44.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8964e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f896006fe10 0x7f89600a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4004870 0x7fd1ec154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1ec139750 0x7fd1ec14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b1f30 0x7fd1ec0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8680ad510 0x7fe8680a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8680b3650 0x7fe868158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86815dbf0 0x7fe868157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe868157b80 con 0x7fe8680ad510 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe868159180 con 0x7fe8680b3650 2024-09-13T17:24:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe86ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681584e0 con 0x7fe86815dbf0 2024-09-13T17:24:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e40070d0 con 0x7f55e8033640 2024-09-13T17:24:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4007460 con 0x7f55e8033640 2024-09-13T17:24:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55f6400700 1 -- 172.21.15.139:0/3972836646 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e80203b0 con 0x7f55e8033640 2024-09-13T17:24:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55f6400700 1 -- 172.21.15.139:0/3972836646 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e8020970 con 0x7f55e8033640 2024-09-13T17:24:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c0672c0 0x7f643c1fef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643c06b810 0x7f643c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643c158cd0 0x7f643c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b5400700 1 --2- 172.21.15.139:0/4251232718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b80cc370 0x7f41b80cc7e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f41b806fe10 tx=0x7f41a4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2052840a916c2efd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0b28f0 con 0x7fd1d4004870 2024-09-13T17:24:44.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec155620 con 0x7fd1ec139750 2024-09-13T17:24:44.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec139bd0 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8964e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f896006fe10 0x7f89600a9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37292/0 (socket says 172.21.15.139:37292) 2024-09-13T17:24:44.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f8964e00700 1 -- 172.21.15.139:0/2197573154 learned_addr learned my addr 172.21.15.139:0/2197573154 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b4a00700 1 -- 172.21.15.139:0/4251232718 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4011830 con 0x7f41b80cc370 2024-09-13T17:24:44.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b4a00700 1 -- 172.21.15.139:0/4251232718 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4011990 con 0x7f41b80cc370 2024-09-13T17:24:44.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f41b4a00700 1 -- 172.21.15.139:0/4251232718 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4011d20 con 0x7f41b80cc370 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55c4000fc0 con 0x7f55e8033640 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8680b3650 0x7fe868158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8680b3650 0x7fe868158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:57034/0 (socket says 172.21.15.139:57034) 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 -- 172.21.15.139:0/719795535 learned_addr learned my addr 172.21.15.139:0/719795535 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b1f30 0x7fd1ec0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b1f30 0x7fd1ec0b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44180/0 (socket says 172.21.15.139:44180) 2024-09-13T17:24:44.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fd1f2000700 1 -- 172.21.15.139:0/1476365323 learned_addr learned my addr 172.21.15.139:0/1476365323 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c155f70 con 0x7f643c0672c0 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0b2200 con 0x7f643c06b810 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6441000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c1506e0 con 0x7f643c158cd0 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6433e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643c06b810 0x7f643c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6433e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643c06b810 0x7f643c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:57028/0 (socket says 172.21.15.139:57028) 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f6433e00700 1 -- 172.21.15.139:0/882738480 learned_addr learned my addr 172.21.15.139:0/882738480 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe866800700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86815dbf0 0x7fe868157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f895fe00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f8960157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f643be00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643c158cd0 0x7f643c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7f643b400700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c0672c0 0x7f643c1fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 -- 172.21.15.139:0/719795535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86815dbf0 msgr2=0x7fe868157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86815dbf0 0x7fe868157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 -- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8680ad510 msgr2=0x7fe8680a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8680ad510 0x7fe8680a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fe85fe00700 1 -- 172.21.15.139:0/719795535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850009570 con 0x7fe8680b3650 2024-09-13T17:24:44.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.995+0000 7fab44a00700 1 -- 172.21.15.139:0/1498835496 wait complete. 2024-09-13T17:24:44.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8965800700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f896013e510 0x7f896015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe85fe00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8680b3650 0x7fe868158c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe850000c00 tx=0x7fe850004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433e00700 1 -- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643c158cd0 msgr2=0x7f643c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433e00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643c158cd0 0x7f643c0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433e00700 1 -- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c0672c0 msgr2=0x7f643c1fef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433e00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f643c0672c0 0x7f643c1fef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433e00700 1 -- 172.21.15.139:0/882738480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240094b0 con 0x7f643c06b810 2024-09-13T17:24:44.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f1600700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4004870 0x7fd1ec154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f643be00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643c158cd0 0x7f643c0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:44.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fab44a00700 1 Processor -- start 2024-09-13T17:24:44.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8964e00700 1 -- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 msgr2=0x7f8960157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8964e00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89600b01d0 0x7f8960157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8964e00700 1 -- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f896013e510 msgr2=0x7f896015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8964e00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f896013e510 0x7f896015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8964e00700 1 -- 172.21.15.139:0/2197573154 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500094b0 con 0x7f896006fe10 2024-09-13T17:24:44.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8965800700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f896013e510 0x7f896015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:44.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1ec139750 0x7fd1ec14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2000700 1 -- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1ec139750 msgr2=0x7fd1ec14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2000700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1ec139750 0x7fd1ec14ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2000700 1 -- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4004870 msgr2=0x7fd1ec154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2000700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1d4004870 0x7fd1ec154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2000700 1 -- 172.21.15.139:0/1476365323 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec14f180 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1ec139750 0x7fd1ec14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:44.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500038c0 con 0x7fe8680b3650 2024-09-13T17:24:44.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850003a20 con 0x7fe8680b3650 2024-09-13T17:24:44.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850003db0 con 0x7fe8680b3650 2024-09-13T17:24:44.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fab44a00700 1 -- start start 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8964e00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f896006fe10 0x7f89600a9090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f894c001eb0 tx=0x7f894c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433e00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643c06b810 0x7f643c0b0100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6424009f60 tx=0x7f6424004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8681593b0 con 0x7fe8680b3650 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8681574c0 con 0x7fe8680b3650 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c005d90 con 0x7f896006fe10 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600a85b0 con 0x7f896006fe10 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0070d0 con 0x7f896006fe10 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c007440 con 0x7f896006fe10 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89600a8b70 con 0x7f896006fe10 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f41bd000700 1 -- 172.21.15.139:0/4251232718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b80cc370 msgr2=0x7f41b80cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f41bd000700 1 --2- 172.21.15.139:0/4251232718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b80cc370 0x7f41b80cc7e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f41b806fe10 tx=0x7f41a4009b30 comp rx=0 tx=0).stop 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 -- start start 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642401d070 con 0x7f643c06b810 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f41bd000700 1 -- 172.21.15.139:0/4251232718 shutdown_connections 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f41bd000700 1 --2- 172.21.15.139:0/4251232718 >> v2:172.21.15.139:3300/0 conn(0x7f41b806d2a0 0x7f41b806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f41bd000700 1 --2- 172.21.15.139:0/4251232718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b80cc370 0x7f41b80cc7e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f41bd000700 1 -- 172.21.15.139:0/4251232718 >> 172.21.15.139:0/4251232718 conn(0x7f41b806b1e0 msgr2=0x7f41b806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89601537e0 con 0x7f896006fe10 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2000700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b1f30 0x7fd1ec0b23b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec072020 tx=0x7fd1e400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400ad30 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2a00700 1 -- 172.21.15.139:0/1476365323 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec154a10 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1f2a00700 1 -- 172.21.15.139:0/1476365323 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec154fd0 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400ae90 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4007270 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe86806bf60 con 0x7fe8680b3650 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fab44a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4013d440 0x7fab401f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fab3e800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4013d440 0x7fab401f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fab3e800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4013d440 0x7fab401f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44212/0 (socket says 172.21.15.139:44212) 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55e40075c0 con 0x7f55e8033640 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c1509c0 con 0x7f643c06b810 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c0b2730 con 0x7f643c06b810 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642400beb0 con 0x7f643c06b810 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424003ad0 con 0x7f643c06b810 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee0070350 0x7fcee0157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcee013e510 0x7fcee01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcee013e8f0 0x7fcee006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0135f40 con 0x7fcee013e8f0 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01ef1e0 con 0x7fcee0070350 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fcee5a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee006b7f0 con 0x7fcee013e510 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1c0000fc0 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:43.999+0000 7fab44a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4013e510 0x7fab401466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 -- 172.21.15.139:0/1017228516 learned_addr learned my addr 172.21.15.139:0/1017228516 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab44a00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013e8f0 0x7fab4013b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3de00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4013e510 0x7fab401466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401f2290 con 0x7fab4013e8f0 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4013a090 con 0x7fab4013e510 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6414000fc0 con 0x7f643c06b810 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedf400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcee013e510 0x7fcee01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedfe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee0070350 0x7fcee0157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcee5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcee013e8f0 0x7fcee006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcee5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcee013e8f0 0x7fcee006bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37332/0 (socket says 172.21.15.139:37332) 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcee5000700 1 -- 172.21.15.139:0/339334005 learned_addr learned my addr 172.21.15.139:0/339334005 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4013a370 con 0x7fab4013d440 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe850022070 con 0x7fe8680b3650 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f894c0075a0 con 0x7f896006fe10 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 -- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4013e510 msgr2=0x7fab401466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4013e510 0x7fab401466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 -- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013e8f0 msgr2=0x7fab4013b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedfe00700 1 -- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcee013e510 msgr2=0x7fcee01527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedfe00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcee013e510 0x7fcee01527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedfe00700 1 -- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcee013e8f0 msgr2=0x7fcee006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedfe00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcee013e8f0 0x7fcee006bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fcedfe00700 1 -- 172.21.15.139:0/339334005 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0094b0 con 0x7fcee0070350 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fe85e000700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe844066780 0x7fe844068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4013e8f0 0x7fab4013b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f895cc00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8940066730 0x7f8940068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38009d40 con 0x7fab4013d440 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3de00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4013e510 0x7fab401466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f894c0840f0 con 0x7f896006fe10 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f895fe00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8940066730 0x7f8940068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f895cc00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f894006fbf0 0x7f8940072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f41bd000700 1 -- 172.21.15.139:0/4251232718 shutdown_connections 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f41bd000700 1 -- 172.21.15.139:0/4251232718 wait complete. 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7f41bd000700 1 Processor -- start 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fab3e800700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4013d440 0x7fab401f1d50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c500 tx=0x7fab2c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f895fe00700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8940066730 0x7f8940068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89500090b0 tx=0x7f8950008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1e40073d0 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.003+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe850086b20 con 0x7fe8680b3650 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe85e000700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7fe84406fdc0 0x7fe844072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 --> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8440728d0 con 0x7fe84406fdc0 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe850086e90 con 0x7fe8680b3650 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe865e00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe844066780 0x7fe844068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0052d0 con 0x7fab4013d440 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55ecc00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55d0066800 0x7f55d0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f55e4084040 con 0x7f55e8033640 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55ecc00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f55d006fe40 0x7f55d0072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 --> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55d0072950 con 0x7f55d006fe40 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55e40843f0 con 0x7f55e8033640 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fcedfe00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee0070350 0x7fcee0157c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fced0001eb0 tx=0x7fced000c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00052d0 con 0x7fcee0070350 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0005430 con 0x7fcee0070350 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00055a0 con 0x7fcee0070350 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee0152d10 con 0x7fcee0070350 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c005430 con 0x7fab4013d440 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0055a0 con 0x7fab4013d440 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee006b1e0 con 0x7fcee0070350 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe866800700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7fe84406fdc0 0x7fe844072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55f5a00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f55d006fe40 0x7f55d0072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe865e00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe844066780 0x7fe844068c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe858009710 tx=0x7fe858006c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1e9600700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd1cc066760 0x7fd1cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1e40844b0 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1e9600700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7fd1cc06fda0 0x7fd1cc0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 --> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1cc0728b0 con 0x7fd1cc06fda0 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1e4084860 con 0x7fd1ec0b1f30 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55efe00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55d0066800 0x7f55d0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1f1600700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd1cc066760 0x7fd1cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7fd1cc06fda0 0x7fd1cc0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fd1f1600700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd1cc066760 0x7fd1cc068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00099e0 tx=0x7fd1e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fe866800700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7fe84406fdc0 0x7fe844072200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4013a650 con 0x7fab4013d440 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4013ac10 con 0x7fab4013d440 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55f5a00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f55d006fe40 0x7f55d0072280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f55efe00700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55d0066800 0x7f55d0068cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f55dc007fd0 tx=0x7f55dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f41bd000700 1 -- start start 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 --> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8940072700 con 0x7f894006fbf0 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f894c051100 con 0x7f896006fe10 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f8965800700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f894006fbf0 0x7f8940072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f8965800700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f894006fbf0 0x7f8940072030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab40071500 con 0x7fab4013d440 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== osd.2 v2:172.21.15.139:6817/3239824397 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe8440728d0 con 0x7fe84406fdc0 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41bd000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b806d2a0 0x7f41b8202410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41bd000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41b80cc370 0x7f41b814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41bd000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41b81612a0 0x7f41b8162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41bd000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b814f750 con 0x7f41b80cc370 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41bd000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b814eb60 con 0x7f41b806d2a0 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41bd000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b814ee20 con 0x7f41b81612a0 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fceb8000fc0 con 0x7fcee0070350 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41b81612a0 0x7f41b8162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41b81612a0 0x7f41b8162280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44234/0 (socket says 172.21.15.139:44234) 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 -- 172.21.15.139:0/641664447 learned_addr learned my addr 172.21.15.139:0/641664447 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7fd1f0c00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7fd1cc06fda0 0x7fd1cc0721e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.007+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6424003c30 con 0x7f643c06b810 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f6433400700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6418066730 0x7f6418068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fced00038e0 con 0x7fcee0070350 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== osd.4 v2:172.21.15.176:6800/3123658344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f55d0072950 con 0x7f55d006fe40 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 -- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b806d2a0 msgr2=0x7f41b8202410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41b806d2a0 0x7f41b8202410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 -- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41b80cc370 msgr2=0x7f41b814fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b5400700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41b80cc370 0x7f41b814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41b80cc370 0x7f41b814fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b6800700 1 -- 172.21.15.139:0/641664447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0009a70 con 0x7f41b81612a0 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== osd.0 v2:172.21.15.139:6800/2232177245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8940072700 con 0x7f894006fbf0 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f41b5400700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41b80cc370 0x7f41b814fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.011+0000 7f643b400700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6418066730 0x7f6418068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41b6800700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41b81612a0 0x7f41b8162280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41b000efc0 tx=0x7f41b000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab2c0038e0 con 0x7fab4013d440 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6424056f80 con 0x7f643c06b810 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== osd.1 v2:172.21.15.139:6808/2059112051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd1cc0728b0 con 0x7fd1cc06fda0 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f643b400700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6418066730 0x7f6418068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f642c000f60 tx=0x7f642c007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f6433400700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7f6418070a10 0x7f6418072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 --> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6418073580 con 0x7f6418070a10 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6424003ee0 con 0x7f643c06b810 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0009d70 con 0x7f41b81612a0 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b000f040 con 0x7f41b81612a0 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000ce00 con 0x7f41b81612a0 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a40094b0 con 0x7f41b81612a0 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b814f3e0 con 0x7f41b81612a0 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f643be00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7f6418070a10 0x7f6418072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fced7e00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcec006ab90 0x7fcec006d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fced00838b0 con 0x7fcee0070350 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41b8070f90 con 0x7f41b81612a0 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fced7e00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fcec00741d0 0x7fcec0076610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab36a00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fab20066800 0x7fab20068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab2c083fa0 con 0x7fab4013d440 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 --> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcec0076ce0 con 0x7fcec00741d0 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fced00882a0 con 0x7fcee0070350 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fcedf400700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcec006ab90 0x7fcec006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fcee5000700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fcec00741d0 0x7fcec0076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7fcee5000700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fcec00741d0 0x7fcec0076610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab36a00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7fab2006fe40 0x7fab20072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab20072950 con 0x7fab2006fe40 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab2c084350 con 0x7fab4013d440 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab3f200700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7fab2006fe40 0x7fab20072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7fab3de00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fab20066800 0x7fab20068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.015+0000 7f643be00700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7f6418070a10 0x7f6418072eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7fab3f200700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7fab2006fe40 0x7fab20072280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== osd.7 v2:172.21.15.176:6816/3835533036 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcec0076ce0 con 0x7fcec00741d0 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41b0014480 con 0x7f41b81612a0 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41ae000700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4198066800 0x7f4198068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41b0084c20 con 0x7f41b81612a0 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41ae000700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7f419806fe40 0x7f4198072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 --> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4198072950 con 0x7f419806fe40 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41b00892a0 con 0x7f41b81612a0 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41b5e00700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4198066800 0x7f4198068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== osd.5 v2:172.21.15.176:6804/545225210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6418073580 con 0x7f6418070a10 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7f41b5400700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7f419806fe40 0x7f4198072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.023+0000 7fab3de00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fab20066800 0x7fab20068cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab40149850 tx=0x7fab30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.019+0000 7fcedf400700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcec006ab90 0x7fcec006d050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0090b0 tx=0x7fcecc01a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.023+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== osd.3 v2:172.21.15.139:6816/1185400623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fab20072950 con 0x7fab2006fe40 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.023+0000 7f41b5400700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7f419806fe40 0x7f4198072280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.023+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== osd.6 v2:172.21.15.176:6824/1964477782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4198072950 con 0x7f419806fe40 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.027+0000 7f41b5e00700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4198066800 0x7f4198068cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41a80015c0 tx=0x7f41a8007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 --> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8680ad9e0 con 0x7fe84406fdc0 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe85e000700 1 -- 172.21.15.139:0/719795535 <== osd.2 v2:172.21.15.139:6817/3239824397 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe8680ad9e0 con 0x7fe84406fdc0 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7fe84406fdc0 msgr2=0x7fe844072200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7fe84406fdc0 0x7fe844072200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe844066780 msgr2=0x7fe844068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe844066780 0x7fe844068c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe858009710 tx=0x7fe858006c70 comp rx=0 tx=0).stop 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8680b3650 msgr2=0x7fe868158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 --2- 172.21.15.139:0/719795535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8680b3650 0x7fe868158c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe850000c00 tx=0x7fe850004770 comp rx=0 tx=0).stop 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 --> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f896013f080 con 0x7f894006fbf0 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe866800700 1 -- 172.21.15.139:0/719795535 reap_dead start 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 shutdown_connections 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 >> 172.21.15.139:0/719795535 conn(0x7fe86806b1e0 msgr2=0x7fe868160940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 --> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55c4002d60 con 0x7f55d006fe40 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 shutdown_connections 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.039+0000 7fe86ca00700 1 -- 172.21.15.139:0/719795535 wait complete. 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55ecc00700 1 -- 172.21.15.139:0/3972836646 <== osd.4 v2:172.21.15.176:6800/3123658344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f55c4002d60 con 0x7f55d006fe40 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f55d006fe40 msgr2=0x7f55d0072280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f55d006fe40 0x7f55d0072280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f895cc00700 1 -- 172.21.15.139:0/2197573154 <== osd.0 v2:172.21.15.139:6800/2232177245 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f896013f080 con 0x7f894006fbf0 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55d0066800 msgr2=0x7f55d0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55d0066800 0x7f55d0068cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f55dc007fd0 tx=0x7f55dc009040 comp rx=0 tx=0).stop 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e8033640 msgr2=0x7f55e80dc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 --2- 172.21.15.139:0/3972836646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e8033640 0x7f55e80dc240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55e4004cb0 tx=0x7f55e400ca90 comp rx=0 tx=0).stop 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55f5a00700 1 -- 172.21.15.139:0/3972836646 reap_dead start 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 --> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1c0002d60 con 0x7fd1cc06fda0 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f894006fbf0 msgr2=0x7f8940072030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f894006fbf0 0x7f8940072030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 shutdown_connections 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 >> 172.21.15.139:0/3972836646 conn(0x7f55e801d9e0 msgr2=0x7f55e80320d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7fd1e9600700 1 -- 172.21.15.139:0/1476365323 <== osd.1 v2:172.21.15.139:6808/2059112051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1c0002d60 con 0x7fd1cc06fda0 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8940066730 msgr2=0x7f8940068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8940066730 0x7f8940068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89500090b0 tx=0x7f8950008030 comp rx=0 tx=0).stop 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f896006fe10 msgr2=0x7f89600a9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 --2- 172.21.15.139:0/2197573154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f896006fe10 0x7f89600a9090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f894c001eb0 tx=0x7f894c00c7b0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8965800700 1 -- 172.21.15.139:0/2197573154 reap_dead start 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 shutdown_connections 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 >> 172.21.15.139:0/2197573154 conn(0x7f89600ae6d0 msgr2=0x7f896006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 shutdown_connections 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.043+0000 7f55e2000700 1 -- 172.21.15.139:0/3972836646 wait complete. 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 shutdown_connections 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7f8966200700 1 -- 172.21.15.139:0/2197573154 wait complete. 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7fd1cc06fda0 msgr2=0x7fd1cc0721e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7fd1cc06fda0 0x7fd1cc0721e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd1cc066760 msgr2=0x7fd1cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd1cc066760 0x7fd1cc068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00099e0 tx=0x7fd1e0008040 comp rx=0 tx=0).stop 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b1f30 msgr2=0x7fd1ec0b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 --2- 172.21.15.139:0/1476365323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1ec0b1f30 0x7fd1ec0b23b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec072020 tx=0x7fd1e400a340 comp rx=0 tx=0).stop 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1f2000700 1 -- 172.21.15.139:0/1476365323 reap_dead start 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 shutdown_connections 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 >> 172.21.15.139:0/1476365323 conn(0x7fd1ec0ae6d0 msgr2=0x7fd1ec1592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 shutdown_connections 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fd1dea00700 1 -- 172.21.15.139:0/1476365323 wait complete. 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.047+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 --> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fceb8002d60 con 0x7fcec00741d0 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fced7e00700 1 -- 172.21.15.139:0/339334005 <== osd.7 v2:172.21.15.176:6816/3835533036 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fceb8002d60 con 0x7fcec00741d0 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 --> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6414002d30 con 0x7f6418070a10 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fcec00741d0 msgr2=0x7fcec0076610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5a00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fcec00741d0 0x7fcec0076610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 --> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41b8070cb0 con 0x7f419806fe40 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcec006ab90 msgr2=0x7fcec006d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5a00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcec006ab90 0x7fcec006d050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0090b0 tx=0x7fcecc01a040 comp rx=0 tx=0).stop 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee0070350 msgr2=0x7fcee0157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5a00700 1 --2- 172.21.15.139:0/339334005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcee0070350 0x7fcee0157c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fced0001eb0 tx=0x7fced000c7b0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7fcee5000700 1 -- 172.21.15.139:0/339334005 reap_dead start 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.051+0000 7f6433400700 1 -- 172.21.15.139:0/882738480 <== osd.5 v2:172.21.15.176:6804/545225210 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6414002d30 con 0x7f6418070a10 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 shutdown_connections 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 >> 172.21.15.139:0/339334005 conn(0x7fcee00ae6d0 msgr2=0x7fcee00aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 shutdown_connections 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 --> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab40071220 con 0x7fab2006fe40 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7fcee5a00700 1 -- 172.21.15.139:0/339334005 wait complete. 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7f6418070a10 msgr2=0x7f6418072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7f6418070a10 0x7f6418072eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6418066730 msgr2=0x7f6418068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6418066730 0x7f6418068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f642c000f60 tx=0x7f642c007f30 comp rx=0 tx=0).stop 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643c06b810 msgr2=0x7f643c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 --2- 172.21.15.139:0/882738480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643c06b810 0x7f643c0b0100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6424009f60 tx=0x7f6424004770 comp rx=0 tx=0).stop 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41ae000700 1 -- 172.21.15.139:0/641664447 <== osd.6 v2:172.21.15.176:6824/1964477782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41a4011b00 con 0x7f419806fe40 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f643be00700 1 -- 172.21.15.139:0/882738480 reap_dead start 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 shutdown_connections 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 >> 172.21.15.139:0/882738480 conn(0x7f643c0cbc50 msgr2=0x7f643c166c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 shutdown_connections 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f6441000700 1 -- 172.21.15.139:0/882738480 wait complete. 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7f419806fe40 msgr2=0x7f4198072280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7f419806fe40 0x7f4198072280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4198066800 msgr2=0x7f4198068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4198066800 0x7f4198068cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41a80015c0 tx=0x7f41a8007a10 comp rx=0 tx=0).stop 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41b81612a0 msgr2=0x7f41b8162280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 --2- 172.21.15.139:0/641664447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41b81612a0 0x7f41b8162280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41b000efc0 tx=0x7f41b000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41b6800700 1 -- 172.21.15.139:0/641664447 reap_dead start 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7fab36a00700 1 -- 172.21.15.139:0/1017228516 <== osd.3 v2:172.21.15.139:6816/1185400623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab38020040 con 0x7fab2006fe40 2024-09-13T17:24:44.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 shutdown_connections 2024-09-13T17:24:44.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.055+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 >> 172.21.15.139:0/641664447 conn(0x7f41b806b1e0 msgr2=0x7f41b8071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7fab2006fe40 msgr2=0x7fab20072280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 shutdown_connections 2024-09-13T17:24:44.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7fab2006fe40 0x7fab20072280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7f41bd000700 1 -- 172.21.15.139:0/641664447 wait complete. 2024-09-13T17:24:44.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fab20066800 msgr2=0x7fab20068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fab20066800 0x7fab20068cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab40149850 tx=0x7fab30009040 comp rx=0 tx=0).stop 2024-09-13T17:24:44.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4013d440 msgr2=0x7fab401f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 --2- 172.21.15.139:0/1017228516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4013d440 0x7fab401f1d50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c500 tx=0x7fab2c00c810 comp rx=0 tx=0).stop 2024-09-13T17:24:44.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab3f200700 1 -- 172.21.15.139:0/1017228516 reap_dead start 2024-09-13T17:24:44.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 shutdown_connections 2024-09-13T17:24:44.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 >> 172.21.15.139:0/1017228516 conn(0x7fab400ae6d0 msgr2=0x7fab4013c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 shutdown_connections 2024-09-13T17:24:44.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.059+0000 7fab44a00700 1 -- 172.21.15.139:0/1017228516 wait complete. 2024-09-13T17:24:44.105 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-09-13T17:24:44.105 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:24:44.106 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-09-13T17:24:44.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:24:44.107 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-09-13T17:24:44.107 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:24:44.108 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-09-13T17:24:44.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:24:44.109 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-09-13T17:24:44.109 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:24:44.110 INFO:teuthology.orchestra.run.smithi139.stdout:55834574857 2024-09-13T17:24:44.110 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:24:44.111 INFO:teuthology.orchestra.run.smithi139.stdout:55834574857 2024-09-13T17:24:44.111 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:24:44.112 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-09-13T17:24:44.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:24:44.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.375+0000 7f15b5a00700 1 Processor -- start 2024-09-13T17:24:44.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.375+0000 7f15b5a00700 1 -- start start 2024-09-13T17:24:44.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.375+0000 7f15b5a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f15b015ef90 0x7f15b0143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.375+0000 7f15b5a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00b6370 con 0x7f15b015f5c0 2024-09-13T17:24:44.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.375+0000 7f15b5a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00b6650 con 0x7f15b015ebb0 2024-09-13T17:24:44.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.375+0000 7f15b5a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b00b6930 con 0x7f15b015ef90 2024-09-13T17:24:44.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.379+0000 7f15afe00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f15b015ebb0 0x7f15b01434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51848/0 (socket says 172.21.15.139:51848) 2024-09-13T17:24:44.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.379+0000 7f15afe00700 1 -- 172.21.15.139:0/729196075 learned_addr learned my addr 172.21.15.139:0/729196075 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.379+0000 7f15b5000700 1 --2- 172.21.15.139:0/729196075 >> v2:172.21.15.139:3300/0 conn(0x7f15b015ef90 0x7f15b0143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5000700 1 -- 172.21.15.139:0/729196075 >> v1:172.21.15.176:6789/0 conn(0x7f15b015ebb0 legacy=0x7f15b01434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.379+0000 7f15aea00700 1 -- 172.21.15.139:0/729196075 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483447624 0 0) 0x7f15b00b6650 con 0x7f15b015ebb0 2024-09-13T17:24:44.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5000700 1 -- 172.21.15.139:0/729196075 >> v1:172.21.15.139:6789/0 conn(0x7f15b015f5c0 legacy=0x7f15b00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5000700 1 -- 172.21.15.139:0/729196075 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b00b6c10 con 0x7f15b015ef90 2024-09-13T17:24:44.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5000700 1 --2- 172.21.15.139:0/729196075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ef90 0x7f15b0143be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009d90 tx=0x7f15a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80360754b560aafb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15aea00700 1 -- 172.21.15.139:0/729196075 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800e070 con 0x7f15b015ef90 2024-09-13T17:24:44.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15aea00700 1 -- 172.21.15.139:0/729196075 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a800bb90 con 0x7f15b015ef90 2024-09-13T17:24:44.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15aea00700 1 -- 172.21.15.139:0/729196075 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800e070 con 0x7f15b015ef90 2024-09-13T17:24:44.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5a00700 1 -- 172.21.15.139:0/729196075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ef90 msgr2=0x7f15b0143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5a00700 1 --2- 172.21.15.139:0/729196075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ef90 0x7f15b0143be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009d90 tx=0x7f15a800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:44.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5a00700 1 -- 172.21.15.139:0/729196075 shutdown_connections 2024-09-13T17:24:44.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5a00700 1 --2- 172.21.15.139:0/729196075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ef90 0x7f15b0143be0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.383+0000 7f15b5a00700 1 -- 172.21.15.139:0/729196075 >> 172.21.15.139:0/729196075 conn(0x7f15b0071fa0 msgr2=0x7f15b0072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 Processor -- start 2024-09-13T17:24:44.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f15b5a00700 1 -- 172.21.15.139:0/729196075 shutdown_connections 2024-09-13T17:24:44.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f15b5a00700 1 -- 172.21.15.139:0/729196075 wait complete. 2024-09-13T17:24:44.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3e00700 1 Processor -- start 2024-09-13T17:24:44.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3e00700 1 -- start start 2024-09-13T17:24:44.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 -- start start 2024-09-13T17:24:44.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 Processor -- start 2024-09-13T17:24:44.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 -- start start 2024-09-13T17:24:44.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b040b64e0 0x7f4b04162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b040d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0406c080 con 0x7f4b040d0270 2024-09-13T17:24:44.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b040d09f0 con 0x7f4b040b64e0 2024-09-13T17:24:44.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b09400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040cf2c0 con 0x7f4b040d1030 2024-09-13T17:24:44.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76f4145940 0x7f76f40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f15b5a00700 1 Processor -- start 2024-09-13T17:24:44.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f4070670 con 0x7f76f40cd670 2024-09-13T17:24:44.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f415d310 con 0x7f76f40cbe50 2024-09-13T17:24:44.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f406fe10 con 0x7f76f4145940 2024-09-13T17:24:44.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f15b5a00700 1 -- start start 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678153610 0x7fe678070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe678070590 0x7fe678159560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780cced0 con 0x7fe678159aa0 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6781539f0 con 0x7fe678070590 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7fe680200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67815a090 con 0x7fe678153610 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b08a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b040d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b08a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b040d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44242/0 (socket says 172.21.15.139:44242) 2024-09-13T17:24:44.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f4b08a00700 1 -- 172.21.15.139:0/4032375521 learned_addr learned my addr 172.21.15.139:0/4032375521 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f2a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76f4145940 0x7f76f40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f76f40cd670 0x7f76f4070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47536/0 (socket says 172.21.15.139:47536) 2024-09-13T17:24:44.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.387+0000 7f76f3400700 1 -- 172.21.15.139:0/3623684568 learned_addr learned my addr 172.21.15.139:0/3623684568 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67ce00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe678070590 0x7fe678159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b08a00700 1 -- 172.21.15.139:0/4032375521 >> v2:172.21.15.176:3300/0 conn(0x7f4b040b64e0 msgr2=0x7f4b04162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ebb0 0x7f15b0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b015ef90 0x7f15b013b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b015f5c0 0x7f15b013a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f2a00700 1 -- 172.21.15.139:0/3623684568 >> v1:172.21.15.176:6789/0 conn(0x7f76f40cbe50 legacy=0x7f76f40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f2a00700 1 -- 172.21.15.139:0/3623684568 >> v1:172.21.15.139:6789/0 conn(0x7f76f40cd670 legacy=0x7f76f4070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f2a00700 1 -- 172.21.15.139:0/3623684568 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40cc580 con 0x7f76f4145940 2024-09-13T17:24:44.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b03e00700 1 --2- 172.21.15.139:0/4032375521 >> v2:172.21.15.176:3300/0 conn(0x7f4b040b64e0 0x7f4b04162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67ce00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe678070590 0x7fe678159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37382/0 (socket says 172.21.15.139:37382) 2024-09-13T17:24:44.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67ce00700 1 -- 172.21.15.139:0/3956985272 learned_addr learned my addr 172.21.15.139:0/3956985272 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b013a770 con 0x7f15b015ebb0 2024-09-13T17:24:44.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b013c9c0 con 0x7f15b015ef90 2024-09-13T17:24:44.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b013bdb0 con 0x7f15b015f5c0 2024-09-13T17:24:44.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 Processor -- start 2024-09-13T17:24:44.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 -- start start 2024-09-13T17:24:44.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67d800700 1 --2- 172.21.15.139:0/3956985272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678153610 0x7fe678070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f2a00700 1 --2- 172.21.15.139:0/3623684568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f40b01d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009850 tx=0x7f76e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e3bbc41aebea9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b02a00700 1 -- 172.21.15.139:0/4032375521 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286921299 0 0) 0x7f4b0406c080 con 0x7f4b040d0270 2024-09-13T17:24:44.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b08a00700 1 --2- 172.21.15.139:0/4032375521 >> v2:172.21.15.176:3300/0 conn(0x7f4b040b64e0 0x7f4b04162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b08a00700 1 -- 172.21.15.139:0/4032375521 >> v1:172.21.15.176:6789/0 conn(0x7f4b040d0270 legacy=0x7f4b040cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b08a00700 1 -- 172.21.15.139:0/4032375521 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b041587e0 con 0x7f4b040d1030 2024-09-13T17:24:44.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe677e00700 1 -- 172.21.15.139:0/3956985272 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31013679 0 0) 0x7fe6780cced0 con 0x7fe678159aa0 2024-09-13T17:24:44.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe677e00700 1 -- 172.21.15.139:0/3956985272 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6600035d0 con 0x7fe678159aa0 2024-09-13T17:24:44.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b015f5c0 0x7f15b013a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b03e00700 1 --2- 172.21.15.139:0/4032375521 >> v2:172.21.15.176:3300/0 conn(0x7f4b040b64e0 0x7f4b04162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:44.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b015f5c0 0x7f15b013a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44254/0 (socket says 172.21.15.139:44254) 2024-09-13T17:24:44.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15b5000700 1 -- 172.21.15.139:0/1417546841 learned_addr learned my addr 172.21.15.139:0/1417546841 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7feb87000700 1 Processor -- start 2024-09-13T17:24:44.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15afe00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ebb0 0x7f15b0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f1600700 1 -- 172.21.15.139:0/3623684568 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011830 con 0x7f76f4145940 2024-09-13T17:24:44.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67d800700 1 -- 172.21.15.139:0/3956985272 >> v2:172.21.15.139:3300/0 conn(0x7fe678070590 msgr2=0x7fe678159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f1600700 1 -- 172.21.15.139:0/3623684568 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4011990 con 0x7f76f4145940 2024-09-13T17:24:44.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f1600700 1 -- 172.21.15.139:0/3623684568 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011d20 con 0x7f76f4145940 2024-09-13T17:24:44.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67d800700 1 --2- 172.21.15.139:0/3956985272 >> v2:172.21.15.139:3300/0 conn(0x7fe678070590 0x7fe678159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67d800700 1 -- 172.21.15.139:0/3956985272 >> v1:172.21.15.176:6789/0 conn(0x7fe678159aa0 legacy=0x7fe6780cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67d800700 1 -- 172.21.15.139:0/3956985272 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67815a370 con 0x7fe678153610 2024-09-13T17:24:44.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7feb87000700 1 -- start start 2024-09-13T17:24:44.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b08a00700 1 --2- 172.21.15.139:0/4032375521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b040d14a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009910 tx=0x7f4af4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f630511be3a1c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15af400700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b015ef90 0x7f15b013b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe67d800700 1 --2- 172.21.15.139:0/3956985272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678153610 0x7fe678070050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009850 tx=0x7fe66c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1691bdeb1d290b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b02a00700 1 -- 172.21.15.139:0/4032375521 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400ba60 con 0x7f4b040d1030 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15afe00700 1 -- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b015f5c0 msgr2=0x7f15b013a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15afe00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b015f5c0 0x7f15b013a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15afe00700 1 -- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b015ef90 msgr2=0x7f15b013b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15afe00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b015ef90 0x7f15b013b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f15afe00700 1 -- 172.21.15.139:0/1417546841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009a70 con 0x7f15b015ebb0 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8fd4142a80 0x7f8fd40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8fd4071ec0 0x7f8fd406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd406a390 con 0x7f8fd4143000 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd4142e60 con 0x7f8fd4071ec0 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f8fdac00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd406a5e0 con 0x7f8fd4142a80 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fc467a00700 1 Processor -- start 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fc467a00700 1 -- start start 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f3e00700 1 -- 172.21.15.139:0/3623684568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 msgr2=0x7f76f40b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f3e00700 1 --2- 172.21.15.139:0/3623684568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f40b01d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009850 tx=0x7f76e4009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b02a00700 1 -- 172.21.15.139:0/4032375521 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400bbc0 con 0x7f4b040d1030 2024-09-13T17:24:44.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f4b02a00700 1 -- 172.21.15.139:0/4032375521 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4009e60 con 0x7f4b040d1030 2024-09-13T17:24:44.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe677e00700 1 -- 172.21.15.139:0/3956985272 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c011830 con 0x7fe678153610 2024-09-13T17:24:44.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe677e00700 1 -- 172.21.15.139:0/3956985272 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c011990 con 0x7fe678153610 2024-09-13T17:24:44.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7fe677e00700 1 -- 172.21.15.139:0/3956985272 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c011830 con 0x7fe678153610 2024-09-13T17:24:44.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f3e00700 1 -- 172.21.15.139:0/3623684568 shutdown_connections 2024-09-13T17:24:44.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.391+0000 7f76f3e00700 1 --2- 172.21.15.139:0/3623684568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f40b01d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f76f3e00700 1 -- 172.21.15.139:0/3623684568 >> 172.21.15.139:0/3623684568 conn(0x7f76f40ae6d0 msgr2=0x7f76f40aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4a1ca00700 1 Processor -- start 2024-09-13T17:24:44.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4a1ca00700 1 -- start start 2024-09-13T17:24:44.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 -- 172.21.15.139:0/4032375521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 msgr2=0x7f4b040d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 --2- 172.21.15.139:0/4032375521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b040d14a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009910 tx=0x7f4af4009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:44.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f15afe00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ebb0 0x7f15b0156180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c520 tx=0x7f15a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004ca0 con 0x7f15b015ebb0 2024-09-13T17:24:44.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0004e00 con 0x7f15b015ebb0 2024-09-13T17:24:44.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0007310 con 0x7f15b015ebb0 2024-09-13T17:24:44.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8fd4071ec0 0x7f8fd406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8fd4071ec0 0x7f8fd406d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37398/0 (socket says 172.21.15.139:37398) 2024-09-13T17:24:44.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 -- 172.21.15.139:0/2462644516 learned_addr learned my addr 172.21.15.139:0/2462644516 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fd9800700 1 --2- 172.21.15.139:0/2462644516 >> v2:172.21.15.176:3300/0 conn(0x7f8fd4142a80 0x7f8fd40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f76f3e00700 1 -- 172.21.15.139:0/3623684568 shutdown_connections 2024-09-13T17:24:44.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 -- 172.21.15.139:0/3956985272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678153610 msgr2=0x7fe678070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 --2- 172.21.15.139:0/3956985272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678153610 0x7fe678070050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009850 tx=0x7fe66c009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f76f3e00700 1 -- 172.21.15.139:0/3623684568 wait complete. 2024-09-13T17:24:44.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb87000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb80159560 0x7feb801599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 -- 172.21.15.139:0/3956985272 shutdown_connections 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 --2- 172.21.15.139:0/3956985272 >> v2:172.21.15.139:3300/0 conn(0x7fe678070590 0x7fe678159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 --2- 172.21.15.139:0/3956985272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678153610 0x7fe678070050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 -- 172.21.15.139:0/4032375521 shutdown_connections 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 --2- 172.21.15.139:0/4032375521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b040d14a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 --2- 172.21.15.139:0/4032375521 >> v2:172.21.15.176:3300/0 conn(0x7f4b040b64e0 0x7f4b04162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 -- 172.21.15.139:0/4032375521 >> 172.21.15.139:0/4032375521 conn(0x7f4b04071fa0 msgr2=0x7f4b04072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 -- 172.21.15.139:0/3956985272 >> 172.21.15.139:0/3956985272 conn(0x7fe67806b1e0 msgr2=0x7fe67806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b013c090 con 0x7f15b015ebb0 2024-09-13T17:24:44.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b013c650 con 0x7f15b015ebb0 2024-09-13T17:24:44.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb87000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb800cced0 con 0x7feb80153610 2024-09-13T17:24:44.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb7fe00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7feb80153610 0x7feb80070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47552/0 (socket says 172.21.15.139:47552) 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb87000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb801539f0 con 0x7feb800cd360 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb87000700 1 -- 172.21.15.139:0/3886805428 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015a090 con 0x7feb80159560 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb7fe00700 1 -- 172.21.15.139:0/3886805428 learned_addr learned my addr 172.21.15.139:0/3886805428 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb7f400700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb80159560 0x7feb801599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 -- 172.21.15.139:0/3956985272 shutdown_connections 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fd3e00700 1 -- 172.21.15.139:0/2462644516 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291393043 0 0) 0x7f8fd406a390 con 0x7f8fd4143000 2024-09-13T17:24:44.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fd3e00700 1 -- 172.21.15.139:0/2462644516 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fbc0035d0 con 0x7f8fd4143000 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc467a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 0x7fc4600b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc467a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4600d2c00 con 0x7fc4600cd400 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc467a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4600cd890 con 0x7fc460165020 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc467a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46006d020 con 0x7fc4601648b0 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 -- 172.21.15.139:0/2462644516 >> v2:172.21.15.176:3300/0 conn(0x7f8fd4142a80 msgr2=0x7f8fd40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 --2- 172.21.15.139:0/2462644516 >> v2:172.21.15.176:3300/0 conn(0x7f8fd4142a80 0x7f8fd40ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 -- 172.21.15.139:0/2462644516 >> v1:172.21.15.176:6789/0 conn(0x7f8fd4143000 legacy=0x7f8fd40717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 -- 172.21.15.139:0/4032375521 shutdown_connections 2024-09-13T17:24:44.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fe680200700 1 -- 172.21.15.139:0/3956985272 wait complete. 2024-09-13T17:24:44.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 -- 172.21.15.139:0/2462644516 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd406c9c0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4a1ca00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a18071550 0x7f4a1815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc465000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 0x7fc4600b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4a1ca00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1815cd50 con 0x7f4a1806df00 2024-09-13T17:24:44.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4a1ca00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1815d260 con 0x7f4a1815a330 2024-09-13T17:24:44.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4a1ca00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1806fe10 con 0x7f4a18071550 2024-09-13T17:24:44.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc465000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 0x7fc4600b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44264/0 (socket says 172.21.15.139:44264) 2024-09-13T17:24:44.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc465000700 1 -- 172.21.15.139:0/4254436828 learned_addr learned my addr 172.21.15.139:0/4254436828 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc45fe00700 1 --1- 172.21.15.139:0/4254436828 >> v1:172.21.15.139:6789/0 conn(0x7fc4600cd400 0x7fc4600d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:47566/0 (socket says 172.21.15.139:47566) 2024-09-13T17:24:44.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f8fda200700 1 --2- 172.21.15.139:0/2462644516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4071ec0 0x7f8fd406d4a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4066970 tx=0x7f8fcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00f97f5bf473ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7fc465a00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc460165020 0x7fc4600ce930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51892/0 (socket says 172.21.15.139:51892) 2024-09-13T17:24:44.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f4b09400700 1 -- 172.21.15.139:0/4032375521 wait complete. 2024-09-13T17:24:44.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7f76f3e00700 1 Processor -- start 2024-09-13T17:24:44.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 -- start start 2024-09-13T17:24:44.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.395+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788103359 0 0) 0x7feb800cced0 con 0x7feb80153610 2024-09-13T17:24:44.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb640035d0 con 0x7feb80153610 2024-09-13T17:24:44.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218716557 0 0) 0x7feb801539f0 con 0x7feb800cd360 2024-09-13T17:24:44.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb800cced0 con 0x7feb800cd360 2024-09-13T17:24:44.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fd3e00700 1 -- 172.21.15.139:0/2462644516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00e070 con 0x7f8fd4071ec0 2024-09-13T17:24:44.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc45f400700 1 -- 172.21.15.139:0/4254436828 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881290042 0 0) 0x7fc4600cd890 con 0x7fc460165020 2024-09-13T17:24:44.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc45f400700 1 -- 172.21.15.139:0/4254436828 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4480035d0 con 0x7fc460165020 2024-09-13T17:24:44.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b00677e0 con 0x7f15b015ebb0 2024-09-13T17:24:44.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fd3e00700 1 -- 172.21.15.139:0/2462644516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc003a40 con 0x7f8fd4071ec0 2024-09-13T17:24:44.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fd3e00700 1 -- 172.21.15.139:0/2462644516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc003df0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc465000700 1 -- 172.21.15.139:0/4254436828 >> v1:172.21.15.176:6789/0 conn(0x7fc460165020 legacy=0x7fc4600ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc465000700 1 -- 172.21.15.139:0/4254436828 >> v1:172.21.15.139:6789/0 conn(0x7fc4600cd400 legacy=0x7fc4600d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc465000700 1 -- 172.21.15.139:0/4254436828 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4600cdb70 con 0x7fc4601648b0 2024-09-13T17:24:44.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1317453355 0 0) 0x7feb640035d0 con 0x7feb80153610 2024-09-13T17:24:44.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb80159560 msgr2=0x7feb801599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb80159560 0x7feb801599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 >> v1:172.21.15.176:6789/0 conn(0x7feb800cd360 legacy=0x7feb800ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8015a370 con 0x7feb80153610 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7feb700015f0 con 0x7feb80153610 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 >> v1:172.21.15.139:6789/0 conn(0x7feb80153610 legacy=0x7feb80070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb64004c70 0x7feb64005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb64003810 0x7feb64003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb640041d0 0x7feb6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb780015b0 con 0x7feb64003810 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015a090 con 0x7feb640041d0 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6400c020 con 0x7feb64004c70 2024-09-13T17:24:44.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76f40cbe50 0x7f76f40aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 -- 172.21.15.139:0/2462644516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4071ec0 msgr2=0x7f8fd406d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 --2- 172.21.15.139:0/2462644516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4071ec0 0x7f8fd406d4a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4066970 tx=0x7f8fcc00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76f40cd670 0x7f76f406ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f4140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f406c330 con 0x7f76f40cbe50 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40aadd0 con 0x7f76f4145940 2024-09-13T17:24:44.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f406e2e0 con 0x7f76f40cd670 2024-09-13T17:24:44.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc465000700 1 --2- 172.21.15.139:0/4254436828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 0x7fc4600b5c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc454009940 tx=0x7fc454009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7150deffa37ef0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 -- 172.21.15.139:0/2462644516 shutdown_connections 2024-09-13T17:24:44.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 --2- 172.21.15.139:0/2462644516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4071ec0 0x7f8fd406d4a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 --2- 172.21.15.139:0/2462644516 >> v2:172.21.15.176:3300/0 conn(0x7f8fd4142a80 0x7f8fd40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 -- 172.21.15.139:0/2462644516 >> 172.21.15.139:0/2462644516 conn(0x7f8fd40ae6d0 msgr2=0x7f8fd40aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb85000700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb640041d0 0x7feb6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15a0007470 con 0x7f15b015ebb0 2024-09-13T17:24:44.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb64004c70 0x7feb64005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc45f400700 1 -- 172.21.15.139:0/4254436828 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454004230 con 0x7fc4601648b0 2024-09-13T17:24:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc45f400700 1 -- 172.21.15.139:0/4254436828 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454004390 con 0x7fc4601648b0 2024-09-13T17:24:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc45f400700 1 -- 172.21.15.139:0/4254436828 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454004230 con 0x7fc4601648b0 2024-09-13T17:24:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f4140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f4140da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:57126/0 (socket says 172.21.15.139:57126) 2024-09-13T17:24:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 -- 172.21.15.139:0/469864028 learned_addr learned my addr 172.21.15.139:0/469864028 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4a16a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a18071550 0x7f4a1815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4b09400700 1 Processor -- start 2024-09-13T17:24:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4a16a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a18071550 0x7f4a1815c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:57102/0 (socket says 172.21.15.139:57102) 2024-09-13T17:24:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4a16a00700 1 -- 172.21.15.139:0/3575010956 learned_addr learned my addr 172.21.15.139:0/3575010956 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fe680200700 1 Processor -- start 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 -- 172.21.15.139:0/2462644516 shutdown_connections 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f8fdac00700 1 -- 172.21.15.139:0/2462644516 wait complete. 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 -- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76f40cd670 msgr2=0x7f76f406ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76f40cd670 0x7f76f406ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 -- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76f40cbe50 msgr2=0x7f76f40aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76f40cbe50 0x7f76f40aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 -- 172.21.15.139:0/469864028 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40094b0 con 0x7f76f4145940 2024-09-13T17:24:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4b09400700 1 -- start start 2024-09-13T17:24:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4a16a00700 1 -- 172.21.15.139:0/3575010956 >> v1:172.21.15.176:6789/0 conn(0x7f4a1815a330 legacy=0x7f4a180b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4a16a00700 1 -- 172.21.15.139:0/3575010956 >> v1:172.21.15.139:6789/0 conn(0x7f4a1806df00 legacy=0x7f4a18070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f4a16a00700 1 -- 172.21.15.139:0/3575010956 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1815d540 con 0x7f4a18071550 2024-09-13T17:24:44.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc467a00700 1 -- 172.21.15.139:0/4254436828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 msgr2=0x7fc4600b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7fc467a00700 1 --2- 172.21.15.139:0/4254436828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 0x7fc4600b5c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc454009940 tx=0x7fc454009c50 comp rx=0 tx=0).stop 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f15a7e00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1590066730 0x7f1590068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15a0083fc0 con 0x7f15b015ebb0 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7f400700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb64003810 0x7feb64003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 -- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb640041d0 msgr2=0x7feb6400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb640041d0 0x7feb6400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 -- 172.21.15.139:0/3886805428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb64003810 msgr2=0x7feb64003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb64003810 0x7feb64003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 -- 172.21.15.139:0/3886805428 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8015a370 con 0x7feb64004c70 2024-09-13T17:24:44.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7feb7fe00700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb64004c70 0x7feb64005050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb7000e6c0 tx=0x7feb640058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a133c54c1860e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fc467a00700 1 -- 172.21.15.139:0/4254436828 shutdown_connections 2024-09-13T17:24:44.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fc467a00700 1 --2- 172.21.15.139:0/4254436828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4601648b0 0x7fc4600b5c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fc467a00700 1 -- 172.21.15.139:0/4254436828 >> 172.21.15.139:0/4254436828 conn(0x7fc4600b4b10 msgr2=0x7fc4600b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.399+0000 7f76f3400700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f4140da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00caa0 tx=0x7f76ec00cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4a16a00700 1 --2- 172.21.15.139:0/3575010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a18071550 0x7f4a1815c810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009e50 tx=0x7f4a0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcebfb951df7acd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 -- start start 2024-09-13T17:24:44.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00a7b0 con 0x7f76f4145940 2024-09-13T17:24:44.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec00a910 con 0x7f76f4145940 2024-09-13T17:24:44.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000e310 con 0x7feb64004c70 2024-09-13T17:24:44.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70014500 con 0x7feb64004c70 2024-09-13T17:24:44.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb7ea00700 1 -- 172.21.15.139:0/3886805428 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700148b0 con 0x7feb64004c70 2024-09-13T17:24:44.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f15af400700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1590066730 0x7f1590068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f40a8f90 con 0x7f76f4145940 2024-09-13T17:24:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f406bf50 con 0x7f76f4145940 2024-09-13T17:24:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4a16000700 1 -- 172.21.15.139:0/3575010956 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400e070 con 0x7f4a18071550 2024-09-13T17:24:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4a16000700 1 -- 172.21.15.139:0/3575010956 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04003a40 con 0x7f4a18071550 2024-09-13T17:24:44.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4a16000700 1 -- 172.21.15.139:0/3575010956 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04003df0 con 0x7f4a18071550 2024-09-13T17:24:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00aca0 con 0x7f76f4145940 2024-09-13T17:24:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f15af400700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1590066730 0x7f1590068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15b015e3c0 tx=0x7f159c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b09400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b040b64e0 0x7f4b041579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe678070590 0x7fe678142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f8fdac00700 1 Processor -- start 2024-09-13T17:24:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b09400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b040d0270 0x7f4b0415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b09400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b0415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f8fdac00700 1 -- start start 2024-09-13T17:24:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe678153610 0x7fe67813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678159aa0 0x7fe67815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe678140170 con 0x7fe678070590 2024-09-13T17:24:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780b3a10 con 0x7fe678153610 2024-09-13T17:24:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe680200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780b3450 con 0x7fe678159aa0 2024-09-13T17:24:44.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b09400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0415a350 con 0x7f4b040b64e0 2024-09-13T17:24:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fc467a00700 1 -- 172.21.15.139:0/4254436828 shutdown_connections 2024-09-13T17:24:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b09400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04159330 con 0x7f4b040d0270 2024-09-13T17:24:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b0415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b0415dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44290/0 (socket says 172.21.15.139:44290) 2024-09-13T17:24:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 -- 172.21.15.139:0/3199222381 learned_addr learned my addr 172.21.15.139:0/3199222381 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04159590 con 0x7f4b040d1030 2024-09-13T17:24:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe67e200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678159aa0 0x7fe67815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe67e200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678159aa0 0x7fe67815cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44304/0 (socket says 172.21.15.139:44304) 2024-09-13T17:24:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fe67e200700 1 -- 172.21.15.139:0/126492482 learned_addr learned my addr 172.21.15.139:0/126492482 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7fc467a00700 1 -- 172.21.15.139:0/4254436828 wait complete. 2024-09-13T17:24:44.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b03e00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b040b64e0 0x7f4b041579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4a1ca00700 1 -- 172.21.15.139:0/3575010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a18071550 msgr2=0x7f4a1815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/3575010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a18071550 0x7f4a1815c810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009e50 tx=0x7f4a0400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:44.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc005310 con 0x7f76f4145940 2024-09-13T17:24:44.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb87000700 1 -- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb64004c70 msgr2=0x7feb64005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb87000700 1 --2- 172.21.15.139:0/3886805428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb64004c70 0x7feb64005050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb7000e6c0 tx=0x7feb640058a0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb85000700 1 -- 172.21.15.139:0/3886805428 reap_dead start 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb87000700 1 -- 172.21.15.139:0/3886805428 shutdown_connections 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb87000700 1 -- 172.21.15.139:0/3886805428 >> 172.21.15.139:0/3886805428 conn(0x7feb8006b1e0 msgr2=0x7feb8006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 -- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b040d0270 msgr2=0x7f4b0415b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b040d0270 0x7f4b0415b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 -- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b040b64e0 msgr2=0x7f4b041579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f8fdac00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 0x7f8fd4159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7f4b08a00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b040b64e0 0x7f4b041579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.403+0000 7feb87000700 1 -- 172.21.15.139:0/3886805428 shutdown_connections 2024-09-13T17:24:44.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4b08a00700 1 -- 172.21.15.139:0/3199222381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4009570 con 0x7f4b040d1030 2024-09-13T17:24:44.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4b03e00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b040b64e0 0x7f4b041579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:44.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fdac00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4142a80 0x7f8fd413e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe678153610 0x7fe67813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7feb87000700 1 -- 172.21.15.139:0/3886805428 wait complete. 2024-09-13T17:24:44.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fdac00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fd4143000 0x7f8fd413f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fdac00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd413ee30 con 0x7f8fd4142a80 2024-09-13T17:24:44.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fdac00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd413c840 con 0x7f8fd4143000 2024-09-13T17:24:44.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 0x7f8fd4159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4b08a00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b0415dc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009150 tx=0x7f4af4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fdac00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd413cae0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 0x7f8fd4159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44320/0 (socket says 172.21.15.139:44320) 2024-09-13T17:24:44.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 -- 172.21.15.139:0/972382790 learned_addr learned my addr 172.21.15.139:0/972382790 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 -- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678159aa0 msgr2=0x7fe67815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678159aa0 0x7fe67815cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 -- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe678070590 msgr2=0x7fe678142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe678070590 0x7fe678142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 -- 172.21.15.139:0/126492482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c0094b0 con 0x7fe678153610 2024-09-13T17:24:44.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe67ce00700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe678153610 0x7fe67813ec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe66400e840 tx=0x7fe66400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fc467a00700 1 Processor -- start 2024-09-13T17:24:44.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4004500 con 0x7f4b040d1030 2024-09-13T17:24:44.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af40036c0 con 0x7f4b040d1030 2024-09-13T17:24:44.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664013680 con 0x7fe678153610 2024-09-13T17:24:44.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4003a70 con 0x7f4b040d1030 2024-09-13T17:24:44.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b04159870 con 0x7f4b040d1030 2024-09-13T17:24:44.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76ec01b3b0 con 0x7f76f4145940 2024-09-13T17:24:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6640137e0 con 0x7fe678153610 2024-09-13T17:24:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fda200700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fd4143000 0x7f8fd413f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 -- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fd4143000 msgr2=0x7f8fd413f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6780b3730 con 0x7fe678153610 2024-09-13T17:24:44.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe678151f00 con 0x7fe678153610 2024-09-13T17:24:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fd4143000 0x7f8fd413f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 -- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4142a80 msgr2=0x7f8fd413e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4142a80 0x7f8fd413e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 -- 172.21.15.139:0/972382790 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc009b30 con 0x7f8fd4071ec0 2024-09-13T17:24:44.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664013b50 con 0x7fe678153610 2024-09-13T17:24:44.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fda200700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fd4143000 0x7f8fd413f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:44.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f76eaa00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f76d4066760 0x7f76d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7feb87000700 1 Processor -- start 2024-09-13T17:24:44.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76ec083e30 con 0x7f76f4145940 2024-09-13T17:24:44.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fc467a00700 1 -- start start 2024-09-13T17:24:44.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b04159e30 con 0x7f4b040d1030 2024-09-13T17:24:44.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4a1ca00700 1 -- 172.21.15.139:0/3575010956 shutdown_connections 2024-09-13T17:24:44.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/3575010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a18071550 0x7f4a1815c810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4a1ca00700 1 -- 172.21.15.139:0/3575010956 >> 172.21.15.139:0/3575010956 conn(0x7f4a180ce9d0 msgr2=0x7f4a180cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f4a1ca00700 1 -- 172.21.15.139:0/3575010956 shutdown_connections 2024-09-13T17:24:44.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f4a1ca00700 1 -- 172.21.15.139:0/3575010956 wait complete. 2024-09-13T17:24:44.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67806d2a0 con 0x7fe678153610 2024-09-13T17:24:44.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.407+0000 7f8fd9800700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 0x7f8fd4159590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800e9d0 tx=0x7f8fc800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc005310 con 0x7f4b040d1030 2024-09-13T17:24:44.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc467a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4601648b0 0x7fc4601f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc467a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc460165020 0x7fc46015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800c850 con 0x7f8fd4071ec0 2024-09-13T17:24:44.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc800c9b0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd413cdc0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800cd20 con 0x7f8fd4071ec0 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd413d5c0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc467a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 0x7fc4601592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc467a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015b030 con 0x7fc4601648b0 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc467a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015ad50 con 0x7fc460165020 2024-09-13T17:24:44.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd406d4a0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc467a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4600c9fb0 con 0x7fc4600ccae0 2024-09-13T17:24:44.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 0x7fc4601592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 0x7fc4601592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:44330/0 (socket says 172.21.15.139:44330) 2024-09-13T17:24:44.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465a00700 1 -- 172.21.15.139:0/2340048532 learned_addr learned my addr 172.21.15.139:0/2340048532 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465000700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4601648b0 0x7fc4601f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f76f2a00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f76d4066760 0x7f76d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7feb87000700 1 -- start start 2024-09-13T17:24:44.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f4a1ca00700 1 Processor -- start 2024-09-13T17:24:44.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7feb87000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8014bde0 0x7feb8014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f4a1ca00700 1 -- start start 2024-09-13T17:24:44.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7feb87000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 0x7feb8015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7feb87000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb8015d260 0x7feb8014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7feb87000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015d6e0 con 0x7feb8014bde0 2024-09-13T17:24:44.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4af4003bd0 con 0x7f4b040d1030 2024-09-13T17:24:44.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7feb87000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80153d20 con 0x7feb80157cf0 2024-09-13T17:24:44.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb87000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8014dfe0 con 0x7feb8015d260 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc45fe00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc460165020 0x7fc46015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465a00700 1 -- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc460165020 msgr2=0x7fc46015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc460165020 0x7fc46015a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.411+0000 7fc465a00700 1 -- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4601648b0 msgr2=0x7fc4601f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7fc465a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4601648b0 0x7fc4601f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7fc465a00700 1 -- 172.21.15.139:0/2340048532 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454009570 con 0x7fc4600ccae0 2024-09-13T17:24:44.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7fc465000700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4601648b0 0x7fc4601f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:44.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 0x7feb8015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 0x7feb8015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:57162/0 (socket says 172.21.15.139:57162) 2024-09-13T17:24:44.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 -- 172.21.15.139:0/1430396249 learned_addr learned my addr 172.21.15.139:0/1430396249 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb85000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb8015d260 0x7feb8014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7fe00700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8014bde0 0x7feb8014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f76f2a00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f76d4066760 0x7f76d4068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76f41fa300 tx=0x7f76e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7fc465a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 0x7fc4601592d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc45800cba0 tx=0x7fc45800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15a00b5db0 con 0x7f15b015ebb0 2024-09-13T17:24:44.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 -- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb8015d260 msgr2=0x7feb8014fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb8015d260 0x7feb8014fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 -- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8014bde0 msgr2=0x7feb8014cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8014bde0 0x7feb8014cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 -- 172.21.15.139:0/1430396249 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8014d470 con 0x7feb80157cf0 2024-09-13T17:24:44.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb85000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb8015d260 0x7feb8014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:44.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4afbe00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4ae4066800 0x7f4ae4068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4af4086010 con 0x7f4b040d1030 2024-09-13T17:24:44.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a1ca00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1806df00 0x7f4a180b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a1ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a18071550 0x7f4a18156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a1ca00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 0x7f4a1806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb7f400700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 0x7feb8015cd20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb6c011550 tx=0x7feb6c011910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a1ca00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18157df0 con 0x7f4a1815a330 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a1ca00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a181f6990 con 0x7f4a1806df00 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a1ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a181571e0 con 0x7f4a18071550 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 0x7f4a1806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 0x7f4a1806d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37476/0 (socket says 172.21.15.139:37476) 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 -- 172.21.15.139:0/363931059 learned_addr learned my addr 172.21.15.139:0/363931059 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a16a00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a18071550 0x7f4a18156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17400700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1806df00 0x7f4a180b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4b03e00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4ae4066800 0x7f4ae4068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 -- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a18071550 msgr2=0x7f4a18156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a18071550 0x7f4a18156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 -- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1806df00 msgr2=0x7f4a180b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1806df00 0x7f4a180b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c015870 con 0x7feb80157cf0 2024-09-13T17:24:44.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c0159f0 con 0x7feb80157cf0 2024-09-13T17:24:44.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c015da0 con 0x7feb80157cf0 2024-09-13T17:24:44.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8014d740 con 0x7feb80157cf0 2024-09-13T17:24:44.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.415+0000 7f4a17e00700 1 -- 172.21.15.139:0/363931059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04009b30 con 0x7f4a1815a330 2024-09-13T17:24:44.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8014dd00 con 0x7feb80157cf0 2024-09-13T17:24:44.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76ec050ea0 con 0x7f76f4145940 2024-09-13T17:24:44.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4b03e00700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4ae4066800 0x7f4ae4068cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4af00089d0 tx=0x7f4af0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a17e00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 0x7f4a1806d480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b4b0 tx=0x7f4a1000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011830 con 0x7f4a1815a330 2024-09-13T17:24:44.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a181574c0 con 0x7f4a1815a330 2024-09-13T17:24:44.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011990 con 0x7f4a1815a330 2024-09-13T17:24:44.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011830 con 0x7f4a1815a330 2024-09-13T17:24:44.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80070740 con 0x7feb80157cf0 2024-09-13T17:24:44.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a18157a80 con 0x7f4a1815a330 2024-09-13T17:24:44.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800ab80 con 0x7fc4600ccae0 2024-09-13T17:24:44.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45800ad00 con 0x7fc4600ccae0 2024-09-13T17:24:44.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458007310 con 0x7fc4600ccae0 2024-09-13T17:24:44.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe664013cb0 con 0x7fe678153610 2024-09-13T17:24:44.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4600ca290 con 0x7fc4600ccae0 2024-09-13T17:24:44.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46015aa40 con 0x7fc4600ccae0 2024-09-13T17:24:44.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4600ca7b0 con 0x7fc4600ccae0 2024-09-13T17:24:44.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7fe675600700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe658066790 0x7fe658068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.419+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a18157fa0 con 0x7f4a1815a330 2024-09-13T17:24:44.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4af4053100 con 0x7f4b040d1030 2024-09-13T17:24:44.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fc8013470 con 0x7f8fd4071ec0 2024-09-13T17:24:44.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6640849b0 con 0x7fe678153610 2024-09-13T17:24:44.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7f8fd1600700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8fb4066780 0x7f8fb4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7fe67d800700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe658066790 0x7fe658068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe664051a20 con 0x7fe678153610 2024-09-13T17:24:44.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a10011b00 con 0x7f4a1815a330 2024-09-13T17:24:44.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7f4a0f400700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066790 0x7f49f8068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.427+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a10083bf0 con 0x7f4a1815a330 2024-09-13T17:24:44.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.427+0000 7fe67d800700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe658066790 0x7fe658068c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009ba0 tx=0x7fe66c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.423+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fc8084c50 con 0x7f8fd4071ec0 2024-09-13T17:24:44.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.427+0000 7f8fd8e00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8fb4066780 0x7f8fb4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.427+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb6c013400 con 0x7feb80157cf0 2024-09-13T17:24:44.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.427+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fc8084e60 con 0x7f8fd4071ec0 2024-09-13T17:24:44.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.427+0000 7f4a17400700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066790 0x7f49f8068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7f8fd8e00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8fb4066780 0x7f8fb4068c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000f60 tx=0x7f8fc0007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7feb77e00700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb60066830 0x7feb60068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7f4a17400700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066790 0x7f49f8068c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a08005150 tx=0x7f4a08007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb6c084e40 con 0x7feb80157cf0 2024-09-13T17:24:44.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc458007470 con 0x7fc4600ccae0 2024-09-13T17:24:44.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7fc45cc00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc440066800 0x7fc440068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:44.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4580845e0 con 0x7fc4600ccae0 2024-09-13T17:24:44.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc458084a60 con 0x7fc4600ccae0 2024-09-13T17:24:44.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb6c0852c0 con 0x7feb80157cf0 2024-09-13T17:24:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.431+0000 7feb7fe00700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb60066830 0x7feb60068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.435+0000 7feb7fe00700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb60066830 0x7feb60068cf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c00 tx=0x7feb7000d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.439+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a18157fa0 con 0x7f4a1815a330 2024-09-13T17:24:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.439+0000 7fc465000700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc440066800 0x7fc440068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.439+0000 7fc465000700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc440066800 0x7fc440068cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc454009fd0 tx=0x7fc454008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:44.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.755+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f76cc0055c0 con 0x7f76f4145940 2024-09-13T17:24:44.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.755+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15b01434d0 con 0x7f15b015ebb0 2024-09-13T17:24:44.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.755+0000 7f76eaa00700 1 -- 172.21.15.139:0/469864028 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76ec0544c0 con 0x7f76f4145940 2024-09-13T17:24:44.761 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-09-13T17:24:44.761 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.759+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4adc005890 con 0x7f4b040d1030 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.759+0000 7f4afbe00700 1 -- 172.21.15.139:0/3199222381 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4af4020020 con 0x7f4b040d1030 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.759+0000 7f15a7e00700 1 -- 172.21.15.139:0/1417546841 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15a0051040 con 0x7f15b015ebb0 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f76d4066760 msgr2=0x7f76d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f76d4066760 0x7f76d4068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76f41fa300 tx=0x7f76e4010000 comp rx=0 tx=0).stop 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 msgr2=0x7f76f4140da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f4140da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00caa0 tx=0x7f76ec00cb80 comp rx=0 tx=0).stop 2024-09-13T17:24:44.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4ae4066800 msgr2=0x7f4ae4068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4ae4066800 0x7f4ae4068cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4af00089d0 tx=0x7f4af0008040 comp rx=0 tx=0).stop 2024-09-13T17:24:44.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 msgr2=0x7f4b0415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b0415dc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009150 tx=0x7f4af4004770 comp rx=0 tx=0).stop 2024-09-13T17:24:44.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 shutdown_connections 2024-09-13T17:24:44.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4ae4066800 0x7f4ae4068cc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b040d1030 0x7f4b0415dc40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b040d0270 0x7f4b0415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 --2- 172.21.15.139:0/3199222381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b040b64e0 0x7f4b041579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 >> 172.21.15.139:0/3199222381 conn(0x7f4b04071fa0 msgr2=0x7f4b04162110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.767 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-09-13T17:24:44.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 shutdown_connections 2024-09-13T17:24:44.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f4b09400700 1 -- 172.21.15.139:0/3199222381 wait complete. 2024-09-13T17:24:44.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 shutdown_connections 2024-09-13T17:24:44.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f76d4066760 0x7f76d4068c20 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76f41fa300 tx=0x7f76e4010000 comp rx=0 tx=0).stop 2024-09-13T17:24:44.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76f4145940 0x7f76f4140da0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76f40cd670 0x7f76f406ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 --2- 172.21.15.139:0/469864028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76f40cbe50 0x7f76f40aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 >> 172.21.15.139:0/469864028 conn(0x7f76f40ae6d0 msgr2=0x7f76f40ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.770 INFO:teuthology.orchestra.run.smithi139.stdout:55834574857 2024-09-13T17:24:44.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.763+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe678072170 con 0x7fe678153610 2024-09-13T17:24:44.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7fe675600700 1 -- 172.21.15.139:0/126492482 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe664055040 con 0x7fe678153610 2024-09-13T17:24:44.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 shutdown_connections 2024-09-13T17:24:44.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f76f3e00700 1 -- 172.21.15.139:0/469864028 wait complete. 2024-09-13T17:24:44.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4600ca7b0 con 0x7fc4600ccae0 2024-09-13T17:24:44.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1590066730 msgr2=0x7f1590068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1590066730 0x7f1590068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15b015e3c0 tx=0x7f159c0090e0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ebb0 msgr2=0x7f15b0156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ebb0 0x7f15b0156180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c520 tx=0x7f15a000c830 comp rx=0 tx=0).stop 2024-09-13T17:24:44.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8fd413efa0 con 0x7f8fd4071ec0 2024-09-13T17:24:44.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 shutdown_connections 2024-09-13T17:24:44.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1590066730 0x7f1590068bf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe658066790 msgr2=0x7fe658068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7fe680200700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe658066790 0x7fe658068c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009ba0 tx=0x7fe66c010000 comp rx=0 tx=0).stop 2024-09-13T17:24:44.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe678153610 msgr2=0x7fe67813ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7fe680200700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe678153610 0x7fe67813ec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe66400e840 tx=0x7fe66400eb50 comp rx=0 tx=0).stop 2024-09-13T17:24:44.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b015f5c0 0x7f15b013a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 shutdown_connections 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe658066790 0x7fe658068c50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe678159aa0 0x7fe67815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe678153610 0x7fe67813ec40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 --2- 172.21.15.139:0/126492482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe678070590 0x7fe678142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 >> 172.21.15.139:0/126492482 conn(0x7fe67806b1e0 msgr2=0x7fe67815a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b015ef90 0x7f15b013b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 --2- 172.21.15.139:0/1417546841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15b015ebb0 0x7f15b0156180 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.767+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 >> 172.21.15.139:0/1417546841 conn(0x7f15b0071fa0 msgr2=0x7f15b0141160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 shutdown_connections 2024-09-13T17:24:44.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7f15b5a00700 1 -- 172.21.15.139:0/1417546841 wait complete. 2024-09-13T17:24:44.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7f8fd1600700 1 -- 172.21.15.139:0/972382790 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc8021090 con 0x7f8fd4071ec0 2024-09-13T17:24:44.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 shutdown_connections 2024-09-13T17:24:44.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fe680200700 1 -- 172.21.15.139:0/126492482 wait complete. 2024-09-13T17:24:44.777 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-09-13T17:24:44.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.771+0000 7fc45cc00700 1 -- 172.21.15.139:0/2340048532 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4600ca7b0 con 0x7fc4600ccae0 2024-09-13T17:24:44.777 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-09-13T17:24:44.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8fb4066780 msgr2=0x7f8fb4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8fb4066780 0x7f8fb4068c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000f60 tx=0x7f8fc0007a60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 msgr2=0x7f8fd4159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 0x7f8fd4159590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800e9d0 tx=0x7f8fc800ed90 comp rx=0 tx=0).stop 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 shutdown_connections 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8fb4066780 0x7f8fb4068c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fd4143000 0x7f8fd413f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd4142a80 0x7f8fd413e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 --2- 172.21.15.139:0/972382790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fd4071ec0 0x7f8fd4159590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 >> 172.21.15.139:0/972382790 conn(0x7f8fd40ae6d0 msgr2=0x7f8fd40ad040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4a18157fa0 con 0x7f4a1815a330 2024-09-13T17:24:44.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 shutdown_connections 2024-09-13T17:24:44.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7f8fdac00700 1 -- 172.21.15.139:0/972382790 wait complete. 2024-09-13T17:24:44.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc440066800 msgr2=0x7fc440068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7fc467a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc440066800 0x7fc440068cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc454009fd0 tx=0x7fc454008030 comp rx=0 tx=0).stop 2024-09-13T17:24:44.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 msgr2=0x7fc4601592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.775+0000 7fc467a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 0x7fc4601592d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc45800cba0 tx=0x7fc45800cf60 comp rx=0 tx=0).stop 2024-09-13T17:24:44.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7feb80070740 con 0x7feb80157cf0 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 shutdown_connections 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc440066800 0x7fc440068cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4600ccae0 0x7fc4601592d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc460165020 0x7fc46015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 --2- 172.21.15.139:0/2340048532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4601648b0 0x7fc4601f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 >> 172.21.15.139:0/2340048532 conn(0x7fc4600b4b10 msgr2=0x7fc4600b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 shutdown_connections 2024-09-13T17:24:44.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7fc467a00700 1 -- 172.21.15.139:0/2340048532 wait complete. 2024-09-13T17:24:44.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7feb77e00700 1 -- 172.21.15.139:0/1430396249 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb80070740 con 0x7feb80157cf0 2024-09-13T17:24:44.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.779+0000 7f4a0f400700 1 -- 172.21.15.139:0/363931059 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a18157fa0 con 0x7f4a1815a330 2024-09-13T17:24:44.784 INFO:teuthology.orchestra.run.smithi139.stdout:55834574857 2024-09-13T17:24:44.784 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-09-13T17:24:44.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb60066830 msgr2=0x7feb60068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb60066830 0x7feb60068cf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c00 tx=0x7feb7000d000 comp rx=0 tx=0).stop 2024-09-13T17:24:44.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 msgr2=0x7feb8015cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066790 msgr2=0x7f49f8068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 0x7feb8015cd20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb6c011550 tx=0x7feb6c011910 comp rx=0 tx=0).stop 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 shutdown_connections 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feb60066830 0x7feb60068cf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb8015d260 0x7feb8014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb80157cf0 0x7feb8015cd20 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb6c011550 tx=0x7feb6c011910 comp rx=0 tx=0).stop 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 --2- 172.21.15.139:0/1430396249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8014bde0 0x7feb8014cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 >> 172.21.15.139:0/1430396249 conn(0x7feb8006b1e0 msgr2=0x7feb800715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066790 0x7f49f8068c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a08005150 tx=0x7f4a08007ee0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 shutdown_connections 2024-09-13T17:24:44.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7feb87000700 1 -- 172.21.15.139:0/1430396249 wait complete. 2024-09-13T17:24:44.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 msgr2=0x7f4a1806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:44.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 0x7f4a1806d480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b4b0 tx=0x7f4a1000b7c0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 shutdown_connections 2024-09-13T17:24:44.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066790 0x7f49f8068c50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1815a330 0x7f4a1806d480 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a18071550 0x7f4a18156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 --2- 172.21.15.139:0/363931059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1806df00 0x7f4a180b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:44.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.787+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 >> 172.21.15.139:0/363931059 conn(0x7f4a180ce9d0 msgr2=0x7f4a18070540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:44.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.791+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 shutdown_connections 2024-09-13T17:24:44.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:44.791+0000 7f4a1ca00700 1 -- 172.21.15.139:0/363931059 wait complete. 2024-09-13T17:24:44.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-09-13T17:24:44.795 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-09-13T17:24:44.797 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-09-13T17:24:44.805 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-09-13T17:24:44.807 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-09-13T17:24:44.807 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-09-13T17:24:44.812 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-09-13T17:24:44.812 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-09-13T17:24:44.823 DEBUG:teuthology.parallel:result is None 2024-09-13T17:24:44.823 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:24:44.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:45.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.023+0000 7fdc69a00700 1 Processor -- start 2024-09-13T17:24:45.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.023+0000 7fdc69a00700 1 -- start start 2024-09-13T17:24:45.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc69a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdc64144770 0x7fdc640ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc69a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc6406d9b0 0x7fdc6415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc69a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6415c160 con 0x7fdc6415b1c0 2024-09-13T17:24:45.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc69a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6415c540 con 0x7fdc64144770 2024-09-13T17:24:45.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc69a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc64144b50 con 0x7fdc6406d9b0 2024-09-13T17:24:45.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc62000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fdc6415b1c0 0x7fdc6406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51372/0 (socket says 172.21.15.139:51372) 2024-09-13T17:24:45.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc62000700 1 -- 172.21.15.139:0/2310171666 learned_addr learned my addr 172.21.15.139:0/2310171666 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:45.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc62a00700 1 --2- 172.21.15.139:0/2310171666 >> v2:172.21.15.139:3300/0 conn(0x7fdc64144770 0x7fdc640ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc63400700 1 --2- 172.21.15.139:0/2310171666 >> v2:172.21.15.176:3300/0 conn(0x7fdc6406d9b0 0x7fdc6415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc61600700 1 -- 172.21.15.139:0/2310171666 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967698951 0 0) 0x7fdc6415c160 con 0x7fdc6415b1c0 2024-09-13T17:24:45.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc61600700 1 -- 172.21.15.139:0/2310171666 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc480035d0 con 0x7fdc6415b1c0 2024-09-13T17:24:45.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc63400700 1 -- 172.21.15.139:0/2310171666 >> v2:172.21.15.139:3300/0 conn(0x7fdc64144770 msgr2=0x7fdc640ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:45.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc63400700 1 --2- 172.21.15.139:0/2310171666 >> v2:172.21.15.139:3300/0 conn(0x7fdc64144770 0x7fdc640ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc63400700 1 -- 172.21.15.139:0/2310171666 >> v1:172.21.15.139:6789/0 conn(0x7fdc6415b1c0 legacy=0x7fdc6406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.027+0000 7fdc63400700 1 -- 172.21.15.139:0/2310171666 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6415b620 con 0x7fdc6406d9b0 2024-09-13T17:24:45.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc63400700 1 --2- 172.21.15.139:0/2310171666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6415c9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc640cbbd0 tx=0x7fdc5c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f187edfce0170c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc61600700 1 -- 172.21.15.139:0/2310171666 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00e070 con 0x7fdc6406d9b0 2024-09-13T17:24:45.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc61600700 1 -- 172.21.15.139:0/2310171666 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c00bb20 con 0x7fdc6406d9b0 2024-09-13T17:24:45.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc61600700 1 -- 172.21.15.139:0/2310171666 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c012430 con 0x7fdc6406d9b0 2024-09-13T17:24:45.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 -- 172.21.15.139:0/2310171666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 msgr2=0x7fdc6415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 --2- 172.21.15.139:0/2310171666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6415c9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc640cbbd0 tx=0x7fdc5c00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:45.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 -- 172.21.15.139:0/2310171666 shutdown_connections 2024-09-13T17:24:45.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 --2- 172.21.15.139:0/2310171666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6415c9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 --2- 172.21.15.139:0/2310171666 >> v2:172.21.15.139:3300/0 conn(0x7fdc64144770 0x7fdc640ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 -- 172.21.15.139:0/2310171666 >> 172.21.15.139:0/2310171666 conn(0x7fdc6406b1e0 msgr2=0x7fdc6406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:45.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 -- 172.21.15.139:0/2310171666 shutdown_connections 2024-09-13T17:24:45.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.031+0000 7fdc69a00700 1 -- 172.21.15.139:0/2310171666 wait complete. 2024-09-13T17:24:45.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 Processor -- start 2024-09-13T17:24:45.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 -- start start 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6413cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc64144770 0x7fdc641409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 0x7fdc640711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6413d480 con 0x7fdc6415b1c0 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6413f940 con 0x7fdc6406d9b0 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6413fc20 con 0x7fdc64144770 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 0x7fdc640711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 0x7fdc640711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36400/0 (socket says 172.21.15.139:36400) 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 -- 172.21.15.139:0/1507765767 learned_addr learned my addr 172.21.15.139:0/1507765767 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc62a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6413cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc62000700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc64144770 0x7fdc641409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 -- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc64144770 msgr2=0x7fdc641409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc64144770 0x7fdc641409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 -- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 msgr2=0x7fdc6413cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6413cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 -- 172.21.15.139:0/1507765767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c009a70 con 0x7fdc6415b1c0 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc63400700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 0x7fdc640711b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c014040 tx=0x7fdc5c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c012430 con 0x7fdc6415b1c0 2024-09-13T17:24:45.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c020070 con 0x7fdc6415b1c0 2024-09-13T17:24:45.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6413ff00 con 0x7fdc6415b1c0 2024-09-13T17:24:45.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.035+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0098f0 con 0x7fdc6415b1c0 2024-09-13T17:24:45.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.039+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc641404c0 con 0x7fdc6415b1c0 2024-09-13T17:24:45.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.039+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc640cdde0 con 0x7fdc6415b1c0 2024-09-13T17:24:45.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.043+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc5c004040 con 0x7fdc6415b1c0 2024-09-13T17:24:45.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.043+0000 7fdc5aa00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdc44066730 0x7fdc44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.043+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc5c022070 con 0x7fdc6415b1c0 2024-09-13T17:24:45.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.043+0000 7fdc62a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdc44066730 0x7fdc44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.043+0000 7fdc62a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdc44066730 0x7fdc44068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009bf0 tx=0x7fdc54009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.047+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc5c0571a0 con 0x7fdc6415b1c0 2024-09-13T17:24:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.219+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc6415be80 con 0x7fdc44066730 2024-09-13T17:24:45.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.235+0000 7fdc5aa00700 1 -- 172.21.15.139:0/1507765767 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345098 (secure 0 0 0) 0x7fdc540118c0 con 0x7fdc44066730 2024-09-13T17:24:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:45.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdc44066730 msgr2=0x7fdc44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdc44066730 0x7fdc44068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009bf0 tx=0x7fdc54009240 comp rx=0 tx=0).stop 2024-09-13T17:24:45.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 msgr2=0x7fdc640711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 0x7fdc640711b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c014040 tx=0x7fdc5c004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 shutdown_connections 2024-09-13T17:24:45.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdc44066730 0x7fdc44068bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.239+0000 7fdc69a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc6415b1c0 0x7fdc640711b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.243+0000 7fdc69a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc64144770 0x7fdc641409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.243+0000 7fdc69a00700 1 --2- 172.21.15.139:0/1507765767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6406d9b0 0x7fdc6413cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.243+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 >> 172.21.15.139:0/1507765767 conn(0x7fdc6406b1e0 msgr2=0x7fdc640af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:45.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.243+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 shutdown_connections 2024-09-13T17:24:45.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.243+0000 7fdc69a00700 1 -- 172.21.15.139:0/1507765767 wait complete. 2024-09-13T17:24:45.250 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:24:45.267 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-13T17:24:44.095032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005106"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476754+0000","last_change":"2024-09-13T17:24:14.997748+0000","last_active":"2024-09-13T17:24:19.476754+0000","last_peered":"2024-09-13T17:24:19.476754+0000","last_clean":"2024-09-13T17:24:19.476754+0000","last_became_active":"2024-09-13T17:24:14.997395+0000","last_became_peered":"2024-09-13T17:24:14.997395+0000","last_unstale":"2024-09-13T17:24:19.476754+0000","last_undegraded":"2024-09-13T17:24:19.476754+0000","last_fullsized":"2024-09-13T17:24:19.476754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:08.882065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474419+0000","last_change":"2024-09-13T17:24:15.472848+0000","last_active":"2024-09-13T17:24:19.474419+0000","last_peered":"2024-09-13T17:24:19.474419+0000","last_clean":"2024-09-13T17:24:19.474419+0000","last_became_active":"2024-09-13T17:24:15.472568+0000","last_became_peered":"2024-09-13T17:24:15.472568+0000","last_unstale":"2024-09-13T17:24:19.474419+0000","last_undegraded":"2024-09-13T17:24:19.474419+0000","last_fullsized":"2024-09-13T17:24:19.474419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933480+0000","last_change":"2024-09-13T17:24:19.822998+0000","last_active":"2024-09-13T17:24:19.933480+0000","last_peered":"2024-09-13T17:24:19.933480+0000","last_clean":"2024-09-13T17:24:19.933480+0000","last_became_active":"2024-09-13T17:24:19.822588+0000","last_became_peered":"2024-09-13T17:24:19.822588+0000","last_unstale":"2024-09-13T17:24:19.933480+0000","last_undegraded":"2024-09-13T17:24:19.933480+0000","last_fullsized":"2024-09-13T17:24:19.933480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:55.423743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475101+0000","last_change":"2024-09-13T17:24:14.998585+0000","last_active":"2024-09-13T17:24:19.475101+0000","last_peered":"2024-09-13T17:24:19.475101+0000","last_clean":"2024-09-13T17:24:19.475101+0000","last_became_active":"2024-09-13T17:24:14.997238+0000","last_became_peered":"2024-09-13T17:24:14.997238+0000","last_unstale":"2024-09-13T17:24:19.475101+0000","last_undegraded":"2024-09-13T17:24:19.475101+0000","last_fullsized":"2024-09-13T17:24:19.475101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476604+0000","last_change":"2024-09-13T17:24:15.447613+0000","last_active":"2024-09-13T17:24:19.476604+0000","last_peered":"2024-09-13T17:24:19.476604+0000","last_clean":"2024-09-13T17:24:19.476604+0000","last_became_active":"2024-09-13T17:24:15.447292+0000","last_became_peered":"2024-09-13T17:24:15.447292+0000","last_unstale":"2024-09-13T17:24:19.476604+0000","last_undegraded":"2024-09-13T17:24:19.476604+0000","last_fullsized":"2024-09-13T17:24:19.476604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935221+0000","last_change":"2024-09-13T17:24:19.483196+0000","last_active":"2024-09-13T17:24:19.935221+0000","last_peered":"2024-09-13T17:24:19.935221+0000","last_clean":"2024-09-13T17:24:19.935221+0000","last_became_active":"2024-09-13T17:24:19.482655+0000","last_became_peered":"2024-09-13T17:24:19.482655+0000","last_unstale":"2024-09-13T17:24:19.935221+0000","last_undegraded":"2024-09-13T17:24:19.935221+0000","last_fullsized":"2024-09-13T17:24:19.935221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815101+0000","last_change":"2024-09-13T17:24:15.000813+0000","last_active":"2024-09-13T17:24:19.815101+0000","last_peered":"2024-09-13T17:24:19.815101+0000","last_clean":"2024-09-13T17:24:19.815101+0000","last_became_active":"2024-09-13T17:24:15.000349+0000","last_became_peered":"2024-09-13T17:24:15.000349+0000","last_unstale":"2024-09-13T17:24:19.815101+0000","last_undegraded":"2024-09-13T17:24:19.815101+0000","last_fullsized":"2024-09-13T17:24:19.815101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:15.469818+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:15.469543+0000","last_became_peered":"2024-09-13T17:24:15.469543+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935701+0000","last_change":"2024-09-13T17:24:19.493757+0000","last_active":"2024-09-13T17:24:19.935701+0000","last_peered":"2024-09-13T17:24:19.935701+0000","last_clean":"2024-09-13T17:24:19.935701+0000","last_became_active":"2024-09-13T17:24:19.493366+0000","last_became_peered":"2024-09-13T17:24:19.493366+0000","last_unstale":"2024-09-13T17:24:19.935701+0000","last_undegraded":"2024-09-13T17:24:19.935701+0000","last_fullsized":"2024-09-13T17:24:19.935701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:14.535914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814303+0000","last_change":"2024-09-13T17:24:14.999109+0000","last_active":"2024-09-13T17:24:19.814303+0000","last_peered":"2024-09-13T17:24:19.814303+0000","last_clean":"2024-09-13T17:24:19.814303+0000","last_became_active":"2024-09-13T17:24:14.998768+0000","last_became_peered":"2024-09-13T17:24:14.998768+0000","last_unstale":"2024-09-13T17:24:19.814303+0000","last_undegraded":"2024-09-13T17:24:19.814303+0000","last_fullsized":"2024-09-13T17:24:19.814303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471317+0000","last_change":"2024-09-13T17:24:15.455006+0000","last_active":"2024-09-13T17:24:19.471317+0000","last_peered":"2024-09-13T17:24:19.471317+0000","last_clean":"2024-09-13T17:24:19.471317+0000","last_became_active":"2024-09-13T17:24:15.454591+0000","last_became_peered":"2024-09-13T17:24:15.454591+0000","last_unstale":"2024-09-13T17:24:19.471317+0000","last_undegraded":"2024-09-13T17:24:19.471317+0000","last_fullsized":"2024-09-13T17:24:19.471317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935356+0000","last_change":"2024-09-13T17:24:19.484849+0000","last_active":"2024-09-13T17:24:19.935356+0000","last_peered":"2024-09-13T17:24:19.935356+0000","last_clean":"2024-09-13T17:24:19.935356+0000","last_became_active":"2024-09-13T17:24:19.484457+0000","last_became_peered":"2024-09-13T17:24:19.484457+0000","last_unstale":"2024-09-13T17:24:19.935356+0000","last_undegraded":"2024-09-13T17:24:19.935356+0000","last_fullsized":"2024-09-13T17:24:19.935356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471737+0000","last_change":"2024-09-13T17:24:15.471194+0000","last_active":"2024-09-13T17:24:19.471737+0000","last_peered":"2024-09-13T17:24:19.471737+0000","last_clean":"2024-09-13T17:24:19.471737+0000","last_became_active":"2024-09-13T17:24:15.471032+0000","last_became_peered":"2024-09-13T17:24:15.471032+0000","last_unstale":"2024-09-13T17:24:19.471737+0000","last_undegraded":"2024-09-13T17:24:19.471737+0000","last_fullsized":"2024-09-13T17:24:19.471737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814620+0000","last_change":"2024-09-13T17:24:14.999111+0000","last_active":"2024-09-13T17:24:19.814620+0000","last_peered":"2024-09-13T17:24:19.814620+0000","last_clean":"2024-09-13T17:24:19.814620+0000","last_became_active":"2024-09-13T17:24:14.998815+0000","last_became_peered":"2024-09-13T17:24:14.998815+0000","last_unstale":"2024-09-13T17:24:19.814620+0000","last_undegraded":"2024-09-13T17:24:19.814620+0000","last_fullsized":"2024-09-13T17:24:19.814620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936160+0000","last_change":"2024-09-13T17:24:19.482367+0000","last_active":"2024-09-13T17:24:19.936160+0000","last_peered":"2024-09-13T17:24:19.936160+0000","last_clean":"2024-09-13T17:24:19.936160+0000","last_became_active":"2024-09-13T17:24:19.481975+0000","last_became_peered":"2024-09-13T17:24:19.481975+0000","last_unstale":"2024-09-13T17:24:19.936160+0000","last_undegraded":"2024-09-13T17:24:19.936160+0000","last_fullsized":"2024-09-13T17:24:19.936160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:45.002511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471659+0000","last_change":"2024-09-13T17:24:15.460971+0000","last_active":"2024-09-13T17:24:19.471659+0000","last_peered":"2024-09-13T17:24:19.471659+0000","last_clean":"2024-09-13T17:24:19.471659+0000","last_became_active":"2024-09-13T17:24:15.460737+0000","last_became_peered":"2024-09-13T17:24:15.460737+0000","last_unstale":"2024-09-13T17:24:19.471659+0000","last_undegraded":"2024-09-13T17:24:19.471659+0000","last_fullsized":"2024-09-13T17:24:19.471659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.489201+0000","last_change":"2024-09-13T17:24:14.995871+0000","last_active":"2024-09-13T17:24:19.489201+0000","last_peered":"2024-09-13T17:24:19.489201+0000","last_clean":"2024-09-13T17:24:19.489201+0000","last_became_active":"2024-09-13T17:24:14.995587+0000","last_became_peered":"2024-09-13T17:24:14.995587+0000","last_unstale":"2024-09-13T17:24:19.489201+0000","last_undegraded":"2024-09-13T17:24:19.489201+0000","last_fullsized":"2024-09-13T17:24:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936209+0000","last_change":"2024-09-13T17:24:19.485042+0000","last_active":"2024-09-13T17:24:19.936209+0000","last_peered":"2024-09-13T17:24:19.936209+0000","last_clean":"2024-09-13T17:24:19.936209+0000","last_became_active":"2024-09-13T17:24:19.484582+0000","last_became_peered":"2024-09-13T17:24:19.484582+0000","last_unstale":"2024-09-13T17:24:19.936209+0000","last_undegraded":"2024-09-13T17:24:19.936209+0000","last_fullsized":"2024-09-13T17:24:19.936209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466505+0000","last_change":"2024-09-13T17:24:15.451828+0000","last_active":"2024-09-13T17:24:19.466505+0000","last_peered":"2024-09-13T17:24:19.466505+0000","last_clean":"2024-09-13T17:24:19.466505+0000","last_became_active":"2024-09-13T17:24:15.451657+0000","last_became_peered":"2024-09-13T17:24:15.451657+0000","last_unstale":"2024-09-13T17:24:19.466505+0000","last_undegraded":"2024-09-13T17:24:19.466505+0000","last_fullsized":"2024-09-13T17:24:19.466505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488312+0000","last_change":"2024-09-13T17:24:14.990698+0000","last_active":"2024-09-13T17:24:19.488312+0000","last_peered":"2024-09-13T17:24:19.488312+0000","last_clean":"2024-09-13T17:24:19.488312+0000","last_became_active":"2024-09-13T17:24:14.990416+0000","last_became_peered":"2024-09-13T17:24:14.990416+0000","last_unstale":"2024-09-13T17:24:19.488312+0000","last_undegraded":"2024-09-13T17:24:19.488312+0000","last_fullsized":"2024-09-13T17:24:19.488312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161687+0000","last_change":"2024-09-13T17:24:19.820132+0000","last_active":"2024-09-13T17:24:20.161687+0000","last_peered":"2024-09-13T17:24:20.161687+0000","last_clean":"2024-09-13T17:24:20.161687+0000","last_became_active":"2024-09-13T17:24:19.818510+0000","last_became_peered":"2024-09-13T17:24:19.818510+0000","last_unstale":"2024-09-13T17:24:20.161687+0000","last_undegraded":"2024-09-13T17:24:20.161687+0000","last_fullsized":"2024-09-13T17:24:20.161687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463620+0000","last_change":"2024-09-13T17:24:15.463989+0000","last_active":"2024-09-13T17:24:19.463620+0000","last_peered":"2024-09-13T17:24:19.463620+0000","last_clean":"2024-09-13T17:24:19.463620+0000","last_became_active":"2024-09-13T17:24:15.460158+0000","last_became_peered":"2024-09-13T17:24:15.460158+0000","last_unstale":"2024-09-13T17:24:19.463620+0000","last_undegraded":"2024-09-13T17:24:19.463620+0000","last_fullsized":"2024-09-13T17:24:19.463620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:52.267958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.813963+0000","last_change":"2024-09-13T17:24:14.997926+0000","last_active":"2024-09-13T17:24:19.813963+0000","last_peered":"2024-09-13T17:24:19.813963+0000","last_clean":"2024-09-13T17:24:19.813963+0000","last_became_active":"2024-09-13T17:24:14.997676+0000","last_became_peered":"2024-09-13T17:24:14.997676+0000","last_unstale":"2024-09-13T17:24:19.813963+0000","last_undegraded":"2024-09-13T17:24:19.813963+0000","last_fullsized":"2024-09-13T17:24:19.813963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935910+0000","last_change":"2024-09-13T17:24:19.482666+0000","last_active":"2024-09-13T17:24:19.935910+0000","last_peered":"2024-09-13T17:24:19.935910+0000","last_clean":"2024-09-13T17:24:19.935910+0000","last_became_active":"2024-09-13T17:24:19.482094+0000","last_became_peered":"2024-09-13T17:24:19.482094+0000","last_unstale":"2024-09-13T17:24:19.935910+0000","last_undegraded":"2024-09-13T17:24:19.935910+0000","last_fullsized":"2024-09-13T17:24:19.935910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476533+0000","last_change":"2024-09-13T17:24:15.451913+0000","last_active":"2024-09-13T17:24:19.476533+0000","last_peered":"2024-09-13T17:24:19.476533+0000","last_clean":"2024-09-13T17:24:19.476533+0000","last_became_active":"2024-09-13T17:24:15.451613+0000","last_became_peered":"2024-09-13T17:24:15.451613+0000","last_unstale":"2024-09-13T17:24:19.476533+0000","last_undegraded":"2024-09-13T17:24:19.476533+0000","last_fullsized":"2024-09-13T17:24:19.476533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:56.437721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475611+0000","last_change":"2024-09-13T17:24:15.000387+0000","last_active":"2024-09-13T17:24:19.475611+0000","last_peered":"2024-09-13T17:24:19.475611+0000","last_clean":"2024-09-13T17:24:19.475611+0000","last_became_active":"2024-09-13T17:24:14.999607+0000","last_became_peered":"2024-09-13T17:24:14.999607+0000","last_unstale":"2024-09-13T17:24:19.475611+0000","last_undegraded":"2024-09-13T17:24:19.475611+0000","last_fullsized":"2024-09-13T17:24:19.475611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935553+0000","last_change":"2024-09-13T17:24:19.818902+0000","last_active":"2024-09-13T17:24:19.935553+0000","last_peered":"2024-09-13T17:24:19.935553+0000","last_clean":"2024-09-13T17:24:19.935553+0000","last_became_active":"2024-09-13T17:24:19.818460+0000","last_became_peered":"2024-09-13T17:24:19.818460+0000","last_unstale":"2024-09-13T17:24:19.935553+0000","last_undegraded":"2024-09-13T17:24:19.935553+0000","last_fullsized":"2024-09-13T17:24:19.935553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.477603+0000","last_change":"2024-09-13T17:24:15.460686+0000","last_active":"2024-09-13T17:24:19.477603+0000","last_peered":"2024-09-13T17:24:19.477603+0000","last_clean":"2024-09-13T17:24:19.477603+0000","last_became_active":"2024-09-13T17:24:15.455133+0000","last_became_peered":"2024-09-13T17:24:15.455133+0000","last_unstale":"2024-09-13T17:24:19.477603+0000","last_undegraded":"2024-09-13T17:24:19.477603+0000","last_fullsized":"2024-09-13T17:24:19.477603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.407763+0000","last_change":"2024-09-13T17:24:14.987019+0000","last_active":"2024-09-13T17:24:20.407763+0000","last_peered":"2024-09-13T17:24:20.407763+0000","last_clean":"2024-09-13T17:24:20.407763+0000","last_became_active":"2024-09-13T17:24:14.986734+0000","last_became_peered":"2024-09-13T17:24:14.986734+0000","last_unstale":"2024-09-13T17:24:20.407763+0000","last_undegraded":"2024-09-13T17:24:20.407763+0000","last_fullsized":"2024-09-13T17:24:20.407763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933226+0000","last_change":"2024-09-13T17:24:19.819389+0000","last_active":"2024-09-13T17:24:19.933226+0000","last_peered":"2024-09-13T17:24:19.933226+0000","last_clean":"2024-09-13T17:24:19.933226+0000","last_became_active":"2024-09-13T17:24:19.819043+0000","last_became_peered":"2024-09-13T17:24:19.819043+0000","last_unstale":"2024-09-13T17:24:19.933226+0000","last_undegraded":"2024-09-13T17:24:19.933226+0000","last_fullsized":"2024-09-13T17:24:19.933226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:34.882933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488880+0000","last_change":"2024-09-13T17:24:15.454805+0000","last_active":"2024-09-13T17:24:19.488880+0000","last_peered":"2024-09-13T17:24:19.488880+0000","last_clean":"2024-09-13T17:24:19.488880+0000","last_became_active":"2024-09-13T17:24:15.454207+0000","last_became_peered":"2024-09-13T17:24:15.454207+0000","last_unstale":"2024-09-13T17:24:19.488880+0000","last_undegraded":"2024-09-13T17:24:19.488880+0000","last_fullsized":"2024-09-13T17:24:19.488880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815264+0000","last_change":"2024-09-13T17:24:15.005234+0000","last_active":"2024-09-13T17:24:19.815264+0000","last_peered":"2024-09-13T17:24:19.815264+0000","last_clean":"2024-09-13T17:24:19.815264+0000","last_became_active":"2024-09-13T17:24:15.005057+0000","last_became_peered":"2024-09-13T17:24:15.005057+0000","last_unstale":"2024-09-13T17:24:19.815264+0000","last_undegraded":"2024-09-13T17:24:19.815264+0000","last_fullsized":"2024-09-13T17:24:19.815264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:30.054079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162331+0000","last_change":"2024-09-13T17:24:19.818120+0000","last_active":"2024-09-13T17:24:20.162331+0000","last_peered":"2024-09-13T17:24:20.162331+0000","last_clean":"2024-09-13T17:24:20.162331+0000","last_became_active":"2024-09-13T17:24:19.816778+0000","last_became_peered":"2024-09-13T17:24:19.816778+0000","last_unstale":"2024-09-13T17:24:20.162331+0000","last_undegraded":"2024-09-13T17:24:20.162331+0000","last_fullsized":"2024-09-13T17:24:20.162331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471403+0000","last_change":"2024-09-13T17:24:15.469501+0000","last_active":"2024-09-13T17:24:19.471403+0000","last_peered":"2024-09-13T17:24:19.471403+0000","last_clean":"2024-09-13T17:24:19.471403+0000","last_became_active":"2024-09-13T17:24:15.469155+0000","last_became_peered":"2024-09-13T17:24:15.469155+0000","last_unstale":"2024-09-13T17:24:19.471403+0000","last_undegraded":"2024-09-13T17:24:19.471403+0000","last_fullsized":"2024-09-13T17:24:19.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488955+0000","last_change":"2024-09-13T17:24:14.998201+0000","last_active":"2024-09-13T17:24:19.488955+0000","last_peered":"2024-09-13T17:24:19.488955+0000","last_clean":"2024-09-13T17:24:19.488955+0000","last_became_active":"2024-09-13T17:24:14.997869+0000","last_became_peered":"2024-09-13T17:24:14.997869+0000","last_unstale":"2024-09-13T17:24:19.488955+0000","last_undegraded":"2024-09-13T17:24:19.488955+0000","last_fullsized":"2024-09-13T17:24:19.488955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161494+0000","last_change":"2024-09-13T17:24:19.491726+0000","last_active":"2024-09-13T17:24:20.161494+0000","last_peered":"2024-09-13T17:24:20.161494+0000","last_clean":"2024-09-13T17:24:20.161494+0000","last_became_active":"2024-09-13T17:24:19.491286+0000","last_became_peered":"2024-09-13T17:24:19.491286+0000","last_unstale":"2024-09-13T17:24:20.161494+0000","last_undegraded":"2024-09-13T17:24:20.161494+0000","last_fullsized":"2024-09-13T17:24:20.161494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466484+0000","last_change":"2024-09-13T17:24:15.460992+0000","last_active":"2024-09-13T17:24:19.466484+0000","last_peered":"2024-09-13T17:24:19.466484+0000","last_clean":"2024-09-13T17:24:19.466484+0000","last_became_active":"2024-09-13T17:24:15.460669+0000","last_became_peered":"2024-09-13T17:24:15.460669+0000","last_unstale":"2024-09-13T17:24:19.466484+0000","last_undegraded":"2024-09-13T17:24:19.466484+0000","last_fullsized":"2024-09-13T17:24:19.466484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:58.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471042+0000","last_change":"2024-09-13T17:24:14.983936+0000","last_active":"2024-09-13T17:24:19.471042+0000","last_peered":"2024-09-13T17:24:19.471042+0000","last_clean":"2024-09-13T17:24:19.471042+0000","last_became_active":"2024-09-13T17:24:14.983685+0000","last_became_peered":"2024-09-13T17:24:14.983685+0000","last_unstale":"2024-09-13T17:24:19.471042+0000","last_undegraded":"2024-09-13T17:24:19.471042+0000","last_fullsized":"2024-09-13T17:24:19.471042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161572+0000","last_change":"2024-09-13T17:24:19.491752+0000","last_active":"2024-09-13T17:24:20.161572+0000","last_peered":"2024-09-13T17:24:20.161572+0000","last_clean":"2024-09-13T17:24:20.161572+0000","last_became_active":"2024-09-13T17:24:19.491306+0000","last_became_peered":"2024-09-13T17:24:19.491306+0000","last_unstale":"2024-09-13T17:24:20.161572+0000","last_undegraded":"2024-09-13T17:24:20.161572+0000","last_fullsized":"2024-09-13T17:24:20.161572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.450557+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.449789+0000","last_became_peered":"2024-09-13T17:24:15.449789+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462988+0000","last_change":"2024-09-13T17:24:14.993441+0000","last_active":"2024-09-13T17:24:19.462988+0000","last_peered":"2024-09-13T17:24:19.462988+0000","last_clean":"2024-09-13T17:24:19.462988+0000","last_became_active":"2024-09-13T17:24:14.992844+0000","last_became_peered":"2024-09-13T17:24:14.992844+0000","last_unstale":"2024-09-13T17:24:19.462988+0000","last_undegraded":"2024-09-13T17:24:19.462988+0000","last_fullsized":"2024-09-13T17:24:19.462988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:45.269493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161707+0000","last_change":"2024-09-13T17:24:19.495163+0000","last_active":"2024-09-13T17:24:20.161707+0000","last_peered":"2024-09-13T17:24:20.161707+0000","last_clean":"2024-09-13T17:24:20.161707+0000","last_became_active":"2024-09-13T17:24:19.494785+0000","last_became_peered":"2024-09-13T17:24:19.494785+0000","last_unstale":"2024-09-13T17:24:20.161707+0000","last_undegraded":"2024-09-13T17:24:20.161707+0000","last_fullsized":"2024-09-13T17:24:20.161707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:03.723085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469004+0000","last_change":"2024-09-13T17:24:15.446878+0000","last_active":"2024-09-13T17:24:19.469004+0000","last_peered":"2024-09-13T17:24:19.469004+0000","last_clean":"2024-09-13T17:24:19.469004+0000","last_became_active":"2024-09-13T17:24:15.446603+0000","last_became_peered":"2024-09-13T17:24:15.446603+0000","last_unstale":"2024-09-13T17:24:19.469004+0000","last_undegraded":"2024-09-13T17:24:19.469004+0000","last_fullsized":"2024-09-13T17:24:19.469004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814072+0000","last_change":"2024-09-13T17:24:14.994254+0000","last_active":"2024-09-13T17:24:19.814072+0000","last_peered":"2024-09-13T17:24:19.814072+0000","last_clean":"2024-09-13T17:24:19.814072+0000","last_became_active":"2024-09-13T17:24:14.993782+0000","last_became_peered":"2024-09-13T17:24:14.993782+0000","last_unstale":"2024-09-13T17:24:19.814072+0000","last_undegraded":"2024-09-13T17:24:19.814072+0000","last_fullsized":"2024-09-13T17:24:19.814072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162536+0000","last_change":"2024-09-13T17:24:19.817339+0000","last_active":"2024-09-13T17:24:20.162536+0000","last_peered":"2024-09-13T17:24:20.162536+0000","last_clean":"2024-09-13T17:24:20.162536+0000","last_became_active":"2024-09-13T17:24:19.816481+0000","last_became_peered":"2024-09-13T17:24:19.816481+0000","last_unstale":"2024-09-13T17:24:20.162536+0000","last_undegraded":"2024-09-13T17:24:20.162536+0000","last_fullsized":"2024-09-13T17:24:20.162536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470053+0000","last_change":"2024-09-13T17:24:15.460711+0000","last_active":"2024-09-13T17:24:19.470053+0000","last_peered":"2024-09-13T17:24:19.470053+0000","last_clean":"2024-09-13T17:24:19.470053+0000","last_became_active":"2024-09-13T17:24:15.460433+0000","last_became_peered":"2024-09-13T17:24:15.460433+0000","last_unstale":"2024-09-13T17:24:19.470053+0000","last_undegraded":"2024-09-13T17:24:19.470053+0000","last_fullsized":"2024-09-13T17:24:19.470053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470665+0000","last_change":"2024-09-13T17:24:14.982963+0000","last_active":"2024-09-13T17:24:19.470665+0000","last_peered":"2024-09-13T17:24:19.470665+0000","last_clean":"2024-09-13T17:24:19.470665+0000","last_became_active":"2024-09-13T17:24:14.982671+0000","last_became_peered":"2024-09-13T17:24:14.982671+0000","last_unstale":"2024-09-13T17:24:19.470665+0000","last_undegraded":"2024-09-13T17:24:19.470665+0000","last_fullsized":"2024-09-13T17:24:19.470665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814197+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:24:19.814197+0000","last_peered":"2024-09-13T17:24:19.814197+0000","last_clean":"2024-09-13T17:24:19.814197+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:24:19.814197+0000","last_undegraded":"2024-09-13T17:24:19.814197+0000","last_fullsized":"2024-09-13T17:24:19.814197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159775+0000","last_change":"2024-09-13T17:24:19.819311+0000","last_active":"2024-09-13T17:24:20.159775+0000","last_peered":"2024-09-13T17:24:20.159775+0000","last_clean":"2024-09-13T17:24:20.159775+0000","last_became_active":"2024-09-13T17:24:19.818841+0000","last_became_peered":"2024-09-13T17:24:19.818841+0000","last_unstale":"2024-09-13T17:24:20.159775+0000","last_undegraded":"2024-09-13T17:24:20.159775+0000","last_fullsized":"2024-09-13T17:24:20.159775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:24.662706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814915+0000","last_change":"2024-09-13T17:24:15.476542+0000","last_active":"2024-09-13T17:24:19.814915+0000","last_peered":"2024-09-13T17:24:19.814915+0000","last_clean":"2024-09-13T17:24:19.814915+0000","last_became_active":"2024-09-13T17:24:15.476036+0000","last_became_peered":"2024-09-13T17:24:15.476036+0000","last_unstale":"2024-09-13T17:24:19.814915+0000","last_undegraded":"2024-09-13T17:24:19.814915+0000","last_fullsized":"2024-09-13T17:24:19.814915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463290+0000","last_change":"2024-09-13T17:24:14.979602+0000","last_active":"2024-09-13T17:24:19.463290+0000","last_peered":"2024-09-13T17:24:19.463290+0000","last_clean":"2024-09-13T17:24:19.463290+0000","last_became_active":"2024-09-13T17:24:14.979263+0000","last_became_peered":"2024-09-13T17:24:14.979263+0000","last_unstale":"2024-09-13T17:24:19.463290+0000","last_undegraded":"2024-09-13T17:24:19.463290+0000","last_fullsized":"2024-09-13T17:24:19.463290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159668+0000","last_change":"2024-09-13T17:24:19.817514+0000","last_active":"2024-09-13T17:24:20.159668+0000","last_peered":"2024-09-13T17:24:20.159668+0000","last_clean":"2024-09-13T17:24:20.159668+0000","last_became_active":"2024-09-13T17:24:19.816806+0000","last_became_peered":"2024-09-13T17:24:19.816806+0000","last_unstale":"2024-09-13T17:24:20.159668+0000","last_undegraded":"2024-09-13T17:24:20.159668+0000","last_fullsized":"2024-09-13T17:24:20.159668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:16.798179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471041+0000","last_change":"2024-09-13T17:24:15.469593+0000","last_active":"2024-09-13T17:24:19.471041+0000","last_peered":"2024-09-13T17:24:19.471041+0000","last_clean":"2024-09-13T17:24:19.471041+0000","last_became_active":"2024-09-13T17:24:15.469184+0000","last_became_peered":"2024-09-13T17:24:15.469184+0000","last_unstale":"2024-09-13T17:24:19.471041+0000","last_undegraded":"2024-09-13T17:24:19.471041+0000","last_fullsized":"2024-09-13T17:24:19.471041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488746+0000","last_change":"2024-09-13T17:24:14.989442+0000","last_active":"2024-09-13T17:24:19.488746+0000","last_peered":"2024-09-13T17:24:19.488746+0000","last_clean":"2024-09-13T17:24:19.488746+0000","last_became_active":"2024-09-13T17:24:14.988868+0000","last_became_peered":"2024-09-13T17:24:14.988868+0000","last_unstale":"2024-09-13T17:24:19.488746+0000","last_undegraded":"2024-09-13T17:24:19.488746+0000","last_fullsized":"2024-09-13T17:24:19.488746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162394+0000","last_change":"2024-09-13T17:24:19.494393+0000","last_active":"2024-09-13T17:24:20.162394+0000","last_peered":"2024-09-13T17:24:20.162394+0000","last_clean":"2024-09-13T17:24:20.162394+0000","last_became_active":"2024-09-13T17:24:19.493501+0000","last_became_peered":"2024-09-13T17:24:19.493501+0000","last_unstale":"2024-09-13T17:24:20.162394+0000","last_undegraded":"2024-09-13T17:24:20.162394+0000","last_fullsized":"2024-09-13T17:24:20.162394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:33.643683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815260+0000","last_change":"2024-09-13T17:24:15.461926+0000","last_active":"2024-09-13T17:24:19.815260+0000","last_peered":"2024-09-13T17:24:19.815260+0000","last_clean":"2024-09-13T17:24:19.815260+0000","last_became_active":"2024-09-13T17:24:15.459619+0000","last_became_peered":"2024-09-13T17:24:15.459619+0000","last_unstale":"2024-09-13T17:24:19.815260+0000","last_undegraded":"2024-09-13T17:24:19.815260+0000","last_fullsized":"2024-09-13T17:24:19.815260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464733+0000","last_change":"2024-09-13T17:24:14.994961+0000","last_active":"2024-09-13T17:24:19.464733+0000","last_peered":"2024-09-13T17:24:19.464733+0000","last_clean":"2024-09-13T17:24:19.464733+0000","last_became_active":"2024-09-13T17:24:14.994704+0000","last_became_peered":"2024-09-13T17:24:14.994704+0000","last_unstale":"2024-09-13T17:24:19.464733+0000","last_undegraded":"2024-09-13T17:24:19.464733+0000","last_fullsized":"2024-09-13T17:24:19.464733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.937782+0000","last_change":"2024-09-13T17:24:19.818462+0000","last_active":"2024-09-13T17:24:19.937782+0000","last_peered":"2024-09-13T17:24:19.937782+0000","last_clean":"2024-09-13T17:24:19.937782+0000","last_became_active":"2024-09-13T17:24:19.816380+0000","last_became_peered":"2024-09-13T17:24:19.816380+0000","last_unstale":"2024-09-13T17:24:19.937782+0000","last_undegraded":"2024-09-13T17:24:19.937782+0000","last_fullsized":"2024-09-13T17:24:19.937782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815030+0000","last_change":"2024-09-13T17:24:15.448897+0000","last_active":"2024-09-13T17:24:19.815030+0000","last_peered":"2024-09-13T17:24:19.815030+0000","last_clean":"2024-09-13T17:24:19.815030+0000","last_became_active":"2024-09-13T17:24:15.448622+0000","last_became_peered":"2024-09-13T17:24:15.448622+0000","last_unstale":"2024-09-13T17:24:19.815030+0000","last_undegraded":"2024-09-13T17:24:19.815030+0000","last_fullsized":"2024-09-13T17:24:19.815030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463641+0000","last_change":"2024-09-13T17:24:14.997545+0000","last_active":"2024-09-13T17:24:19.463641+0000","last_peered":"2024-09-13T17:24:19.463641+0000","last_clean":"2024-09-13T17:24:19.463641+0000","last_became_active":"2024-09-13T17:24:14.997198+0000","last_became_peered":"2024-09-13T17:24:14.997198+0000","last_unstale":"2024-09-13T17:24:19.463641+0000","last_undegraded":"2024-09-13T17:24:19.463641+0000","last_fullsized":"2024-09-13T17:24:19.463641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:25.033343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935257+0000","last_change":"2024-09-13T17:24:19.480414+0000","last_active":"2024-09-13T17:24:19.935257+0000","last_peered":"2024-09-13T17:24:19.935257+0000","last_clean":"2024-09-13T17:24:19.935257+0000","last_became_active":"2024-09-13T17:24:19.479642+0000","last_became_peered":"2024-09-13T17:24:19.479642+0000","last_unstale":"2024-09-13T17:24:19.935257+0000","last_undegraded":"2024-09-13T17:24:19.935257+0000","last_fullsized":"2024-09-13T17:24:19.935257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:14.017983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814064+0000","last_change":"2024-09-13T17:24:15.450082+0000","last_active":"2024-09-13T17:24:19.814064+0000","last_peered":"2024-09-13T17:24:19.814064+0000","last_clean":"2024-09-13T17:24:19.814064+0000","last_became_active":"2024-09-13T17:24:15.449273+0000","last_became_peered":"2024-09-13T17:24:15.449273+0000","last_unstale":"2024-09-13T17:24:19.814064+0000","last_undegraded":"2024-09-13T17:24:19.814064+0000","last_fullsized":"2024-09-13T17:24:19.814064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462863+0000","last_change":"2024-09-13T17:24:14.983243+0000","last_active":"2024-09-13T17:24:19.462863+0000","last_peered":"2024-09-13T17:24:19.462863+0000","last_clean":"2024-09-13T17:24:19.462863+0000","last_became_active":"2024-09-13T17:24:14.983004+0000","last_became_peered":"2024-09-13T17:24:14.983004+0000","last_unstale":"2024-09-13T17:24:19.462863+0000","last_undegraded":"2024-09-13T17:24:19.462863+0000","last_fullsized":"2024-09-13T17:24:19.462863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162516+0000","last_change":"2024-09-13T17:24:19.488835+0000","last_active":"2024-09-13T17:24:20.162516+0000","last_peered":"2024-09-13T17:24:20.162516+0000","last_clean":"2024-09-13T17:24:20.162516+0000","last_became_active":"2024-09-13T17:24:19.486830+0000","last_became_peered":"2024-09-13T17:24:19.486830+0000","last_unstale":"2024-09-13T17:24:20.162516+0000","last_undegraded":"2024-09-13T17:24:20.162516+0000","last_fullsized":"2024-09-13T17:24:20.162516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470643+0000","last_change":"2024-09-13T17:24:15.461810+0000","last_active":"2024-09-13T17:24:19.470643+0000","last_peered":"2024-09-13T17:24:19.470643+0000","last_clean":"2024-09-13T17:24:19.470643+0000","last_became_active":"2024-09-13T17:24:15.461508+0000","last_became_peered":"2024-09-13T17:24:15.461508+0000","last_unstale":"2024-09-13T17:24:19.470643+0000","last_undegraded":"2024-09-13T17:24:19.470643+0000","last_fullsized":"2024-09-13T17:24:19.470643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471219+0000","last_change":"2024-09-13T17:24:14.987302+0000","last_active":"2024-09-13T17:24:19.471219+0000","last_peered":"2024-09-13T17:24:19.471219+0000","last_clean":"2024-09-13T17:24:19.471219+0000","last_became_active":"2024-09-13T17:24:14.986233+0000","last_became_peered":"2024-09-13T17:24:14.986233+0000","last_unstale":"2024-09-13T17:24:19.471219+0000","last_undegraded":"2024-09-13T17:24:19.471219+0000","last_fullsized":"2024-09-13T17:24:19.471219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934778+0000","last_change":"2024-09-13T17:24:19.818522+0000","last_active":"2024-09-13T17:24:19.934778+0000","last_peered":"2024-09-13T17:24:19.934778+0000","last_clean":"2024-09-13T17:24:19.934778+0000","last_became_active":"2024-09-13T17:24:19.817966+0000","last_became_peered":"2024-09-13T17:24:19.817966+0000","last_unstale":"2024-09-13T17:24:19.934778+0000","last_undegraded":"2024-09-13T17:24:19.934778+0000","last_fullsized":"2024-09-13T17:24:19.934778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:34.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814894+0000","last_change":"2024-09-13T17:24:15.459249+0000","last_active":"2024-09-13T17:24:19.814894+0000","last_peered":"2024-09-13T17:24:19.814894+0000","last_clean":"2024-09-13T17:24:19.814894+0000","last_became_active":"2024-09-13T17:24:15.459011+0000","last_became_peered":"2024-09-13T17:24:15.459011+0000","last_unstale":"2024-09-13T17:24:19.814894+0000","last_undegraded":"2024-09-13T17:24:19.814894+0000","last_fullsized":"2024-09-13T17:24:19.814894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:14.988544+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:14.988212+0000","last_became_peered":"2024-09-13T17:24:14.988212+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934302+0000","last_change":"2024-09-13T17:24:19.815017+0000","last_active":"2024-09-13T17:24:19.934302+0000","last_peered":"2024-09-13T17:24:19.934302+0000","last_clean":"2024-09-13T17:24:19.934302+0000","last_became_active":"2024-09-13T17:24:19.814320+0000","last_became_peered":"2024-09-13T17:24:19.814320+0000","last_unstale":"2024-09-13T17:24:19.934302+0000","last_undegraded":"2024-09-13T17:24:19.934302+0000","last_fullsized":"2024-09-13T17:24:19.934302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468886+0000","last_change":"2024-09-13T17:24:15.456460+0000","last_active":"2024-09-13T17:24:19.468886+0000","last_peered":"2024-09-13T17:24:19.468886+0000","last_clean":"2024-09-13T17:24:19.468886+0000","last_became_active":"2024-09-13T17:24:15.456017+0000","last_became_peered":"2024-09-13T17:24:15.456017+0000","last_unstale":"2024-09-13T17:24:19.468886+0000","last_undegraded":"2024-09-13T17:24:19.468886+0000","last_fullsized":"2024-09-13T17:24:19.468886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476162+0000","last_change":"2024-09-13T17:24:14.990747+0000","last_active":"2024-09-13T17:24:19.476162+0000","last_peered":"2024-09-13T17:24:19.476162+0000","last_clean":"2024-09-13T17:24:19.476162+0000","last_became_active":"2024-09-13T17:24:14.990294+0000","last_became_peered":"2024-09-13T17:24:14.990294+0000","last_unstale":"2024-09-13T17:24:19.476162+0000","last_undegraded":"2024-09-13T17:24:19.476162+0000","last_fullsized":"2024-09-13T17:24:19.476162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.938634+0000","last_change":"2024-09-13T17:24:19.818818+0000","last_active":"2024-09-13T17:24:19.938634+0000","last_peered":"2024-09-13T17:24:19.938634+0000","last_clean":"2024-09-13T17:24:19.938634+0000","last_became_active":"2024-09-13T17:24:19.818382+0000","last_became_peered":"2024-09-13T17:24:19.818382+0000","last_unstale":"2024-09-13T17:24:19.938634+0000","last_undegraded":"2024-09-13T17:24:19.938634+0000","last_fullsized":"2024-09-13T17:24:19.938634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814361+0000","last_change":"2024-09-13T17:24:15.466297+0000","last_active":"2024-09-13T17:24:19.814361+0000","last_peered":"2024-09-13T17:24:19.814361+0000","last_clean":"2024-09-13T17:24:19.814361+0000","last_became_active":"2024-09-13T17:24:15.466044+0000","last_became_peered":"2024-09-13T17:24:15.466044+0000","last_unstale":"2024-09-13T17:24:19.814361+0000","last_undegraded":"2024-09-13T17:24:19.814361+0000","last_fullsized":"2024-09-13T17:24:19.814361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:31.909644+0000","last_change":"2024-09-13T17:24:14.999123+0000","last_active":"2024-09-13T17:24:31.909644+0000","last_peered":"2024-09-13T17:24:31.909644+0000","last_clean":"2024-09-13T17:24:31.909644+0000","last_became_active":"2024-09-13T17:24:14.998510+0000","last_became_peered":"2024-09-13T17:24:14.998510+0000","last_unstale":"2024-09-13T17:24:31.909644+0000","last_undegraded":"2024-09-13T17:24:31.909644+0000","last_fullsized":"2024-09-13T17:24:31.909644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161518+0000","last_change":"2024-09-13T17:24:19.489369+0000","last_active":"2024-09-13T17:24:20.161518+0000","last_peered":"2024-09-13T17:24:20.161518+0000","last_clean":"2024-09-13T17:24:20.161518+0000","last_became_active":"2024-09-13T17:24:19.488726+0000","last_became_peered":"2024-09-13T17:24:19.488726+0000","last_unstale":"2024-09-13T17:24:20.161518+0000","last_undegraded":"2024-09-13T17:24:20.161518+0000","last_fullsized":"2024-09-13T17:24:20.161518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464281+0000","last_change":"2024-09-13T17:24:15.460340+0000","last_active":"2024-09-13T17:24:19.464281+0000","last_peered":"2024-09-13T17:24:19.464281+0000","last_clean":"2024-09-13T17:24:19.464281+0000","last_became_active":"2024-09-13T17:24:15.456798+0000","last_became_peered":"2024-09-13T17:24:15.456798+0000","last_unstale":"2024-09-13T17:24:19.464281+0000","last_undegraded":"2024-09-13T17:24:19.464281+0000","last_fullsized":"2024-09-13T17:24:19.464281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488655+0000","last_change":"2024-09-13T17:24:14.992998+0000","last_active":"2024-09-13T17:24:19.488655+0000","last_peered":"2024-09-13T17:24:19.488655+0000","last_clean":"2024-09-13T17:24:19.488655+0000","last_became_active":"2024-09-13T17:24:14.992739+0000","last_became_peered":"2024-09-13T17:24:14.992739+0000","last_unstale":"2024-09-13T17:24:19.488655+0000","last_undegraded":"2024-09-13T17:24:19.488655+0000","last_fullsized":"2024-09-13T17:24:19.488655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936378+0000","last_change":"2024-09-13T17:24:19.493862+0000","last_active":"2024-09-13T17:24:19.936378+0000","last_peered":"2024-09-13T17:24:19.936378+0000","last_clean":"2024-09-13T17:24:19.936378+0000","last_became_active":"2024-09-13T17:24:19.493509+0000","last_became_peered":"2024-09-13T17:24:19.493509+0000","last_unstale":"2024-09-13T17:24:19.936378+0000","last_undegraded":"2024-09-13T17:24:19.936378+0000","last_fullsized":"2024-09-13T17:24:19.936378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476651+0000","last_change":"2024-09-13T17:24:15.452147+0000","last_active":"2024-09-13T17:24:19.476651+0000","last_peered":"2024-09-13T17:24:19.476651+0000","last_clean":"2024-09-13T17:24:19.476651+0000","last_became_active":"2024-09-13T17:24:15.451907+0000","last_became_peered":"2024-09-13T17:24:15.451907+0000","last_unstale":"2024-09-13T17:24:19.476651+0000","last_undegraded":"2024-09-13T17:24:19.476651+0000","last_fullsized":"2024-09-13T17:24:19.476651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471398+0000","last_change":"2024-09-13T17:24:14.983387+0000","last_active":"2024-09-13T17:24:19.471398+0000","last_peered":"2024-09-13T17:24:19.471398+0000","last_clean":"2024-09-13T17:24:19.471398+0000","last_became_active":"2024-09-13T17:24:14.983068+0000","last_became_peered":"2024-09-13T17:24:14.983068+0000","last_unstale":"2024-09-13T17:24:19.471398+0000","last_undegraded":"2024-09-13T17:24:19.471398+0000","last_fullsized":"2024-09-13T17:24:19.471398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933438+0000","last_change":"2024-09-13T17:24:19.483413+0000","last_active":"2024-09-13T17:24:19.933438+0000","last_peered":"2024-09-13T17:24:19.933438+0000","last_clean":"2024-09-13T17:24:19.933438+0000","last_became_active":"2024-09-13T17:24:19.482969+0000","last_became_peered":"2024-09-13T17:24:19.482969+0000","last_unstale":"2024-09-13T17:24:19.933438+0000","last_undegraded":"2024-09-13T17:24:19.933438+0000","last_fullsized":"2024-09-13T17:24:19.933438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471316+0000","last_change":"2024-09-13T17:24:15.462544+0000","last_active":"2024-09-13T17:24:19.471316+0000","last_peered":"2024-09-13T17:24:19.471316+0000","last_clean":"2024-09-13T17:24:19.471316+0000","last_became_active":"2024-09-13T17:24:15.462281+0000","last_became_peered":"2024-09-13T17:24:15.462281+0000","last_unstale":"2024-09-13T17:24:19.471316+0000","last_undegraded":"2024-09-13T17:24:19.471316+0000","last_fullsized":"2024-09-13T17:24:19.471316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475543+0000","last_change":"2024-09-13T17:24:14.980247+0000","last_active":"2024-09-13T17:24:19.475543+0000","last_peered":"2024-09-13T17:24:19.475543+0000","last_clean":"2024-09-13T17:24:19.475543+0000","last_became_active":"2024-09-13T17:24:14.979718+0000","last_became_peered":"2024-09-13T17:24:14.979718+0000","last_unstale":"2024-09-13T17:24:19.475543+0000","last_undegraded":"2024-09-13T17:24:19.475543+0000","last_fullsized":"2024-09-13T17:24:19.475543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933528+0000","last_change":"2024-09-13T17:24:19.822202+0000","last_active":"2024-09-13T17:24:19.933528+0000","last_peered":"2024-09-13T17:24:19.933528+0000","last_clean":"2024-09-13T17:24:19.933528+0000","last_became_active":"2024-09-13T17:24:19.819258+0000","last_became_peered":"2024-09-13T17:24:19.819258+0000","last_unstale":"2024-09-13T17:24:19.933528+0000","last_undegraded":"2024-09-13T17:24:19.933528+0000","last_fullsized":"2024-09-13T17:24:19.933528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:00.905961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162494+0000","last_change":"2024-09-13T17:24:19.817595+0000","last_active":"2024-09-13T17:24:20.162494+0000","last_peered":"2024-09-13T17:24:20.162494+0000","last_clean":"2024-09-13T17:24:20.162494+0000","last_became_active":"2024-09-13T17:24:19.817002+0000","last_became_peered":"2024-09-13T17:24:19.817002+0000","last_unstale":"2024-09-13T17:24:20.162494+0000","last_undegraded":"2024-09-13T17:24:20.162494+0000","last_fullsized":"2024-09-13T17:24:20.162494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.453433+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.453178+0000","last_became_peered":"2024-09-13T17:24:15.453178+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470382+0000","last_change":"2024-09-13T17:24:14.981327+0000","last_active":"2024-09-13T17:24:19.470382+0000","last_peered":"2024-09-13T17:24:19.470382+0000","last_clean":"2024-09-13T17:24:19.470382+0000","last_became_active":"2024-09-13T17:24:14.980907+0000","last_became_peered":"2024-09-13T17:24:14.980907+0000","last_unstale":"2024-09-13T17:24:19.470382+0000","last_undegraded":"2024-09-13T17:24:19.470382+0000","last_fullsized":"2024-09-13T17:24:19.470382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159850+0000","last_change":"2024-09-13T17:24:19.488756+0000","last_active":"2024-09-13T17:24:20.159850+0000","last_peered":"2024-09-13T17:24:20.159850+0000","last_clean":"2024-09-13T17:24:20.159850+0000","last_became_active":"2024-09-13T17:24:19.488197+0000","last_became_peered":"2024-09-13T17:24:19.488197+0000","last_unstale":"2024-09-13T17:24:20.159850+0000","last_undegraded":"2024-09-13T17:24:20.159850+0000","last_fullsized":"2024-09-13T17:24:20.159850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466419+0000","last_change":"2024-09-13T17:24:15.451443+0000","last_active":"2024-09-13T17:24:19.466419+0000","last_peered":"2024-09-13T17:24:19.466419+0000","last_clean":"2024-09-13T17:24:19.466419+0000","last_became_active":"2024-09-13T17:24:15.449232+0000","last_became_peered":"2024-09-13T17:24:15.449232+0000","last_unstale":"2024-09-13T17:24:19.466419+0000","last_undegraded":"2024-09-13T17:24:19.466419+0000","last_fullsized":"2024-09-13T17:24:19.466419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467931+0000","last_change":"2024-09-13T17:24:14.996368+0000","last_active":"2024-09-13T17:24:19.467931+0000","last_peered":"2024-09-13T17:24:19.467931+0000","last_clean":"2024-09-13T17:24:19.467931+0000","last_became_active":"2024-09-13T17:24:14.996059+0000","last_became_peered":"2024-09-13T17:24:14.996059+0000","last_unstale":"2024-09-13T17:24:19.467931+0000","last_undegraded":"2024-09-13T17:24:19.467931+0000","last_fullsized":"2024-09-13T17:24:19.467931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.472184+0000","last_change":"2024-09-13T17:24:14.985701+0000","last_active":"2024-09-13T17:24:19.472184+0000","last_peered":"2024-09-13T17:24:19.472184+0000","last_clean":"2024-09-13T17:24:19.472184+0000","last_became_active":"2024-09-13T17:24:14.985456+0000","last_became_peered":"2024-09-13T17:24:14.985456+0000","last_unstale":"2024-09-13T17:24:19.472184+0000","last_undegraded":"2024-09-13T17:24:19.472184+0000","last_fullsized":"2024-09-13T17:24:19.472184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476130+0000","last_change":"2024-09-13T17:24:15.455316+0000","last_active":"2024-09-13T17:24:19.476130+0000","last_peered":"2024-09-13T17:24:19.476130+0000","last_clean":"2024-09-13T17:24:19.476130+0000","last_became_active":"2024-09-13T17:24:15.454982+0000","last_became_peered":"2024-09-13T17:24:15.454982+0000","last_unstale":"2024-09-13T17:24:19.476130+0000","last_undegraded":"2024-09-13T17:24:19.476130+0000","last_fullsized":"2024-09-13T17:24:19.476130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.025977+0000","last_change":"2024-09-13T17:24:19.488455+0000","last_active":"2024-09-13T17:24:20.025977+0000","last_peered":"2024-09-13T17:24:20.025977+0000","last_clean":"2024-09-13T17:24:20.025977+0000","last_became_active":"2024-09-13T17:24:19.485870+0000","last_became_peered":"2024-09-13T17:24:19.485870+0000","last_unstale":"2024-09-13T17:24:20.025977+0000","last_undegraded":"2024-09-13T17:24:20.025977+0000","last_fullsized":"2024-09-13T17:24:20.025977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:48.596044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471752+0000","last_change":"2024-09-13T17:24:15.001371+0000","last_active":"2024-09-13T17:24:19.471752+0000","last_peered":"2024-09-13T17:24:19.471752+0000","last_clean":"2024-09-13T17:24:19.471752+0000","last_became_active":"2024-09-13T17:24:15.001103+0000","last_became_peered":"2024-09-13T17:24:15.001103+0000","last_unstale":"2024-09-13T17:24:19.471752+0000","last_undegraded":"2024-09-13T17:24:19.471752+0000","last_fullsized":"2024-09-13T17:24:19.471752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:28.035253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463630+0000","last_change":"2024-09-13T17:24:15.455094+0000","last_active":"2024-09-13T17:24:19.463630+0000","last_peered":"2024-09-13T17:24:19.463630+0000","last_clean":"2024-09-13T17:24:19.463630+0000","last_became_active":"2024-09-13T17:24:15.454651+0000","last_became_peered":"2024-09-13T17:24:15.454651+0000","last_unstale":"2024-09-13T17:24:19.463630+0000","last_undegraded":"2024-09-13T17:24:19.463630+0000","last_fullsized":"2024-09-13T17:24:19.463630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934497+0000","last_change":"2024-09-13T17:24:19.491640+0000","last_active":"2024-09-13T17:24:19.934497+0000","last_peered":"2024-09-13T17:24:19.934497+0000","last_clean":"2024-09-13T17:24:19.934497+0000","last_became_active":"2024-09-13T17:24:19.488532+0000","last_became_peered":"2024-09-13T17:24:19.488532+0000","last_unstale":"2024-09-13T17:24:19.934497+0000","last_undegraded":"2024-09-13T17:24:19.934497+0000","last_fullsized":"2024-09-13T17:24:19.934497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.387959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470302+0000","last_change":"2024-09-13T17:24:15.465966+0000","last_active":"2024-09-13T17:24:19.470302+0000","last_peered":"2024-09-13T17:24:19.470302+0000","last_clean":"2024-09-13T17:24:19.470302+0000","last_became_active":"2024-09-13T17:24:15.465686+0000","last_became_peered":"2024-09-13T17:24:15.465686+0000","last_unstale":"2024-09-13T17:24:19.470302+0000","last_undegraded":"2024-09-13T17:24:19.470302+0000","last_fullsized":"2024-09-13T17:24:19.470302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462822+0000","last_change":"2024-09-13T17:24:15.447576+0000","last_active":"2024-09-13T17:24:19.462822+0000","last_peered":"2024-09-13T17:24:19.462822+0000","last_clean":"2024-09-13T17:24:19.462822+0000","last_became_active":"2024-09-13T17:24:15.447320+0000","last_became_peered":"2024-09-13T17:24:15.447320+0000","last_unstale":"2024-09-13T17:24:19.462822+0000","last_undegraded":"2024-09-13T17:24:19.462822+0000","last_fullsized":"2024-09-13T17:24:19.462822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:26.973977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.462939+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.462315+0000","last_became_peered":"2024-09-13T17:24:15.462315+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469473+0000","last_change":"2024-09-13T17:24:15.465949+0000","last_active":"2024-09-13T17:24:19.469473+0000","last_peered":"2024-09-13T17:24:19.469473+0000","last_clean":"2024-09-13T17:24:19.469473+0000","last_became_active":"2024-09-13T17:24:15.465644+0000","last_became_peered":"2024-09-13T17:24:15.465644+0000","last_unstale":"2024-09-13T17:24:19.469473+0000","last_undegraded":"2024-09-13T17:24:19.469473+0000","last_fullsized":"2024-09-13T17:24:19.469473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476759+0000","last_change":"2024-09-13T17:24:15.454116+0000","last_active":"2024-09-13T17:24:19.476759+0000","last_peered":"2024-09-13T17:24:19.476759+0000","last_clean":"2024-09-13T17:24:19.476759+0000","last_became_active":"2024-09-13T17:24:15.453864+0000","last_became_peered":"2024-09-13T17:24:15.453864+0000","last_unstale":"2024-09-13T17:24:19.476759+0000","last_undegraded":"2024-09-13T17:24:19.476759+0000","last_fullsized":"2024-09-13T17:24:19.476759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488559+0000","last_change":"2024-09-13T17:24:15.456865+0000","last_active":"2024-09-13T17:24:19.488559+0000","last_peered":"2024-09-13T17:24:19.488559+0000","last_clean":"2024-09-13T17:24:19.488559+0000","last_became_active":"2024-09-13T17:24:15.456631+0000","last_became_peered":"2024-09-13T17:24:15.456631+0000","last_unstale":"2024-09-13T17:24:19.488559+0000","last_undegraded":"2024-09-13T17:24:19.488559+0000","last_fullsized":"2024-09-13T17:24:19.488559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475054+0000","last_change":"2024-09-13T17:24:15.471072+0000","last_active":"2024-09-13T17:24:19.475054+0000","last_peered":"2024-09-13T17:24:19.475054+0000","last_clean":"2024-09-13T17:24:19.475054+0000","last_became_active":"2024-09-13T17:24:15.470861+0000","last_became_peered":"2024-09-13T17:24:15.470861+0000","last_unstale":"2024-09-13T17:24:19.475054+0000","last_undegraded":"2024-09-13T17:24:19.475054+0000","last_fullsized":"2024-09-13T17:24:19.475054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471745+0000","last_change":"2024-09-13T17:24:15.474755+0000","last_active":"2024-09-13T17:24:19.471745+0000","last_peered":"2024-09-13T17:24:19.471745+0000","last_clean":"2024-09-13T17:24:19.471745+0000","last_became_active":"2024-09-13T17:24:15.474492+0000","last_became_peered":"2024-09-13T17:24:15.474492+0000","last_unstale":"2024-09-13T17:24:19.471745+0000","last_undegraded":"2024-09-13T17:24:19.471745+0000","last_fullsized":"2024-09-13T17:24:19.471745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470293+0000","last_change":"2024-09-13T17:24:15.466413+0000","last_active":"2024-09-13T17:24:19.470293+0000","last_peered":"2024-09-13T17:24:19.470293+0000","last_clean":"2024-09-13T17:24:19.470293+0000","last_became_active":"2024-09-13T17:24:15.466175+0000","last_became_peered":"2024-09-13T17:24:15.466175+0000","last_unstale":"2024-09-13T17:24:19.470293+0000","last_undegraded":"2024-09-13T17:24:19.470293+0000","last_fullsized":"2024-09-13T17:24:19.470293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467831+0000","last_change":"2024-09-13T17:24:15.477779+0000","last_active":"2024-09-13T17:24:19.467831+0000","last_peered":"2024-09-13T17:24:19.467831+0000","last_clean":"2024-09-13T17:24:19.467831+0000","last_became_active":"2024-09-13T17:24:15.477570+0000","last_became_peered":"2024-09-13T17:24:15.477570+0000","last_unstale":"2024-09-13T17:24:19.467831+0000","last_undegraded":"2024-09-13T17:24:19.467831+0000","last_fullsized":"2024-09-13T17:24:19.467831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470760+0000","last_change":"2024-09-13T17:24:15.462997+0000","last_active":"2024-09-13T17:24:19.470760+0000","last_peered":"2024-09-13T17:24:19.470760+0000","last_clean":"2024-09-13T17:24:19.470760+0000","last_became_active":"2024-09-13T17:24:15.462681+0000","last_became_peered":"2024-09-13T17:24:15.462681+0000","last_unstale":"2024-09-13T17:24:19.470760+0000","last_undegraded":"2024-09-13T17:24:19.470760+0000","last_fullsized":"2024-09-13T17:24:19.470760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:25.475650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469238+0000","last_change":"2024-09-13T17:24:15.456978+0000","last_active":"2024-09-13T17:24:19.469238+0000","last_peered":"2024-09-13T17:24:19.469238+0000","last_clean":"2024-09-13T17:24:19.469238+0000","last_became_active":"2024-09-13T17:24:15.456755+0000","last_became_peered":"2024-09-13T17:24:15.456755+0000","last_unstale":"2024-09-13T17:24:19.469238+0000","last_undegraded":"2024-09-13T17:24:19.469238+0000","last_fullsized":"2024-09-13T17:24:19.469238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473078+0000","last_change":"2024-09-13T17:24:15.473844+0000","last_active":"2024-09-13T17:24:19.473078+0000","last_peered":"2024-09-13T17:24:19.473078+0000","last_clean":"2024-09-13T17:24:19.473078+0000","last_became_active":"2024-09-13T17:24:15.473173+0000","last_became_peered":"2024-09-13T17:24:15.473173+0000","last_unstale":"2024-09-13T17:24:19.473078+0000","last_undegraded":"2024-09-13T17:24:19.473078+0000","last_fullsized":"2024-09-13T17:24:19.473078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815161+0000","last_change":"2024-09-13T17:24:15.470097+0000","last_active":"2024-09-13T17:24:19.815161+0000","last_peered":"2024-09-13T17:24:19.815161+0000","last_clean":"2024-09-13T17:24:19.815161+0000","last_became_active":"2024-09-13T17:24:15.469838+0000","last_became_peered":"2024-09-13T17:24:15.469838+0000","last_unstale":"2024-09-13T17:24:19.815161+0000","last_undegraded":"2024-09-13T17:24:19.815161+0000","last_fullsized":"2024-09-13T17:24:19.815161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464607+0000","last_change":"2024-09-13T17:24:15.473774+0000","last_active":"2024-09-13T17:24:19.464607+0000","last_peered":"2024-09-13T17:24:19.464607+0000","last_clean":"2024-09-13T17:24:19.464607+0000","last_became_active":"2024-09-13T17:24:15.473399+0000","last_became_peered":"2024-09-13T17:24:15.473399+0000","last_unstale":"2024-09-13T17:24:19.464607+0000","last_undegraded":"2024-09-13T17:24:19.464607+0000","last_fullsized":"2024-09-13T17:24:19.464607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:26.844852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473438+0000","last_change":"2024-09-13T17:24:15.462760+0000","last_active":"2024-09-13T17:24:19.473438+0000","last_peered":"2024-09-13T17:24:19.473438+0000","last_clean":"2024-09-13T17:24:19.473438+0000","last_became_active":"2024-09-13T17:24:15.462524+0000","last_became_peered":"2024-09-13T17:24:15.462524+0000","last_unstale":"2024-09-13T17:24:19.473438+0000","last_undegraded":"2024-09-13T17:24:19.473438+0000","last_fullsized":"2024-09-13T17:24:19.473438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470212+0000","last_change":"2024-09-13T17:24:15.457282+0000","last_active":"2024-09-13T17:24:19.470212+0000","last_peered":"2024-09-13T17:24:19.470212+0000","last_clean":"2024-09-13T17:24:19.470212+0000","last_became_active":"2024-09-13T17:24:15.456356+0000","last_became_peered":"2024-09-13T17:24:15.456356+0000","last_unstale":"2024-09-13T17:24:19.470212+0000","last_undegraded":"2024-09-13T17:24:19.470212+0000","last_fullsized":"2024-09-13T17:24:19.470212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488232+0000","last_change":"2024-09-13T17:24:15.446263+0000","last_active":"2024-09-13T17:24:19.488232+0000","last_peered":"2024-09-13T17:24:19.488232+0000","last_clean":"2024-09-13T17:24:19.488232+0000","last_became_active":"2024-09-13T17:24:15.445995+0000","last_became_peered":"2024-09-13T17:24:15.445995+0000","last_unstale":"2024-09-13T17:24:19.488232+0000","last_undegraded":"2024-09-13T17:24:19.488232+0000","last_fullsized":"2024-09-13T17:24:19.488232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468673+0000","last_change":"2024-09-13T17:24:15.456257+0000","last_active":"2024-09-13T17:24:19.468673+0000","last_peered":"2024-09-13T17:24:19.468673+0000","last_clean":"2024-09-13T17:24:19.468673+0000","last_became_active":"2024-09-13T17:24:15.455665+0000","last_became_peered":"2024-09-13T17:24:15.455665+0000","last_unstale":"2024-09-13T17:24:19.468673+0000","last_undegraded":"2024-09-13T17:24:19.468673+0000","last_fullsized":"2024-09-13T17:24:19.468673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471558+0000","last_change":"2024-09-13T17:24:15.461978+0000","last_active":"2024-09-13T17:24:19.471558+0000","last_peered":"2024-09-13T17:24:19.471558+0000","last_clean":"2024-09-13T17:24:19.471558+0000","last_became_active":"2024-09-13T17:24:15.461755+0000","last_became_peered":"2024-09-13T17:24:15.461755+0000","last_unstale":"2024-09-13T17:24:19.471558+0000","last_undegraded":"2024-09-13T17:24:19.471558+0000","last_fullsized":"2024-09-13T17:24:19.471558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464237+0000","last_change":"2024-09-13T17:24:15.475629+0000","last_active":"2024-09-13T17:24:19.464237+0000","last_peered":"2024-09-13T17:24:19.464237+0000","last_clean":"2024-09-13T17:24:19.464237+0000","last_became_active":"2024-09-13T17:24:15.475274+0000","last_became_peered":"2024-09-13T17:24:15.475274+0000","last_unstale":"2024-09-13T17:24:19.464237+0000","last_undegraded":"2024-09-13T17:24:19.464237+0000","last_fullsized":"2024-09-13T17:24:19.464237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:10.483625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473012+0000","last_change":"2024-09-13T17:24:15.456332+0000","last_active":"2024-09-13T17:24:19.473012+0000","last_peered":"2024-09-13T17:24:19.473012+0000","last_clean":"2024-09-13T17:24:19.473012+0000","last_became_active":"2024-09-13T17:24:15.456082+0000","last_became_peered":"2024-09-13T17:24:15.456082+0000","last_unstale":"2024-09-13T17:24:19.473012+0000","last_undegraded":"2024-09-13T17:24:19.473012+0000","last_fullsized":"2024-09-13T17:24:19.473012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474972+0000","last_change":"2024-09-13T17:24:15.471584+0000","last_active":"2024-09-13T17:24:19.474972+0000","last_peered":"2024-09-13T17:24:19.474972+0000","last_clean":"2024-09-13T17:24:19.474972+0000","last_became_active":"2024-09-13T17:24:15.471359+0000","last_became_peered":"2024-09-13T17:24:15.471359+0000","last_unstale":"2024-09-13T17:24:19.474972+0000","last_undegraded":"2024-09-13T17:24:19.474972+0000","last_fullsized":"2024-09-13T17:24:19.474972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815205+0000","last_change":"2024-09-13T17:24:15.472777+0000","last_active":"2024-09-13T17:24:19.815205+0000","last_peered":"2024-09-13T17:24:19.815205+0000","last_clean":"2024-09-13T17:24:19.815205+0000","last_became_active":"2024-09-13T17:24:15.472470+0000","last_became_peered":"2024-09-13T17:24:15.472470+0000","last_unstale":"2024-09-13T17:24:19.815205+0000","last_undegraded":"2024-09-13T17:24:19.815205+0000","last_fullsized":"2024-09-13T17:24:19.815205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466323+0000","last_change":"2024-09-13T17:24:15.452755+0000","last_active":"2024-09-13T17:24:19.466323+0000","last_peered":"2024-09-13T17:24:19.466323+0000","last_clean":"2024-09-13T17:24:19.466323+0000","last_became_active":"2024-09-13T17:24:15.452538+0000","last_became_peered":"2024-09-13T17:24:15.452538+0000","last_unstale":"2024-09-13T17:24:19.466323+0000","last_undegraded":"2024-09-13T17:24:19.466323+0000","last_fullsized":"2024-09-13T17:24:19.466323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814329+0000","last_change":"2024-09-13T17:24:15.464963+0000","last_active":"2024-09-13T17:24:19.814329+0000","last_peered":"2024-09-13T17:24:19.814329+0000","last_clean":"2024-09-13T17:24:19.814329+0000","last_became_active":"2024-09-13T17:24:15.464655+0000","last_became_peered":"2024-09-13T17:24:15.464655+0000","last_unstale":"2024-09-13T17:24:19.814329+0000","last_undegraded":"2024-09-13T17:24:19.814329+0000","last_fullsized":"2024-09-13T17:24:19.814329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471402+0000","last_change":"2024-09-13T17:24:15.466816+0000","last_active":"2024-09-13T17:24:19.471402+0000","last_peered":"2024-09-13T17:24:19.471402+0000","last_clean":"2024-09-13T17:24:19.471402+0000","last_became_active":"2024-09-13T17:24:15.464574+0000","last_became_peered":"2024-09-13T17:24:15.464574+0000","last_unstale":"2024-09-13T17:24:19.471402+0000","last_undegraded":"2024-09-13T17:24:19.471402+0000","last_fullsized":"2024-09-13T17:24:19.471402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814245+0000","last_change":"2024-09-13T17:24:15.470250+0000","last_active":"2024-09-13T17:24:19.814245+0000","last_peered":"2024-09-13T17:24:19.814245+0000","last_clean":"2024-09-13T17:24:19.814245+0000","last_became_active":"2024-09-13T17:24:15.469321+0000","last_became_peered":"2024-09-13T17:24:15.469321+0000","last_unstale":"2024-09-13T17:24:19.814245+0000","last_undegraded":"2024-09-13T17:24:19.814245+0000","last_fullsized":"2024-09-13T17:24:19.814245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.469790+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.469232+0000","last_became_peered":"2024-09-13T17:24:15.469232+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476283+0000","last_change":"2024-09-13T17:24:15.454215+0000","last_active":"2024-09-13T17:24:19.476283+0000","last_peered":"2024-09-13T17:24:19.476283+0000","last_clean":"2024-09-13T17:24:19.476283+0000","last_became_active":"2024-09-13T17:24:15.451536+0000","last_became_peered":"2024-09-13T17:24:15.451536+0000","last_unstale":"2024-09-13T17:24:19.476283+0000","last_undegraded":"2024-09-13T17:24:19.476283+0000","last_fullsized":"2024-09-13T17:24:19.476283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.491024+0000","last_change":"2024-09-13T17:24:15.443088+0000","last_active":"2024-09-13T17:24:19.491024+0000","last_peered":"2024-09-13T17:24:19.491024+0000","last_clean":"2024-09-13T17:24:19.491024+0000","last_became_active":"2024-09-13T17:24:15.442849+0000","last_became_peered":"2024-09-13T17:24:15.442849+0000","last_unstale":"2024-09-13T17:24:19.491024+0000","last_undegraded":"2024-09-13T17:24:19.491024+0000","last_fullsized":"2024-09-13T17:24:19.491024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814892+0000","last_change":"2024-09-13T17:24:15.462869+0000","last_active":"2024-09-13T17:24:19.814892+0000","last_peered":"2024-09-13T17:24:19.814892+0000","last_clean":"2024-09-13T17:24:19.814892+0000","last_became_active":"2024-09-13T17:24:15.462623+0000","last_became_peered":"2024-09-13T17:24:15.462623+0000","last_unstale":"2024-09-13T17:24:19.814892+0000","last_undegraded":"2024-09-13T17:24:19.814892+0000","last_fullsized":"2024-09-13T17:24:19.814892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0459999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:45.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:24:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.467+0000 7fcae6600700 1 Processor -- start 2024-09-13T17:24:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.467+0000 7fcae6600700 1 -- start start 2024-09-13T17:24:45.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae6600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0070b80 0x7fcae00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae6600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcae00b4140 0x7fcae006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae6600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae00aea90 con 0x7fcae0158480 2024-09-13T17:24:45.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae6600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00b45f0 con 0x7fcae00b4140 2024-09-13T17:24:45.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae6600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae015bf50 con 0x7fcae0070b80 2024-09-13T17:24:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae5c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcae00b4140 0x7fcae006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae5c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcae00b4140 0x7fcae006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36414/0 (socket says 172.21.15.139:36414) 2024-09-13T17:24:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcae5c00700 1 -- 172.21.15.139:0/164796362 learned_addr learned my addr 172.21.15.139:0/164796362 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.471+0000 7fcadfe00700 1 --2- 172.21.15.139:0/164796362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0070b80 0x7fcae00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae5c00700 1 -- 172.21.15.139:0/164796362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0070b80 msgr2=0x7fcae00b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae5c00700 1 --2- 172.21.15.139:0/164796362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0070b80 0x7fcae00b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae5c00700 1 -- 172.21.15.139:0/164796362 >> v1:172.21.15.176:6789/0 conn(0x7fcae0158480 legacy=0x7fcae00ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae5c00700 1 -- 172.21.15.139:0/164796362 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0070fc0 con 0x7fcae00b4140 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcadf400700 1 -- 172.21.15.139:0/164796362 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074500446 0 0) 0x7fcae00aea90 con 0x7fcae0158480 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae5c00700 1 --2- 172.21.15.139:0/164796362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae006c840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009e50 tx=0x7fcad800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e1d1336f573a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcadf400700 1 -- 172.21.15.139:0/164796362 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800e070 con 0x7fcae00b4140 2024-09-13T17:24:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcadf400700 1 -- 172.21.15.139:0/164796362 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800b910 con 0x7fcae00b4140 2024-09-13T17:24:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcadf400700 1 -- 172.21.15.139:0/164796362 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800bcc0 con 0x7fcae00b4140 2024-09-13T17:24:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 -- 172.21.15.139:0/164796362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 msgr2=0x7fcae006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 --2- 172.21.15.139:0/164796362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae006c840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009e50 tx=0x7fcad800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:45.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 -- 172.21.15.139:0/164796362 shutdown_connections 2024-09-13T17:24:45.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 --2- 172.21.15.139:0/164796362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae006c840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 --2- 172.21.15.139:0/164796362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0070b80 0x7fcae00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 -- 172.21.15.139:0/164796362 >> 172.21.15.139:0/164796362 conn(0x7fcae006ed30 msgr2=0x7fcae00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:45.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 -- 172.21.15.139:0/164796362 shutdown_connections 2024-09-13T17:24:45.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.475+0000 7fcae6600700 1 -- 172.21.15.139:0/164796362 wait complete. 2024-09-13T17:24:45.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 Processor -- start 2024-09-13T17:24:45.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 -- start start 2024-09-13T17:24:45.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcae0070b80 0x7fcae00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae01418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0158480 0x7fcae015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0141e30 con 0x7fcae00b4140 2024-09-13T17:24:45.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae01f6430 con 0x7fcae0070b80 2024-09-13T17:24:45.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae6600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae014f6e0 con 0x7fcae0158480 2024-09-13T17:24:45.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae01418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae01418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36428/0 (socket says 172.21.15.139:36428) 2024-09-13T17:24:45.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 -- 172.21.15.139:0/3590479702 learned_addr learned my addr 172.21.15.139:0/3590479702 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:45.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae5200700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcae0070b80 0x7fcae00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae5c00700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0158480 0x7fcae015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 -- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0158480 msgr2=0x7fcae015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0158480 0x7fcae015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 -- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcae0070b80 msgr2=0x7fcae00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcae0070b80 0x7fcae00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcadfe00700 1 -- 172.21.15.139:0/3590479702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009b30 con 0x7fcae00b4140 2024-09-13T17:24:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.479+0000 7fcae5c00700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0158480 0x7fcae015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcadfe00700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae01418f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00e9a0 tx=0x7fcacc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc009720 con 0x7fcae00b4140 2024-09-13T17:24:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae01f6680 con 0x7fcae00b4140 2024-09-13T17:24:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00c850 con 0x7fcae00b4140 2024-09-13T17:24:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00cbe0 con 0x7fcae00b4140 2024-09-13T17:24:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae01f6c40 con 0x7fcae00b4140 2024-09-13T17:24:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae015afc0 con 0x7fcae00b4140 2024-09-13T17:24:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.483+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcacc00cd40 con 0x7fcae00b4140 2024-09-13T17:24:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.487+0000 7fcadcc00700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcac0066730 0x7fcac0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.487+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcacc084520 con 0x7fcae00b4140 2024-09-13T17:24:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.487+0000 7fcae5200700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcac0066730 0x7fcac0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.487+0000 7fcae5200700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcac0066730 0x7fcac0068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcad4000f60 tx=0x7fcad4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.495+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcacc051510 con 0x7fcae00b4140 2024-09-13T17:24:45.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.679+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcae015b890 con 0x7fcac0066730 2024-09-13T17:24:45.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.695+0000 7fcadcc00700 1 -- 172.21.15.139:0/3590479702 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345098 (secure 0 0 0) 0x7fcad400f690 con 0x7fcac0066730 2024-09-13T17:24:45.704 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcac0066730 msgr2=0x7fcac0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcac0066730 0x7fcac0068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcad4000f60 tx=0x7fcad4009040 comp rx=0 tx=0).stop 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 msgr2=0x7fcae01418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae01418f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00e9a0 tx=0x7fcacc00ecb0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 shutdown_connections 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcac0066730 0x7fcac0068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcae0158480 0x7fcae015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcae00b4140 0x7fcae01418f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 --2- 172.21.15.139:0/3590479702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcae0070b80 0x7fcae00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 >> 172.21.15.139:0/3590479702 conn(0x7fcae006ed30 msgr2=0x7fcae015c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:45.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 shutdown_connections 2024-09-13T17:24:45.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.703+0000 7fcae6600700 1 -- 172.21.15.139:0/3590479702 wait complete. 2024-09-13T17:24:45.710 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:24:45.729 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-13T17:24:44.095032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005106"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476754+0000","last_change":"2024-09-13T17:24:14.997748+0000","last_active":"2024-09-13T17:24:19.476754+0000","last_peered":"2024-09-13T17:24:19.476754+0000","last_clean":"2024-09-13T17:24:19.476754+0000","last_became_active":"2024-09-13T17:24:14.997395+0000","last_became_peered":"2024-09-13T17:24:14.997395+0000","last_unstale":"2024-09-13T17:24:19.476754+0000","last_undegraded":"2024-09-13T17:24:19.476754+0000","last_fullsized":"2024-09-13T17:24:19.476754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:08.882065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474419+0000","last_change":"2024-09-13T17:24:15.472848+0000","last_active":"2024-09-13T17:24:19.474419+0000","last_peered":"2024-09-13T17:24:19.474419+0000","last_clean":"2024-09-13T17:24:19.474419+0000","last_became_active":"2024-09-13T17:24:15.472568+0000","last_became_peered":"2024-09-13T17:24:15.472568+0000","last_unstale":"2024-09-13T17:24:19.474419+0000","last_undegraded":"2024-09-13T17:24:19.474419+0000","last_fullsized":"2024-09-13T17:24:19.474419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933480+0000","last_change":"2024-09-13T17:24:19.822998+0000","last_active":"2024-09-13T17:24:19.933480+0000","last_peered":"2024-09-13T17:24:19.933480+0000","last_clean":"2024-09-13T17:24:19.933480+0000","last_became_active":"2024-09-13T17:24:19.822588+0000","last_became_peered":"2024-09-13T17:24:19.822588+0000","last_unstale":"2024-09-13T17:24:19.933480+0000","last_undegraded":"2024-09-13T17:24:19.933480+0000","last_fullsized":"2024-09-13T17:24:19.933480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:55.423743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475101+0000","last_change":"2024-09-13T17:24:14.998585+0000","last_active":"2024-09-13T17:24:19.475101+0000","last_peered":"2024-09-13T17:24:19.475101+0000","last_clean":"2024-09-13T17:24:19.475101+0000","last_became_active":"2024-09-13T17:24:14.997238+0000","last_became_peered":"2024-09-13T17:24:14.997238+0000","last_unstale":"2024-09-13T17:24:19.475101+0000","last_undegraded":"2024-09-13T17:24:19.475101+0000","last_fullsized":"2024-09-13T17:24:19.475101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476604+0000","last_change":"2024-09-13T17:24:15.447613+0000","last_active":"2024-09-13T17:24:19.476604+0000","last_peered":"2024-09-13T17:24:19.476604+0000","last_clean":"2024-09-13T17:24:19.476604+0000","last_became_active":"2024-09-13T17:24:15.447292+0000","last_became_peered":"2024-09-13T17:24:15.447292+0000","last_unstale":"2024-09-13T17:24:19.476604+0000","last_undegraded":"2024-09-13T17:24:19.476604+0000","last_fullsized":"2024-09-13T17:24:19.476604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:04.930680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935221+0000","last_change":"2024-09-13T17:24:19.483196+0000","last_active":"2024-09-13T17:24:19.935221+0000","last_peered":"2024-09-13T17:24:19.935221+0000","last_clean":"2024-09-13T17:24:19.935221+0000","last_became_active":"2024-09-13T17:24:19.482655+0000","last_became_peered":"2024-09-13T17:24:19.482655+0000","last_unstale":"2024-09-13T17:24:19.935221+0000","last_undegraded":"2024-09-13T17:24:19.935221+0000","last_fullsized":"2024-09-13T17:24:19.935221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815101+0000","last_change":"2024-09-13T17:24:15.000813+0000","last_active":"2024-09-13T17:24:19.815101+0000","last_peered":"2024-09-13T17:24:19.815101+0000","last_clean":"2024-09-13T17:24:19.815101+0000","last_became_active":"2024-09-13T17:24:15.000349+0000","last_became_peered":"2024-09-13T17:24:15.000349+0000","last_unstale":"2024-09-13T17:24:19.815101+0000","last_undegraded":"2024-09-13T17:24:19.815101+0000","last_fullsized":"2024-09-13T17:24:19.815101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:15.469818+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:15.469543+0000","last_became_peered":"2024-09-13T17:24:15.469543+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935701+0000","last_change":"2024-09-13T17:24:19.493757+0000","last_active":"2024-09-13T17:24:19.935701+0000","last_peered":"2024-09-13T17:24:19.935701+0000","last_clean":"2024-09-13T17:24:19.935701+0000","last_became_active":"2024-09-13T17:24:19.493366+0000","last_became_peered":"2024-09-13T17:24:19.493366+0000","last_unstale":"2024-09-13T17:24:19.935701+0000","last_undegraded":"2024-09-13T17:24:19.935701+0000","last_fullsized":"2024-09-13T17:24:19.935701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:14.535914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814303+0000","last_change":"2024-09-13T17:24:14.999109+0000","last_active":"2024-09-13T17:24:19.814303+0000","last_peered":"2024-09-13T17:24:19.814303+0000","last_clean":"2024-09-13T17:24:19.814303+0000","last_became_active":"2024-09-13T17:24:14.998768+0000","last_became_peered":"2024-09-13T17:24:14.998768+0000","last_unstale":"2024-09-13T17:24:19.814303+0000","last_undegraded":"2024-09-13T17:24:19.814303+0000","last_fullsized":"2024-09-13T17:24:19.814303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471317+0000","last_change":"2024-09-13T17:24:15.455006+0000","last_active":"2024-09-13T17:24:19.471317+0000","last_peered":"2024-09-13T17:24:19.471317+0000","last_clean":"2024-09-13T17:24:19.471317+0000","last_became_active":"2024-09-13T17:24:15.454591+0000","last_became_peered":"2024-09-13T17:24:15.454591+0000","last_unstale":"2024-09-13T17:24:19.471317+0000","last_undegraded":"2024-09-13T17:24:19.471317+0000","last_fullsized":"2024-09-13T17:24:19.471317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935356+0000","last_change":"2024-09-13T17:24:19.484849+0000","last_active":"2024-09-13T17:24:19.935356+0000","last_peered":"2024-09-13T17:24:19.935356+0000","last_clean":"2024-09-13T17:24:19.935356+0000","last_became_active":"2024-09-13T17:24:19.484457+0000","last_became_peered":"2024-09-13T17:24:19.484457+0000","last_unstale":"2024-09-13T17:24:19.935356+0000","last_undegraded":"2024-09-13T17:24:19.935356+0000","last_fullsized":"2024-09-13T17:24:19.935356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471737+0000","last_change":"2024-09-13T17:24:15.471194+0000","last_active":"2024-09-13T17:24:19.471737+0000","last_peered":"2024-09-13T17:24:19.471737+0000","last_clean":"2024-09-13T17:24:19.471737+0000","last_became_active":"2024-09-13T17:24:15.471032+0000","last_became_peered":"2024-09-13T17:24:15.471032+0000","last_unstale":"2024-09-13T17:24:19.471737+0000","last_undegraded":"2024-09-13T17:24:19.471737+0000","last_fullsized":"2024-09-13T17:24:19.471737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814620+0000","last_change":"2024-09-13T17:24:14.999111+0000","last_active":"2024-09-13T17:24:19.814620+0000","last_peered":"2024-09-13T17:24:19.814620+0000","last_clean":"2024-09-13T17:24:19.814620+0000","last_became_active":"2024-09-13T17:24:14.998815+0000","last_became_peered":"2024-09-13T17:24:14.998815+0000","last_unstale":"2024-09-13T17:24:19.814620+0000","last_undegraded":"2024-09-13T17:24:19.814620+0000","last_fullsized":"2024-09-13T17:24:19.814620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936160+0000","last_change":"2024-09-13T17:24:19.482367+0000","last_active":"2024-09-13T17:24:19.936160+0000","last_peered":"2024-09-13T17:24:19.936160+0000","last_clean":"2024-09-13T17:24:19.936160+0000","last_became_active":"2024-09-13T17:24:19.481975+0000","last_became_peered":"2024-09-13T17:24:19.481975+0000","last_unstale":"2024-09-13T17:24:19.936160+0000","last_undegraded":"2024-09-13T17:24:19.936160+0000","last_fullsized":"2024-09-13T17:24:19.936160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:45.002511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471659+0000","last_change":"2024-09-13T17:24:15.460971+0000","last_active":"2024-09-13T17:24:19.471659+0000","last_peered":"2024-09-13T17:24:19.471659+0000","last_clean":"2024-09-13T17:24:19.471659+0000","last_became_active":"2024-09-13T17:24:15.460737+0000","last_became_peered":"2024-09-13T17:24:15.460737+0000","last_unstale":"2024-09-13T17:24:19.471659+0000","last_undegraded":"2024-09-13T17:24:19.471659+0000","last_fullsized":"2024-09-13T17:24:19.471659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.489201+0000","last_change":"2024-09-13T17:24:14.995871+0000","last_active":"2024-09-13T17:24:19.489201+0000","last_peered":"2024-09-13T17:24:19.489201+0000","last_clean":"2024-09-13T17:24:19.489201+0000","last_became_active":"2024-09-13T17:24:14.995587+0000","last_became_peered":"2024-09-13T17:24:14.995587+0000","last_unstale":"2024-09-13T17:24:19.489201+0000","last_undegraded":"2024-09-13T17:24:19.489201+0000","last_fullsized":"2024-09-13T17:24:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936209+0000","last_change":"2024-09-13T17:24:19.485042+0000","last_active":"2024-09-13T17:24:19.936209+0000","last_peered":"2024-09-13T17:24:19.936209+0000","last_clean":"2024-09-13T17:24:19.936209+0000","last_became_active":"2024-09-13T17:24:19.484582+0000","last_became_peered":"2024-09-13T17:24:19.484582+0000","last_unstale":"2024-09-13T17:24:19.936209+0000","last_undegraded":"2024-09-13T17:24:19.936209+0000","last_fullsized":"2024-09-13T17:24:19.936209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466505+0000","last_change":"2024-09-13T17:24:15.451828+0000","last_active":"2024-09-13T17:24:19.466505+0000","last_peered":"2024-09-13T17:24:19.466505+0000","last_clean":"2024-09-13T17:24:19.466505+0000","last_became_active":"2024-09-13T17:24:15.451657+0000","last_became_peered":"2024-09-13T17:24:15.451657+0000","last_unstale":"2024-09-13T17:24:19.466505+0000","last_undegraded":"2024-09-13T17:24:19.466505+0000","last_fullsized":"2024-09-13T17:24:19.466505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488312+0000","last_change":"2024-09-13T17:24:14.990698+0000","last_active":"2024-09-13T17:24:19.488312+0000","last_peered":"2024-09-13T17:24:19.488312+0000","last_clean":"2024-09-13T17:24:19.488312+0000","last_became_active":"2024-09-13T17:24:14.990416+0000","last_became_peered":"2024-09-13T17:24:14.990416+0000","last_unstale":"2024-09-13T17:24:19.488312+0000","last_undegraded":"2024-09-13T17:24:19.488312+0000","last_fullsized":"2024-09-13T17:24:19.488312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161687+0000","last_change":"2024-09-13T17:24:19.820132+0000","last_active":"2024-09-13T17:24:20.161687+0000","last_peered":"2024-09-13T17:24:20.161687+0000","last_clean":"2024-09-13T17:24:20.161687+0000","last_became_active":"2024-09-13T17:24:19.818510+0000","last_became_peered":"2024-09-13T17:24:19.818510+0000","last_unstale":"2024-09-13T17:24:20.161687+0000","last_undegraded":"2024-09-13T17:24:20.161687+0000","last_fullsized":"2024-09-13T17:24:20.161687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463620+0000","last_change":"2024-09-13T17:24:15.463989+0000","last_active":"2024-09-13T17:24:19.463620+0000","last_peered":"2024-09-13T17:24:19.463620+0000","last_clean":"2024-09-13T17:24:19.463620+0000","last_became_active":"2024-09-13T17:24:15.460158+0000","last_became_peered":"2024-09-13T17:24:15.460158+0000","last_unstale":"2024-09-13T17:24:19.463620+0000","last_undegraded":"2024-09-13T17:24:19.463620+0000","last_fullsized":"2024-09-13T17:24:19.463620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:52.267958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.813963+0000","last_change":"2024-09-13T17:24:14.997926+0000","last_active":"2024-09-13T17:24:19.813963+0000","last_peered":"2024-09-13T17:24:19.813963+0000","last_clean":"2024-09-13T17:24:19.813963+0000","last_became_active":"2024-09-13T17:24:14.997676+0000","last_became_peered":"2024-09-13T17:24:14.997676+0000","last_unstale":"2024-09-13T17:24:19.813963+0000","last_undegraded":"2024-09-13T17:24:19.813963+0000","last_fullsized":"2024-09-13T17:24:19.813963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935910+0000","last_change":"2024-09-13T17:24:19.482666+0000","last_active":"2024-09-13T17:24:19.935910+0000","last_peered":"2024-09-13T17:24:19.935910+0000","last_clean":"2024-09-13T17:24:19.935910+0000","last_became_active":"2024-09-13T17:24:19.482094+0000","last_became_peered":"2024-09-13T17:24:19.482094+0000","last_unstale":"2024-09-13T17:24:19.935910+0000","last_undegraded":"2024-09-13T17:24:19.935910+0000","last_fullsized":"2024-09-13T17:24:19.935910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476533+0000","last_change":"2024-09-13T17:24:15.451913+0000","last_active":"2024-09-13T17:24:19.476533+0000","last_peered":"2024-09-13T17:24:19.476533+0000","last_clean":"2024-09-13T17:24:19.476533+0000","last_became_active":"2024-09-13T17:24:15.451613+0000","last_became_peered":"2024-09-13T17:24:15.451613+0000","last_unstale":"2024-09-13T17:24:19.476533+0000","last_undegraded":"2024-09-13T17:24:19.476533+0000","last_fullsized":"2024-09-13T17:24:19.476533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:56.437721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475611+0000","last_change":"2024-09-13T17:24:15.000387+0000","last_active":"2024-09-13T17:24:19.475611+0000","last_peered":"2024-09-13T17:24:19.475611+0000","last_clean":"2024-09-13T17:24:19.475611+0000","last_became_active":"2024-09-13T17:24:14.999607+0000","last_became_peered":"2024-09-13T17:24:14.999607+0000","last_unstale":"2024-09-13T17:24:19.475611+0000","last_undegraded":"2024-09-13T17:24:19.475611+0000","last_fullsized":"2024-09-13T17:24:19.475611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935553+0000","last_change":"2024-09-13T17:24:19.818902+0000","last_active":"2024-09-13T17:24:19.935553+0000","last_peered":"2024-09-13T17:24:19.935553+0000","last_clean":"2024-09-13T17:24:19.935553+0000","last_became_active":"2024-09-13T17:24:19.818460+0000","last_became_peered":"2024-09-13T17:24:19.818460+0000","last_unstale":"2024-09-13T17:24:19.935553+0000","last_undegraded":"2024-09-13T17:24:19.935553+0000","last_fullsized":"2024-09-13T17:24:19.935553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.477603+0000","last_change":"2024-09-13T17:24:15.460686+0000","last_active":"2024-09-13T17:24:19.477603+0000","last_peered":"2024-09-13T17:24:19.477603+0000","last_clean":"2024-09-13T17:24:19.477603+0000","last_became_active":"2024-09-13T17:24:15.455133+0000","last_became_peered":"2024-09-13T17:24:15.455133+0000","last_unstale":"2024-09-13T17:24:19.477603+0000","last_undegraded":"2024-09-13T17:24:19.477603+0000","last_fullsized":"2024-09-13T17:24:19.477603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.407763+0000","last_change":"2024-09-13T17:24:14.987019+0000","last_active":"2024-09-13T17:24:20.407763+0000","last_peered":"2024-09-13T17:24:20.407763+0000","last_clean":"2024-09-13T17:24:20.407763+0000","last_became_active":"2024-09-13T17:24:14.986734+0000","last_became_peered":"2024-09-13T17:24:14.986734+0000","last_unstale":"2024-09-13T17:24:20.407763+0000","last_undegraded":"2024-09-13T17:24:20.407763+0000","last_fullsized":"2024-09-13T17:24:20.407763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:57.089831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933226+0000","last_change":"2024-09-13T17:24:19.819389+0000","last_active":"2024-09-13T17:24:19.933226+0000","last_peered":"2024-09-13T17:24:19.933226+0000","last_clean":"2024-09-13T17:24:19.933226+0000","last_became_active":"2024-09-13T17:24:19.819043+0000","last_became_peered":"2024-09-13T17:24:19.819043+0000","last_unstale":"2024-09-13T17:24:19.933226+0000","last_undegraded":"2024-09-13T17:24:19.933226+0000","last_fullsized":"2024-09-13T17:24:19.933226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:34.882933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488880+0000","last_change":"2024-09-13T17:24:15.454805+0000","last_active":"2024-09-13T17:24:19.488880+0000","last_peered":"2024-09-13T17:24:19.488880+0000","last_clean":"2024-09-13T17:24:19.488880+0000","last_became_active":"2024-09-13T17:24:15.454207+0000","last_became_peered":"2024-09-13T17:24:15.454207+0000","last_unstale":"2024-09-13T17:24:19.488880+0000","last_undegraded":"2024-09-13T17:24:19.488880+0000","last_fullsized":"2024-09-13T17:24:19.488880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815264+0000","last_change":"2024-09-13T17:24:15.005234+0000","last_active":"2024-09-13T17:24:19.815264+0000","last_peered":"2024-09-13T17:24:19.815264+0000","last_clean":"2024-09-13T17:24:19.815264+0000","last_became_active":"2024-09-13T17:24:15.005057+0000","last_became_peered":"2024-09-13T17:24:15.005057+0000","last_unstale":"2024-09-13T17:24:19.815264+0000","last_undegraded":"2024-09-13T17:24:19.815264+0000","last_fullsized":"2024-09-13T17:24:19.815264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:30.054079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162331+0000","last_change":"2024-09-13T17:24:19.818120+0000","last_active":"2024-09-13T17:24:20.162331+0000","last_peered":"2024-09-13T17:24:20.162331+0000","last_clean":"2024-09-13T17:24:20.162331+0000","last_became_active":"2024-09-13T17:24:19.816778+0000","last_became_peered":"2024-09-13T17:24:19.816778+0000","last_unstale":"2024-09-13T17:24:20.162331+0000","last_undegraded":"2024-09-13T17:24:20.162331+0000","last_fullsized":"2024-09-13T17:24:20.162331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:32.916944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471403+0000","last_change":"2024-09-13T17:24:15.469501+0000","last_active":"2024-09-13T17:24:19.471403+0000","last_peered":"2024-09-13T17:24:19.471403+0000","last_clean":"2024-09-13T17:24:19.471403+0000","last_became_active":"2024-09-13T17:24:15.469155+0000","last_became_peered":"2024-09-13T17:24:15.469155+0000","last_unstale":"2024-09-13T17:24:19.471403+0000","last_undegraded":"2024-09-13T17:24:19.471403+0000","last_fullsized":"2024-09-13T17:24:19.471403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488955+0000","last_change":"2024-09-13T17:24:14.998201+0000","last_active":"2024-09-13T17:24:19.488955+0000","last_peered":"2024-09-13T17:24:19.488955+0000","last_clean":"2024-09-13T17:24:19.488955+0000","last_became_active":"2024-09-13T17:24:14.997869+0000","last_became_peered":"2024-09-13T17:24:14.997869+0000","last_unstale":"2024-09-13T17:24:19.488955+0000","last_undegraded":"2024-09-13T17:24:19.488955+0000","last_fullsized":"2024-09-13T17:24:19.488955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:25.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161494+0000","last_change":"2024-09-13T17:24:19.491726+0000","last_active":"2024-09-13T17:24:20.161494+0000","last_peered":"2024-09-13T17:24:20.161494+0000","last_clean":"2024-09-13T17:24:20.161494+0000","last_became_active":"2024-09-13T17:24:19.491286+0000","last_became_peered":"2024-09-13T17:24:19.491286+0000","last_unstale":"2024-09-13T17:24:20.161494+0000","last_undegraded":"2024-09-13T17:24:20.161494+0000","last_fullsized":"2024-09-13T17:24:20.161494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466484+0000","last_change":"2024-09-13T17:24:15.460992+0000","last_active":"2024-09-13T17:24:19.466484+0000","last_peered":"2024-09-13T17:24:19.466484+0000","last_clean":"2024-09-13T17:24:19.466484+0000","last_became_active":"2024-09-13T17:24:15.460669+0000","last_became_peered":"2024-09-13T17:24:15.460669+0000","last_unstale":"2024-09-13T17:24:19.466484+0000","last_undegraded":"2024-09-13T17:24:19.466484+0000","last_fullsized":"2024-09-13T17:24:19.466484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:58.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471042+0000","last_change":"2024-09-13T17:24:14.983936+0000","last_active":"2024-09-13T17:24:19.471042+0000","last_peered":"2024-09-13T17:24:19.471042+0000","last_clean":"2024-09-13T17:24:19.471042+0000","last_became_active":"2024-09-13T17:24:14.983685+0000","last_became_peered":"2024-09-13T17:24:14.983685+0000","last_unstale":"2024-09-13T17:24:19.471042+0000","last_undegraded":"2024-09-13T17:24:19.471042+0000","last_fullsized":"2024-09-13T17:24:19.471042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161572+0000","last_change":"2024-09-13T17:24:19.491752+0000","last_active":"2024-09-13T17:24:20.161572+0000","last_peered":"2024-09-13T17:24:20.161572+0000","last_clean":"2024-09-13T17:24:20.161572+0000","last_became_active":"2024-09-13T17:24:19.491306+0000","last_became_peered":"2024-09-13T17:24:19.491306+0000","last_unstale":"2024-09-13T17:24:20.161572+0000","last_undegraded":"2024-09-13T17:24:20.161572+0000","last_fullsized":"2024-09-13T17:24:20.161572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.450557+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.449789+0000","last_became_peered":"2024-09-13T17:24:15.449789+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462988+0000","last_change":"2024-09-13T17:24:14.993441+0000","last_active":"2024-09-13T17:24:19.462988+0000","last_peered":"2024-09-13T17:24:19.462988+0000","last_clean":"2024-09-13T17:24:19.462988+0000","last_became_active":"2024-09-13T17:24:14.992844+0000","last_became_peered":"2024-09-13T17:24:14.992844+0000","last_unstale":"2024-09-13T17:24:19.462988+0000","last_undegraded":"2024-09-13T17:24:19.462988+0000","last_fullsized":"2024-09-13T17:24:19.462988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:45.269493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161707+0000","last_change":"2024-09-13T17:24:19.495163+0000","last_active":"2024-09-13T17:24:20.161707+0000","last_peered":"2024-09-13T17:24:20.161707+0000","last_clean":"2024-09-13T17:24:20.161707+0000","last_became_active":"2024-09-13T17:24:19.494785+0000","last_became_peered":"2024-09-13T17:24:19.494785+0000","last_unstale":"2024-09-13T17:24:20.161707+0000","last_undegraded":"2024-09-13T17:24:20.161707+0000","last_fullsized":"2024-09-13T17:24:20.161707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:03.723085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469004+0000","last_change":"2024-09-13T17:24:15.446878+0000","last_active":"2024-09-13T17:24:19.469004+0000","last_peered":"2024-09-13T17:24:19.469004+0000","last_clean":"2024-09-13T17:24:19.469004+0000","last_became_active":"2024-09-13T17:24:15.446603+0000","last_became_peered":"2024-09-13T17:24:15.446603+0000","last_unstale":"2024-09-13T17:24:19.469004+0000","last_undegraded":"2024-09-13T17:24:19.469004+0000","last_fullsized":"2024-09-13T17:24:19.469004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814072+0000","last_change":"2024-09-13T17:24:14.994254+0000","last_active":"2024-09-13T17:24:19.814072+0000","last_peered":"2024-09-13T17:24:19.814072+0000","last_clean":"2024-09-13T17:24:19.814072+0000","last_became_active":"2024-09-13T17:24:14.993782+0000","last_became_peered":"2024-09-13T17:24:14.993782+0000","last_unstale":"2024-09-13T17:24:19.814072+0000","last_undegraded":"2024-09-13T17:24:19.814072+0000","last_fullsized":"2024-09-13T17:24:19.814072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:25.959187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162536+0000","last_change":"2024-09-13T17:24:19.817339+0000","last_active":"2024-09-13T17:24:20.162536+0000","last_peered":"2024-09-13T17:24:20.162536+0000","last_clean":"2024-09-13T17:24:20.162536+0000","last_became_active":"2024-09-13T17:24:19.816481+0000","last_became_peered":"2024-09-13T17:24:19.816481+0000","last_unstale":"2024-09-13T17:24:20.162536+0000","last_undegraded":"2024-09-13T17:24:20.162536+0000","last_fullsized":"2024-09-13T17:24:20.162536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470053+0000","last_change":"2024-09-13T17:24:15.460711+0000","last_active":"2024-09-13T17:24:19.470053+0000","last_peered":"2024-09-13T17:24:19.470053+0000","last_clean":"2024-09-13T17:24:19.470053+0000","last_became_active":"2024-09-13T17:24:15.460433+0000","last_became_peered":"2024-09-13T17:24:15.460433+0000","last_unstale":"2024-09-13T17:24:19.470053+0000","last_undegraded":"2024-09-13T17:24:19.470053+0000","last_fullsized":"2024-09-13T17:24:19.470053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470665+0000","last_change":"2024-09-13T17:24:14.982963+0000","last_active":"2024-09-13T17:24:19.470665+0000","last_peered":"2024-09-13T17:24:19.470665+0000","last_clean":"2024-09-13T17:24:19.470665+0000","last_became_active":"2024-09-13T17:24:14.982671+0000","last_became_peered":"2024-09-13T17:24:14.982671+0000","last_unstale":"2024-09-13T17:24:19.470665+0000","last_undegraded":"2024-09-13T17:24:19.470665+0000","last_fullsized":"2024-09-13T17:24:19.470665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814197+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:24:19.814197+0000","last_peered":"2024-09-13T17:24:19.814197+0000","last_clean":"2024-09-13T17:24:19.814197+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:24:19.814197+0000","last_undegraded":"2024-09-13T17:24:19.814197+0000","last_fullsized":"2024-09-13T17:24:19.814197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159775+0000","last_change":"2024-09-13T17:24:19.819311+0000","last_active":"2024-09-13T17:24:20.159775+0000","last_peered":"2024-09-13T17:24:20.159775+0000","last_clean":"2024-09-13T17:24:20.159775+0000","last_became_active":"2024-09-13T17:24:19.818841+0000","last_became_peered":"2024-09-13T17:24:19.818841+0000","last_unstale":"2024-09-13T17:24:20.159775+0000","last_undegraded":"2024-09-13T17:24:20.159775+0000","last_fullsized":"2024-09-13T17:24:20.159775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:24.662706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814915+0000","last_change":"2024-09-13T17:24:15.476542+0000","last_active":"2024-09-13T17:24:19.814915+0000","last_peered":"2024-09-13T17:24:19.814915+0000","last_clean":"2024-09-13T17:24:19.814915+0000","last_became_active":"2024-09-13T17:24:15.476036+0000","last_became_peered":"2024-09-13T17:24:15.476036+0000","last_unstale":"2024-09-13T17:24:19.814915+0000","last_undegraded":"2024-09-13T17:24:19.814915+0000","last_fullsized":"2024-09-13T17:24:19.814915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463290+0000","last_change":"2024-09-13T17:24:14.979602+0000","last_active":"2024-09-13T17:24:19.463290+0000","last_peered":"2024-09-13T17:24:19.463290+0000","last_clean":"2024-09-13T17:24:19.463290+0000","last_became_active":"2024-09-13T17:24:14.979263+0000","last_became_peered":"2024-09-13T17:24:14.979263+0000","last_unstale":"2024-09-13T17:24:19.463290+0000","last_undegraded":"2024-09-13T17:24:19.463290+0000","last_fullsized":"2024-09-13T17:24:19.463290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:55.997046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159668+0000","last_change":"2024-09-13T17:24:19.817514+0000","last_active":"2024-09-13T17:24:20.159668+0000","last_peered":"2024-09-13T17:24:20.159668+0000","last_clean":"2024-09-13T17:24:20.159668+0000","last_became_active":"2024-09-13T17:24:19.816806+0000","last_became_peered":"2024-09-13T17:24:19.816806+0000","last_unstale":"2024-09-13T17:24:20.159668+0000","last_undegraded":"2024-09-13T17:24:20.159668+0000","last_fullsized":"2024-09-13T17:24:20.159668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:16.798179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471041+0000","last_change":"2024-09-13T17:24:15.469593+0000","last_active":"2024-09-13T17:24:19.471041+0000","last_peered":"2024-09-13T17:24:19.471041+0000","last_clean":"2024-09-13T17:24:19.471041+0000","last_became_active":"2024-09-13T17:24:15.469184+0000","last_became_peered":"2024-09-13T17:24:15.469184+0000","last_unstale":"2024-09-13T17:24:19.471041+0000","last_undegraded":"2024-09-13T17:24:19.471041+0000","last_fullsized":"2024-09-13T17:24:19.471041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488746+0000","last_change":"2024-09-13T17:24:14.989442+0000","last_active":"2024-09-13T17:24:19.488746+0000","last_peered":"2024-09-13T17:24:19.488746+0000","last_clean":"2024-09-13T17:24:19.488746+0000","last_became_active":"2024-09-13T17:24:14.988868+0000","last_became_peered":"2024-09-13T17:24:14.988868+0000","last_unstale":"2024-09-13T17:24:19.488746+0000","last_undegraded":"2024-09-13T17:24:19.488746+0000","last_fullsized":"2024-09-13T17:24:19.488746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162394+0000","last_change":"2024-09-13T17:24:19.494393+0000","last_active":"2024-09-13T17:24:20.162394+0000","last_peered":"2024-09-13T17:24:20.162394+0000","last_clean":"2024-09-13T17:24:20.162394+0000","last_became_active":"2024-09-13T17:24:19.493501+0000","last_became_peered":"2024-09-13T17:24:19.493501+0000","last_unstale":"2024-09-13T17:24:20.162394+0000","last_undegraded":"2024-09-13T17:24:20.162394+0000","last_fullsized":"2024-09-13T17:24:20.162394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:33.643683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815260+0000","last_change":"2024-09-13T17:24:15.461926+0000","last_active":"2024-09-13T17:24:19.815260+0000","last_peered":"2024-09-13T17:24:19.815260+0000","last_clean":"2024-09-13T17:24:19.815260+0000","last_became_active":"2024-09-13T17:24:15.459619+0000","last_became_peered":"2024-09-13T17:24:15.459619+0000","last_unstale":"2024-09-13T17:24:19.815260+0000","last_undegraded":"2024-09-13T17:24:19.815260+0000","last_fullsized":"2024-09-13T17:24:19.815260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464733+0000","last_change":"2024-09-13T17:24:14.994961+0000","last_active":"2024-09-13T17:24:19.464733+0000","last_peered":"2024-09-13T17:24:19.464733+0000","last_clean":"2024-09-13T17:24:19.464733+0000","last_became_active":"2024-09-13T17:24:14.994704+0000","last_became_peered":"2024-09-13T17:24:14.994704+0000","last_unstale":"2024-09-13T17:24:19.464733+0000","last_undegraded":"2024-09-13T17:24:19.464733+0000","last_fullsized":"2024-09-13T17:24:19.464733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.937782+0000","last_change":"2024-09-13T17:24:19.818462+0000","last_active":"2024-09-13T17:24:19.937782+0000","last_peered":"2024-09-13T17:24:19.937782+0000","last_clean":"2024-09-13T17:24:19.937782+0000","last_became_active":"2024-09-13T17:24:19.816380+0000","last_became_peered":"2024-09-13T17:24:19.816380+0000","last_unstale":"2024-09-13T17:24:19.937782+0000","last_undegraded":"2024-09-13T17:24:19.937782+0000","last_fullsized":"2024-09-13T17:24:19.937782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815030+0000","last_change":"2024-09-13T17:24:15.448897+0000","last_active":"2024-09-13T17:24:19.815030+0000","last_peered":"2024-09-13T17:24:19.815030+0000","last_clean":"2024-09-13T17:24:19.815030+0000","last_became_active":"2024-09-13T17:24:15.448622+0000","last_became_peered":"2024-09-13T17:24:15.448622+0000","last_unstale":"2024-09-13T17:24:19.815030+0000","last_undegraded":"2024-09-13T17:24:19.815030+0000","last_fullsized":"2024-09-13T17:24:19.815030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463641+0000","last_change":"2024-09-13T17:24:14.997545+0000","last_active":"2024-09-13T17:24:19.463641+0000","last_peered":"2024-09-13T17:24:19.463641+0000","last_clean":"2024-09-13T17:24:19.463641+0000","last_became_active":"2024-09-13T17:24:14.997198+0000","last_became_peered":"2024-09-13T17:24:14.997198+0000","last_unstale":"2024-09-13T17:24:19.463641+0000","last_undegraded":"2024-09-13T17:24:19.463641+0000","last_fullsized":"2024-09-13T17:24:19.463641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:25.033343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.935257+0000","last_change":"2024-09-13T17:24:19.480414+0000","last_active":"2024-09-13T17:24:19.935257+0000","last_peered":"2024-09-13T17:24:19.935257+0000","last_clean":"2024-09-13T17:24:19.935257+0000","last_became_active":"2024-09-13T17:24:19.479642+0000","last_became_peered":"2024-09-13T17:24:19.479642+0000","last_unstale":"2024-09-13T17:24:19.935257+0000","last_undegraded":"2024-09-13T17:24:19.935257+0000","last_fullsized":"2024-09-13T17:24:19.935257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:14.017983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814064+0000","last_change":"2024-09-13T17:24:15.450082+0000","last_active":"2024-09-13T17:24:19.814064+0000","last_peered":"2024-09-13T17:24:19.814064+0000","last_clean":"2024-09-13T17:24:19.814064+0000","last_became_active":"2024-09-13T17:24:15.449273+0000","last_became_peered":"2024-09-13T17:24:15.449273+0000","last_unstale":"2024-09-13T17:24:19.814064+0000","last_undegraded":"2024-09-13T17:24:19.814064+0000","last_fullsized":"2024-09-13T17:24:19.814064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462863+0000","last_change":"2024-09-13T17:24:14.983243+0000","last_active":"2024-09-13T17:24:19.462863+0000","last_peered":"2024-09-13T17:24:19.462863+0000","last_clean":"2024-09-13T17:24:19.462863+0000","last_became_active":"2024-09-13T17:24:14.983004+0000","last_became_peered":"2024-09-13T17:24:14.983004+0000","last_unstale":"2024-09-13T17:24:19.462863+0000","last_undegraded":"2024-09-13T17:24:19.462863+0000","last_fullsized":"2024-09-13T17:24:19.462863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:53.015817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162516+0000","last_change":"2024-09-13T17:24:19.488835+0000","last_active":"2024-09-13T17:24:20.162516+0000","last_peered":"2024-09-13T17:24:20.162516+0000","last_clean":"2024-09-13T17:24:20.162516+0000","last_became_active":"2024-09-13T17:24:19.486830+0000","last_became_peered":"2024-09-13T17:24:19.486830+0000","last_unstale":"2024-09-13T17:24:20.162516+0000","last_undegraded":"2024-09-13T17:24:20.162516+0000","last_fullsized":"2024-09-13T17:24:20.162516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:29.868024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470643+0000","last_change":"2024-09-13T17:24:15.461810+0000","last_active":"2024-09-13T17:24:19.470643+0000","last_peered":"2024-09-13T17:24:19.470643+0000","last_clean":"2024-09-13T17:24:19.470643+0000","last_became_active":"2024-09-13T17:24:15.461508+0000","last_became_peered":"2024-09-13T17:24:15.461508+0000","last_unstale":"2024-09-13T17:24:19.470643+0000","last_undegraded":"2024-09-13T17:24:19.470643+0000","last_fullsized":"2024-09-13T17:24:19.470643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471219+0000","last_change":"2024-09-13T17:24:14.987302+0000","last_active":"2024-09-13T17:24:19.471219+0000","last_peered":"2024-09-13T17:24:19.471219+0000","last_clean":"2024-09-13T17:24:19.471219+0000","last_became_active":"2024-09-13T17:24:14.986233+0000","last_became_peered":"2024-09-13T17:24:14.986233+0000","last_unstale":"2024-09-13T17:24:19.471219+0000","last_undegraded":"2024-09-13T17:24:19.471219+0000","last_fullsized":"2024-09-13T17:24:19.471219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934778+0000","last_change":"2024-09-13T17:24:19.818522+0000","last_active":"2024-09-13T17:24:19.934778+0000","last_peered":"2024-09-13T17:24:19.934778+0000","last_clean":"2024-09-13T17:24:19.934778+0000","last_became_active":"2024-09-13T17:24:19.817966+0000","last_became_peered":"2024-09-13T17:24:19.817966+0000","last_unstale":"2024-09-13T17:24:19.934778+0000","last_undegraded":"2024-09-13T17:24:19.934778+0000","last_fullsized":"2024-09-13T17:24:19.934778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:34.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814894+0000","last_change":"2024-09-13T17:24:15.459249+0000","last_active":"2024-09-13T17:24:19.814894+0000","last_peered":"2024-09-13T17:24:19.814894+0000","last_clean":"2024-09-13T17:24:19.814894+0000","last_became_active":"2024-09-13T17:24:15.459011+0000","last_became_peered":"2024-09-13T17:24:15.459011+0000","last_unstale":"2024-09-13T17:24:19.814894+0000","last_undegraded":"2024-09-13T17:24:19.814894+0000","last_fullsized":"2024-09-13T17:24:19.814894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470945+0000","last_change":"2024-09-13T17:24:14.988544+0000","last_active":"2024-09-13T17:24:19.470945+0000","last_peered":"2024-09-13T17:24:19.470945+0000","last_clean":"2024-09-13T17:24:19.470945+0000","last_became_active":"2024-09-13T17:24:14.988212+0000","last_became_peered":"2024-09-13T17:24:14.988212+0000","last_unstale":"2024-09-13T17:24:19.470945+0000","last_undegraded":"2024-09-13T17:24:19.470945+0000","last_fullsized":"2024-09-13T17:24:19.470945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934302+0000","last_change":"2024-09-13T17:24:19.815017+0000","last_active":"2024-09-13T17:24:19.934302+0000","last_peered":"2024-09-13T17:24:19.934302+0000","last_clean":"2024-09-13T17:24:19.934302+0000","last_became_active":"2024-09-13T17:24:19.814320+0000","last_became_peered":"2024-09-13T17:24:19.814320+0000","last_unstale":"2024-09-13T17:24:19.934302+0000","last_undegraded":"2024-09-13T17:24:19.934302+0000","last_fullsized":"2024-09-13T17:24:19.934302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:48.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468886+0000","last_change":"2024-09-13T17:24:15.456460+0000","last_active":"2024-09-13T17:24:19.468886+0000","last_peered":"2024-09-13T17:24:19.468886+0000","last_clean":"2024-09-13T17:24:19.468886+0000","last_became_active":"2024-09-13T17:24:15.456017+0000","last_became_peered":"2024-09-13T17:24:15.456017+0000","last_unstale":"2024-09-13T17:24:19.468886+0000","last_undegraded":"2024-09-13T17:24:19.468886+0000","last_fullsized":"2024-09-13T17:24:19.468886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:15.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476162+0000","last_change":"2024-09-13T17:24:14.990747+0000","last_active":"2024-09-13T17:24:19.476162+0000","last_peered":"2024-09-13T17:24:19.476162+0000","last_clean":"2024-09-13T17:24:19.476162+0000","last_became_active":"2024-09-13T17:24:14.990294+0000","last_became_peered":"2024-09-13T17:24:14.990294+0000","last_unstale":"2024-09-13T17:24:19.476162+0000","last_undegraded":"2024-09-13T17:24:19.476162+0000","last_fullsized":"2024-09-13T17:24:19.476162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.938634+0000","last_change":"2024-09-13T17:24:19.818818+0000","last_active":"2024-09-13T17:24:19.938634+0000","last_peered":"2024-09-13T17:24:19.938634+0000","last_clean":"2024-09-13T17:24:19.938634+0000","last_became_active":"2024-09-13T17:24:19.818382+0000","last_became_peered":"2024-09-13T17:24:19.818382+0000","last_unstale":"2024-09-13T17:24:19.938634+0000","last_undegraded":"2024-09-13T17:24:19.938634+0000","last_fullsized":"2024-09-13T17:24:19.938634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814361+0000","last_change":"2024-09-13T17:24:15.466297+0000","last_active":"2024-09-13T17:24:19.814361+0000","last_peered":"2024-09-13T17:24:19.814361+0000","last_clean":"2024-09-13T17:24:19.814361+0000","last_became_active":"2024-09-13T17:24:15.466044+0000","last_became_peered":"2024-09-13T17:24:15.466044+0000","last_unstale":"2024-09-13T17:24:19.814361+0000","last_undegraded":"2024-09-13T17:24:19.814361+0000","last_fullsized":"2024-09-13T17:24:19.814361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:31.909644+0000","last_change":"2024-09-13T17:24:14.999123+0000","last_active":"2024-09-13T17:24:31.909644+0000","last_peered":"2024-09-13T17:24:31.909644+0000","last_clean":"2024-09-13T17:24:31.909644+0000","last_became_active":"2024-09-13T17:24:14.998510+0000","last_became_peered":"2024-09-13T17:24:14.998510+0000","last_unstale":"2024-09-13T17:24:31.909644+0000","last_undegraded":"2024-09-13T17:24:31.909644+0000","last_fullsized":"2024-09-13T17:24:31.909644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.161518+0000","last_change":"2024-09-13T17:24:19.489369+0000","last_active":"2024-09-13T17:24:20.161518+0000","last_peered":"2024-09-13T17:24:20.161518+0000","last_clean":"2024-09-13T17:24:20.161518+0000","last_became_active":"2024-09-13T17:24:19.488726+0000","last_became_peered":"2024-09-13T17:24:19.488726+0000","last_unstale":"2024-09-13T17:24:20.161518+0000","last_undegraded":"2024-09-13T17:24:20.161518+0000","last_fullsized":"2024-09-13T17:24:20.161518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464281+0000","last_change":"2024-09-13T17:24:15.460340+0000","last_active":"2024-09-13T17:24:19.464281+0000","last_peered":"2024-09-13T17:24:19.464281+0000","last_clean":"2024-09-13T17:24:19.464281+0000","last_became_active":"2024-09-13T17:24:15.456798+0000","last_became_peered":"2024-09-13T17:24:15.456798+0000","last_unstale":"2024-09-13T17:24:19.464281+0000","last_undegraded":"2024-09-13T17:24:19.464281+0000","last_fullsized":"2024-09-13T17:24:19.464281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.305382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488655+0000","last_change":"2024-09-13T17:24:14.992998+0000","last_active":"2024-09-13T17:24:19.488655+0000","last_peered":"2024-09-13T17:24:19.488655+0000","last_clean":"2024-09-13T17:24:19.488655+0000","last_became_active":"2024-09-13T17:24:14.992739+0000","last_became_peered":"2024-09-13T17:24:14.992739+0000","last_unstale":"2024-09-13T17:24:19.488655+0000","last_undegraded":"2024-09-13T17:24:19.488655+0000","last_fullsized":"2024-09-13T17:24:19.488655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:51.253168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.936378+0000","last_change":"2024-09-13T17:24:19.493862+0000","last_active":"2024-09-13T17:24:19.936378+0000","last_peered":"2024-09-13T17:24:19.936378+0000","last_clean":"2024-09-13T17:24:19.936378+0000","last_became_active":"2024-09-13T17:24:19.493509+0000","last_became_peered":"2024-09-13T17:24:19.493509+0000","last_unstale":"2024-09-13T17:24:19.936378+0000","last_undegraded":"2024-09-13T17:24:19.936378+0000","last_fullsized":"2024-09-13T17:24:19.936378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476651+0000","last_change":"2024-09-13T17:24:15.452147+0000","last_active":"2024-09-13T17:24:19.476651+0000","last_peered":"2024-09-13T17:24:19.476651+0000","last_clean":"2024-09-13T17:24:19.476651+0000","last_became_active":"2024-09-13T17:24:15.451907+0000","last_became_peered":"2024-09-13T17:24:15.451907+0000","last_unstale":"2024-09-13T17:24:19.476651+0000","last_undegraded":"2024-09-13T17:24:19.476651+0000","last_fullsized":"2024-09-13T17:24:19.476651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471398+0000","last_change":"2024-09-13T17:24:14.983387+0000","last_active":"2024-09-13T17:24:19.471398+0000","last_peered":"2024-09-13T17:24:19.471398+0000","last_clean":"2024-09-13T17:24:19.471398+0000","last_became_active":"2024-09-13T17:24:14.983068+0000","last_became_peered":"2024-09-13T17:24:14.983068+0000","last_unstale":"2024-09-13T17:24:19.471398+0000","last_undegraded":"2024-09-13T17:24:19.471398+0000","last_fullsized":"2024-09-13T17:24:19.471398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.290592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933438+0000","last_change":"2024-09-13T17:24:19.483413+0000","last_active":"2024-09-13T17:24:19.933438+0000","last_peered":"2024-09-13T17:24:19.933438+0000","last_clean":"2024-09-13T17:24:19.933438+0000","last_became_active":"2024-09-13T17:24:19.482969+0000","last_became_peered":"2024-09-13T17:24:19.482969+0000","last_unstale":"2024-09-13T17:24:19.933438+0000","last_undegraded":"2024-09-13T17:24:19.933438+0000","last_fullsized":"2024-09-13T17:24:19.933438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471316+0000","last_change":"2024-09-13T17:24:15.462544+0000","last_active":"2024-09-13T17:24:19.471316+0000","last_peered":"2024-09-13T17:24:19.471316+0000","last_clean":"2024-09-13T17:24:19.471316+0000","last_became_active":"2024-09-13T17:24:15.462281+0000","last_became_peered":"2024-09-13T17:24:15.462281+0000","last_unstale":"2024-09-13T17:24:19.471316+0000","last_undegraded":"2024-09-13T17:24:19.471316+0000","last_fullsized":"2024-09-13T17:24:19.471316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475543+0000","last_change":"2024-09-13T17:24:14.980247+0000","last_active":"2024-09-13T17:24:19.475543+0000","last_peered":"2024-09-13T17:24:19.475543+0000","last_clean":"2024-09-13T17:24:19.475543+0000","last_became_active":"2024-09-13T17:24:14.979718+0000","last_became_peered":"2024-09-13T17:24:14.979718+0000","last_unstale":"2024-09-13T17:24:19.475543+0000","last_undegraded":"2024-09-13T17:24:19.475543+0000","last_fullsized":"2024-09-13T17:24:19.475543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.468834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.933528+0000","last_change":"2024-09-13T17:24:19.822202+0000","last_active":"2024-09-13T17:24:19.933528+0000","last_peered":"2024-09-13T17:24:19.933528+0000","last_clean":"2024-09-13T17:24:19.933528+0000","last_became_active":"2024-09-13T17:24:19.819258+0000","last_became_peered":"2024-09-13T17:24:19.819258+0000","last_unstale":"2024-09-13T17:24:19.933528+0000","last_undegraded":"2024-09-13T17:24:19.933528+0000","last_fullsized":"2024-09-13T17:24:19.933528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:00.905961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.162494+0000","last_change":"2024-09-13T17:24:19.817595+0000","last_active":"2024-09-13T17:24:20.162494+0000","last_peered":"2024-09-13T17:24:20.162494+0000","last_clean":"2024-09-13T17:24:20.162494+0000","last_became_active":"2024-09-13T17:24:19.817002+0000","last_became_peered":"2024-09-13T17:24:19.817002+0000","last_unstale":"2024-09-13T17:24:20.162494+0000","last_undegraded":"2024-09-13T17:24:20.162494+0000","last_fullsized":"2024-09-13T17:24:20.162494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:58.524578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.487552+0000","last_change":"2024-09-13T17:24:15.453433+0000","last_active":"2024-09-13T17:24:19.487552+0000","last_peered":"2024-09-13T17:24:19.487552+0000","last_clean":"2024-09-13T17:24:19.487552+0000","last_became_active":"2024-09-13T17:24:15.453178+0000","last_became_peered":"2024-09-13T17:24:15.453178+0000","last_unstale":"2024-09-13T17:24:19.487552+0000","last_undegraded":"2024-09-13T17:24:19.487552+0000","last_fullsized":"2024-09-13T17:24:19.487552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470382+0000","last_change":"2024-09-13T17:24:14.981327+0000","last_active":"2024-09-13T17:24:19.470382+0000","last_peered":"2024-09-13T17:24:19.470382+0000","last_clean":"2024-09-13T17:24:19.470382+0000","last_became_active":"2024-09-13T17:24:14.980907+0000","last_became_peered":"2024-09-13T17:24:14.980907+0000","last_unstale":"2024-09-13T17:24:19.470382+0000","last_undegraded":"2024-09-13T17:24:19.470382+0000","last_fullsized":"2024-09-13T17:24:19.470382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.159850+0000","last_change":"2024-09-13T17:24:19.488756+0000","last_active":"2024-09-13T17:24:20.159850+0000","last_peered":"2024-09-13T17:24:20.159850+0000","last_clean":"2024-09-13T17:24:20.159850+0000","last_became_active":"2024-09-13T17:24:19.488197+0000","last_became_peered":"2024-09-13T17:24:19.488197+0000","last_unstale":"2024-09-13T17:24:20.159850+0000","last_undegraded":"2024-09-13T17:24:20.159850+0000","last_fullsized":"2024-09-13T17:24:20.159850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:33.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466419+0000","last_change":"2024-09-13T17:24:15.451443+0000","last_active":"2024-09-13T17:24:19.466419+0000","last_peered":"2024-09-13T17:24:19.466419+0000","last_clean":"2024-09-13T17:24:19.466419+0000","last_became_active":"2024-09-13T17:24:15.449232+0000","last_became_peered":"2024-09-13T17:24:15.449232+0000","last_unstale":"2024-09-13T17:24:19.466419+0000","last_undegraded":"2024-09-13T17:24:19.466419+0000","last_fullsized":"2024-09-13T17:24:19.466419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467931+0000","last_change":"2024-09-13T17:24:14.996368+0000","last_active":"2024-09-13T17:24:19.467931+0000","last_peered":"2024-09-13T17:24:19.467931+0000","last_clean":"2024-09-13T17:24:19.467931+0000","last_became_active":"2024-09-13T17:24:14.996059+0000","last_became_peered":"2024-09-13T17:24:14.996059+0000","last_unstale":"2024-09-13T17:24:19.467931+0000","last_undegraded":"2024-09-13T17:24:19.467931+0000","last_fullsized":"2024-09-13T17:24:19.467931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:12.132280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.472184+0000","last_change":"2024-09-13T17:24:14.985701+0000","last_active":"2024-09-13T17:24:19.472184+0000","last_peered":"2024-09-13T17:24:19.472184+0000","last_clean":"2024-09-13T17:24:19.472184+0000","last_became_active":"2024-09-13T17:24:14.985456+0000","last_became_peered":"2024-09-13T17:24:14.985456+0000","last_unstale":"2024-09-13T17:24:19.472184+0000","last_undegraded":"2024-09-13T17:24:19.472184+0000","last_fullsized":"2024-09-13T17:24:19.472184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:26.957682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476130+0000","last_change":"2024-09-13T17:24:15.455316+0000","last_active":"2024-09-13T17:24:19.476130+0000","last_peered":"2024-09-13T17:24:19.476130+0000","last_clean":"2024-09-13T17:24:19.476130+0000","last_became_active":"2024-09-13T17:24:15.454982+0000","last_became_peered":"2024-09-13T17:24:15.454982+0000","last_unstale":"2024-09-13T17:24:19.476130+0000","last_undegraded":"2024-09-13T17:24:19.476130+0000","last_fullsized":"2024-09-13T17:24:19.476130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:20.025977+0000","last_change":"2024-09-13T17:24:19.488455+0000","last_active":"2024-09-13T17:24:20.025977+0000","last_peered":"2024-09-13T17:24:20.025977+0000","last_clean":"2024-09-13T17:24:20.025977+0000","last_became_active":"2024-09-13T17:24:19.485870+0000","last_became_peered":"2024-09-13T17:24:19.485870+0000","last_unstale":"2024-09-13T17:24:20.025977+0000","last_undegraded":"2024-09-13T17:24:20.025977+0000","last_fullsized":"2024-09-13T17:24:20.025977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:48.596044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471752+0000","last_change":"2024-09-13T17:24:15.001371+0000","last_active":"2024-09-13T17:24:19.471752+0000","last_peered":"2024-09-13T17:24:19.471752+0000","last_clean":"2024-09-13T17:24:19.471752+0000","last_became_active":"2024-09-13T17:24:15.001103+0000","last_became_peered":"2024-09-13T17:24:15.001103+0000","last_unstale":"2024-09-13T17:24:19.471752+0000","last_undegraded":"2024-09-13T17:24:19.471752+0000","last_fullsized":"2024-09-13T17:24:19.471752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:13.935315+0000","last_clean_scrub_stamp":"2024-09-13T17:24:13.935315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:28.035253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.463630+0000","last_change":"2024-09-13T17:24:15.455094+0000","last_active":"2024-09-13T17:24:19.463630+0000","last_peered":"2024-09-13T17:24:19.463630+0000","last_clean":"2024-09-13T17:24:19.463630+0000","last_became_active":"2024-09-13T17:24:15.454651+0000","last_became_peered":"2024-09-13T17:24:15.454651+0000","last_unstale":"2024-09-13T17:24:19.463630+0000","last_undegraded":"2024-09-13T17:24:19.463630+0000","last_fullsized":"2024-09-13T17:24:19.463630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.934497+0000","last_change":"2024-09-13T17:24:19.491640+0000","last_active":"2024-09-13T17:24:19.934497+0000","last_peered":"2024-09-13T17:24:19.934497+0000","last_clean":"2024-09-13T17:24:19.934497+0000","last_became_active":"2024-09-13T17:24:19.488532+0000","last_became_peered":"2024-09-13T17:24:19.488532+0000","last_unstale":"2024-09-13T17:24:19.934497+0000","last_undegraded":"2024-09-13T17:24:19.934497+0000","last_fullsized":"2024-09-13T17:24:19.934497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:18.433257+0000","last_clean_scrub_stamp":"2024-09-13T17:24:18.433257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.387959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470302+0000","last_change":"2024-09-13T17:24:15.465966+0000","last_active":"2024-09-13T17:24:19.470302+0000","last_peered":"2024-09-13T17:24:19.470302+0000","last_clean":"2024-09-13T17:24:19.470302+0000","last_became_active":"2024-09-13T17:24:15.465686+0000","last_became_peered":"2024-09-13T17:24:15.465686+0000","last_unstale":"2024-09-13T17:24:19.470302+0000","last_undegraded":"2024-09-13T17:24:19.470302+0000","last_fullsized":"2024-09-13T17:24:19.470302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.462822+0000","last_change":"2024-09-13T17:24:15.447576+0000","last_active":"2024-09-13T17:24:19.462822+0000","last_peered":"2024-09-13T17:24:19.462822+0000","last_clean":"2024-09-13T17:24:19.462822+0000","last_became_active":"2024-09-13T17:24:15.447320+0000","last_became_peered":"2024-09-13T17:24:15.447320+0000","last_unstale":"2024-09-13T17:24:19.462822+0000","last_undegraded":"2024-09-13T17:24:19.462822+0000","last_fullsized":"2024-09-13T17:24:19.462822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:26.973977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.462939+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.462315+0000","last_became_peered":"2024-09-13T17:24:15.462315+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:26.095454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469473+0000","last_change":"2024-09-13T17:24:15.465949+0000","last_active":"2024-09-13T17:24:19.469473+0000","last_peered":"2024-09-13T17:24:19.469473+0000","last_clean":"2024-09-13T17:24:19.469473+0000","last_became_active":"2024-09-13T17:24:15.465644+0000","last_became_peered":"2024-09-13T17:24:15.465644+0000","last_unstale":"2024-09-13T17:24:19.469473+0000","last_undegraded":"2024-09-13T17:24:19.469473+0000","last_fullsized":"2024-09-13T17:24:19.469473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476759+0000","last_change":"2024-09-13T17:24:15.454116+0000","last_active":"2024-09-13T17:24:19.476759+0000","last_peered":"2024-09-13T17:24:19.476759+0000","last_clean":"2024-09-13T17:24:19.476759+0000","last_became_active":"2024-09-13T17:24:15.453864+0000","last_became_peered":"2024-09-13T17:24:15.453864+0000","last_unstale":"2024-09-13T17:24:19.476759+0000","last_undegraded":"2024-09-13T17:24:19.476759+0000","last_fullsized":"2024-09-13T17:24:19.476759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488559+0000","last_change":"2024-09-13T17:24:15.456865+0000","last_active":"2024-09-13T17:24:19.488559+0000","last_peered":"2024-09-13T17:24:19.488559+0000","last_clean":"2024-09-13T17:24:19.488559+0000","last_became_active":"2024-09-13T17:24:15.456631+0000","last_became_peered":"2024-09-13T17:24:15.456631+0000","last_unstale":"2024-09-13T17:24:19.488559+0000","last_undegraded":"2024-09-13T17:24:19.488559+0000","last_fullsized":"2024-09-13T17:24:19.488559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.475054+0000","last_change":"2024-09-13T17:24:15.471072+0000","last_active":"2024-09-13T17:24:19.475054+0000","last_peered":"2024-09-13T17:24:19.475054+0000","last_clean":"2024-09-13T17:24:19.475054+0000","last_became_active":"2024-09-13T17:24:15.470861+0000","last_became_peered":"2024-09-13T17:24:15.470861+0000","last_unstale":"2024-09-13T17:24:19.475054+0000","last_undegraded":"2024-09-13T17:24:19.475054+0000","last_fullsized":"2024-09-13T17:24:19.475054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.420436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471745+0000","last_change":"2024-09-13T17:24:15.474755+0000","last_active":"2024-09-13T17:24:19.471745+0000","last_peered":"2024-09-13T17:24:19.471745+0000","last_clean":"2024-09-13T17:24:19.471745+0000","last_became_active":"2024-09-13T17:24:15.474492+0000","last_became_peered":"2024-09-13T17:24:15.474492+0000","last_unstale":"2024-09-13T17:24:19.471745+0000","last_undegraded":"2024-09-13T17:24:19.471745+0000","last_fullsized":"2024-09-13T17:24:19.471745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:40.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470293+0000","last_change":"2024-09-13T17:24:15.466413+0000","last_active":"2024-09-13T17:24:19.470293+0000","last_peered":"2024-09-13T17:24:19.470293+0000","last_clean":"2024-09-13T17:24:19.470293+0000","last_became_active":"2024-09-13T17:24:15.466175+0000","last_became_peered":"2024-09-13T17:24:15.466175+0000","last_unstale":"2024-09-13T17:24:19.470293+0000","last_undegraded":"2024-09-13T17:24:19.470293+0000","last_fullsized":"2024-09-13T17:24:19.470293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.467831+0000","last_change":"2024-09-13T17:24:15.477779+0000","last_active":"2024-09-13T17:24:19.467831+0000","last_peered":"2024-09-13T17:24:19.467831+0000","last_clean":"2024-09-13T17:24:19.467831+0000","last_became_active":"2024-09-13T17:24:15.477570+0000","last_became_peered":"2024-09-13T17:24:15.477570+0000","last_unstale":"2024-09-13T17:24:19.467831+0000","last_undegraded":"2024-09-13T17:24:19.467831+0000","last_fullsized":"2024-09-13T17:24:19.467831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470760+0000","last_change":"2024-09-13T17:24:15.462997+0000","last_active":"2024-09-13T17:24:19.470760+0000","last_peered":"2024-09-13T17:24:19.470760+0000","last_clean":"2024-09-13T17:24:19.470760+0000","last_became_active":"2024-09-13T17:24:15.462681+0000","last_became_peered":"2024-09-13T17:24:15.462681+0000","last_unstale":"2024-09-13T17:24:19.470760+0000","last_undegraded":"2024-09-13T17:24:19.470760+0000","last_fullsized":"2024-09-13T17:24:19.470760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:25.475650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.469238+0000","last_change":"2024-09-13T17:24:15.456978+0000","last_active":"2024-09-13T17:24:19.469238+0000","last_peered":"2024-09-13T17:24:19.469238+0000","last_clean":"2024-09-13T17:24:19.469238+0000","last_became_active":"2024-09-13T17:24:15.456755+0000","last_became_peered":"2024-09-13T17:24:15.456755+0000","last_unstale":"2024-09-13T17:24:19.469238+0000","last_undegraded":"2024-09-13T17:24:19.469238+0000","last_fullsized":"2024-09-13T17:24:19.469238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473078+0000","last_change":"2024-09-13T17:24:15.473844+0000","last_active":"2024-09-13T17:24:19.473078+0000","last_peered":"2024-09-13T17:24:19.473078+0000","last_clean":"2024-09-13T17:24:19.473078+0000","last_became_active":"2024-09-13T17:24:15.473173+0000","last_became_peered":"2024-09-13T17:24:15.473173+0000","last_unstale":"2024-09-13T17:24:19.473078+0000","last_undegraded":"2024-09-13T17:24:19.473078+0000","last_fullsized":"2024-09-13T17:24:19.473078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:50.614959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815161+0000","last_change":"2024-09-13T17:24:15.470097+0000","last_active":"2024-09-13T17:24:19.815161+0000","last_peered":"2024-09-13T17:24:19.815161+0000","last_clean":"2024-09-13T17:24:19.815161+0000","last_became_active":"2024-09-13T17:24:15.469838+0000","last_became_peered":"2024-09-13T17:24:15.469838+0000","last_unstale":"2024-09-13T17:24:19.815161+0000","last_undegraded":"2024-09-13T17:24:19.815161+0000","last_fullsized":"2024-09-13T17:24:19.815161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:31.148724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464607+0000","last_change":"2024-09-13T17:24:15.473774+0000","last_active":"2024-09-13T17:24:19.464607+0000","last_peered":"2024-09-13T17:24:19.464607+0000","last_clean":"2024-09-13T17:24:19.464607+0000","last_became_active":"2024-09-13T17:24:15.473399+0000","last_became_peered":"2024-09-13T17:24:15.473399+0000","last_unstale":"2024-09-13T17:24:19.464607+0000","last_undegraded":"2024-09-13T17:24:19.464607+0000","last_fullsized":"2024-09-13T17:24:19.464607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:26.844852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473438+0000","last_change":"2024-09-13T17:24:15.462760+0000","last_active":"2024-09-13T17:24:19.473438+0000","last_peered":"2024-09-13T17:24:19.473438+0000","last_clean":"2024-09-13T17:24:19.473438+0000","last_became_active":"2024-09-13T17:24:15.462524+0000","last_became_peered":"2024-09-13T17:24:15.462524+0000","last_unstale":"2024-09-13T17:24:19.473438+0000","last_undegraded":"2024-09-13T17:24:19.473438+0000","last_fullsized":"2024-09-13T17:24:19.473438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470212+0000","last_change":"2024-09-13T17:24:15.457282+0000","last_active":"2024-09-13T17:24:19.470212+0000","last_peered":"2024-09-13T17:24:19.470212+0000","last_clean":"2024-09-13T17:24:19.470212+0000","last_became_active":"2024-09-13T17:24:15.456356+0000","last_became_peered":"2024-09-13T17:24:15.456356+0000","last_unstale":"2024-09-13T17:24:19.470212+0000","last_undegraded":"2024-09-13T17:24:19.470212+0000","last_fullsized":"2024-09-13T17:24:19.470212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:13.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.488232+0000","last_change":"2024-09-13T17:24:15.446263+0000","last_active":"2024-09-13T17:24:19.488232+0000","last_peered":"2024-09-13T17:24:19.488232+0000","last_clean":"2024-09-13T17:24:19.488232+0000","last_became_active":"2024-09-13T17:24:15.445995+0000","last_became_peered":"2024-09-13T17:24:15.445995+0000","last_unstale":"2024-09-13T17:24:19.488232+0000","last_undegraded":"2024-09-13T17:24:19.488232+0000","last_fullsized":"2024-09-13T17:24:19.488232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:15.199806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.468673+0000","last_change":"2024-09-13T17:24:15.456257+0000","last_active":"2024-09-13T17:24:19.468673+0000","last_peered":"2024-09-13T17:24:19.468673+0000","last_clean":"2024-09-13T17:24:19.468673+0000","last_became_active":"2024-09-13T17:24:15.455665+0000","last_became_peered":"2024-09-13T17:24:15.455665+0000","last_unstale":"2024-09-13T17:24:19.468673+0000","last_undegraded":"2024-09-13T17:24:19.468673+0000","last_fullsized":"2024-09-13T17:24:19.468673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:18.905419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471558+0000","last_change":"2024-09-13T17:24:15.461978+0000","last_active":"2024-09-13T17:24:19.471558+0000","last_peered":"2024-09-13T17:24:19.471558+0000","last_clean":"2024-09-13T17:24:19.471558+0000","last_became_active":"2024-09-13T17:24:15.461755+0000","last_became_peered":"2024-09-13T17:24:15.461755+0000","last_unstale":"2024-09-13T17:24:19.471558+0000","last_undegraded":"2024-09-13T17:24:19.471558+0000","last_fullsized":"2024-09-13T17:24:19.471558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.468128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.464237+0000","last_change":"2024-09-13T17:24:15.475629+0000","last_active":"2024-09-13T17:24:19.464237+0000","last_peered":"2024-09-13T17:24:19.464237+0000","last_clean":"2024-09-13T17:24:19.464237+0000","last_became_active":"2024-09-13T17:24:15.475274+0000","last_became_peered":"2024-09-13T17:24:15.475274+0000","last_unstale":"2024-09-13T17:24:19.464237+0000","last_undegraded":"2024-09-13T17:24:19.464237+0000","last_fullsized":"2024-09-13T17:24:19.464237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:10.483625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.473012+0000","last_change":"2024-09-13T17:24:15.456332+0000","last_active":"2024-09-13T17:24:19.473012+0000","last_peered":"2024-09-13T17:24:19.473012+0000","last_clean":"2024-09-13T17:24:19.473012+0000","last_became_active":"2024-09-13T17:24:15.456082+0000","last_became_peered":"2024-09-13T17:24:15.456082+0000","last_unstale":"2024-09-13T17:24:19.473012+0000","last_undegraded":"2024-09-13T17:24:19.473012+0000","last_fullsized":"2024-09-13T17:24:19.473012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.474972+0000","last_change":"2024-09-13T17:24:15.471584+0000","last_active":"2024-09-13T17:24:19.474972+0000","last_peered":"2024-09-13T17:24:19.474972+0000","last_clean":"2024-09-13T17:24:19.474972+0000","last_became_active":"2024-09-13T17:24:15.471359+0000","last_became_peered":"2024-09-13T17:24:15.471359+0000","last_unstale":"2024-09-13T17:24:19.474972+0000","last_undegraded":"2024-09-13T17:24:19.474972+0000","last_fullsized":"2024-09-13T17:24:19.474972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:48.805167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.815205+0000","last_change":"2024-09-13T17:24:15.472777+0000","last_active":"2024-09-13T17:24:19.815205+0000","last_peered":"2024-09-13T17:24:19.815205+0000","last_clean":"2024-09-13T17:24:19.815205+0000","last_became_active":"2024-09-13T17:24:15.472470+0000","last_became_peered":"2024-09-13T17:24:15.472470+0000","last_unstale":"2024-09-13T17:24:19.815205+0000","last_undegraded":"2024-09-13T17:24:19.815205+0000","last_fullsized":"2024-09-13T17:24:19.815205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:36.573678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.466323+0000","last_change":"2024-09-13T17:24:15.452755+0000","last_active":"2024-09-13T17:24:19.466323+0000","last_peered":"2024-09-13T17:24:19.466323+0000","last_clean":"2024-09-13T17:24:19.466323+0000","last_became_active":"2024-09-13T17:24:15.452538+0000","last_became_peered":"2024-09-13T17:24:15.452538+0000","last_unstale":"2024-09-13T17:24:19.466323+0000","last_undegraded":"2024-09-13T17:24:19.466323+0000","last_fullsized":"2024-09-13T17:24:19.466323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814329+0000","last_change":"2024-09-13T17:24:15.464963+0000","last_active":"2024-09-13T17:24:19.814329+0000","last_peered":"2024-09-13T17:24:19.814329+0000","last_clean":"2024-09-13T17:24:19.814329+0000","last_became_active":"2024-09-13T17:24:15.464655+0000","last_became_peered":"2024-09-13T17:24:15.464655+0000","last_unstale":"2024-09-13T17:24:19.814329+0000","last_undegraded":"2024-09-13T17:24:19.814329+0000","last_fullsized":"2024-09-13T17:24:19.814329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:22.007794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.471402+0000","last_change":"2024-09-13T17:24:15.466816+0000","last_active":"2024-09-13T17:24:19.471402+0000","last_peered":"2024-09-13T17:24:19.471402+0000","last_clean":"2024-09-13T17:24:19.471402+0000","last_became_active":"2024-09-13T17:24:15.464574+0000","last_became_peered":"2024-09-13T17:24:15.464574+0000","last_unstale":"2024-09-13T17:24:19.471402+0000","last_undegraded":"2024-09-13T17:24:19.471402+0000","last_fullsized":"2024-09-13T17:24:19.471402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:50.673596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814245+0000","last_change":"2024-09-13T17:24:15.470250+0000","last_active":"2024-09-13T17:24:19.814245+0000","last_peered":"2024-09-13T17:24:19.814245+0000","last_clean":"2024-09-13T17:24:19.814245+0000","last_became_active":"2024-09-13T17:24:15.469321+0000","last_became_peered":"2024-09-13T17:24:15.469321+0000","last_unstale":"2024-09-13T17:24:19.814245+0000","last_undegraded":"2024-09-13T17:24:19.814245+0000","last_fullsized":"2024-09-13T17:24:19.814245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:15.565190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.470854+0000","last_change":"2024-09-13T17:24:15.469790+0000","last_active":"2024-09-13T17:24:19.470854+0000","last_peered":"2024-09-13T17:24:19.470854+0000","last_clean":"2024-09-13T17:24:19.470854+0000","last_became_active":"2024-09-13T17:24:15.469232+0000","last_became_peered":"2024-09-13T17:24:15.469232+0000","last_unstale":"2024-09-13T17:24:19.470854+0000","last_undegraded":"2024-09-13T17:24:19.470854+0000","last_fullsized":"2024-09-13T17:24:19.470854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:52.842658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.476283+0000","last_change":"2024-09-13T17:24:15.454215+0000","last_active":"2024-09-13T17:24:19.476283+0000","last_peered":"2024-09-13T17:24:19.476283+0000","last_clean":"2024-09-13T17:24:19.476283+0000","last_became_active":"2024-09-13T17:24:15.451536+0000","last_became_peered":"2024-09-13T17:24:15.451536+0000","last_unstale":"2024-09-13T17:24:19.476283+0000","last_undegraded":"2024-09-13T17:24:19.476283+0000","last_fullsized":"2024-09-13T17:24:19.476283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:45.112892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.491024+0000","last_change":"2024-09-13T17:24:15.443088+0000","last_active":"2024-09-13T17:24:19.491024+0000","last_peered":"2024-09-13T17:24:19.491024+0000","last_clean":"2024-09-13T17:24:19.491024+0000","last_became_active":"2024-09-13T17:24:15.442849+0000","last_became_peered":"2024-09-13T17:24:15.442849+0000","last_unstale":"2024-09-13T17:24:19.491024+0000","last_undegraded":"2024-09-13T17:24:19.491024+0000","last_fullsized":"2024-09-13T17:24:19.491024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:44.776950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:24:19.814892+0000","last_change":"2024-09-13T17:24:15.462869+0000","last_active":"2024-09-13T17:24:19.814892+0000","last_peered":"2024-09-13T17:24:19.814892+0000","last_clean":"2024-09-13T17:24:19.814892+0000","last_became_active":"2024-09-13T17:24:15.462623+0000","last_became_peered":"2024-09-13T17:24:15.462623+0000","last_unstale":"2024-09-13T17:24:19.814892+0000","last_undegraded":"2024-09-13T17:24:19.814892+0000","last_fullsized":"2024-09-13T17:24:19.814892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:14.950105+0000","last_clean_scrub_stamp":"2024-09-13T17:24:14.950105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:08.157166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0459999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:24:45.734 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:24:45.735 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:24:45.735 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T17:24:45.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 Processor -- start 2024-09-13T17:24:45.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 -- start start 2024-09-13T17:24:45.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f61881467c0 0x7f618815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61880b0f80 0x7f61880b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880b1920 con 0x7f61881609c0 2024-09-13T17:24:45.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618815ec80 con 0x7f61881467c0 2024-09-13T17:24:45.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f618e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618815e390 con 0x7f61880b0f80 2024-09-13T17:24:45.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6187400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f61881467c0 0x7f618815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6186a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61880b0f80 0x7f61880b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6187e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f61881609c0 0x7f6188160e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:38892/0 (socket says 172.21.15.139:38892) 2024-09-13T17:24:45.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6187e00700 1 -- 172.21.15.139:0/3411788204 learned_addr learned my addr 172.21.15.139:0/3411788204 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:45.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6186a00700 1 -- 172.21.15.139:0/3411788204 >> v2:172.21.15.176:3300/0 conn(0x7f61881467c0 msgr2=0x7f618815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:45.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6186a00700 1 --2- 172.21.15.139:0/3411788204 >> v2:172.21.15.176:3300/0 conn(0x7f61881467c0 0x7f618815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6186a00700 1 -- 172.21.15.139:0/3411788204 >> v1:172.21.15.176:6789/0 conn(0x7f61881609c0 legacy=0x7f6188160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6186a00700 1 -- 172.21.15.139:0/3411788204 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880cf900 con 0x7f61880b0f80 2024-09-13T17:24:45.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.935+0000 7f6186000700 1 -- 172.21.15.139:0/3411788204 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367867348 0 0) 0x7f61880b1920 con 0x7f61881609c0 2024-09-13T17:24:45.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f6186a00700 1 --2- 172.21.15.139:0/3411788204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61880b0f80 0x7f61880b13e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6174009850 tx=0x7f6174009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733d4653aab4cd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f6186000700 1 -- 172.21.15.139:0/3411788204 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011830 con 0x7f61880b0f80 2024-09-13T17:24:45.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f6186000700 1 -- 172.21.15.139:0/3411788204 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174011990 con 0x7f61880b0f80 2024-09-13T17:24:45.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f6186000700 1 -- 172.21.15.139:0/3411788204 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011d40 con 0x7f61880b0f80 2024-09-13T17:24:45.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 -- 172.21.15.139:0/3411788204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61880b0f80 msgr2=0x7f61880b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 --2- 172.21.15.139:0/3411788204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61880b0f80 0x7f61880b13e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6174009850 tx=0x7f6174009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:45.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 -- 172.21.15.139:0/3411788204 shutdown_connections 2024-09-13T17:24:45.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 --2- 172.21.15.139:0/3411788204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61880b0f80 0x7f61880b13e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 --2- 172.21.15.139:0/3411788204 >> v2:172.21.15.176:3300/0 conn(0x7f61881467c0 0x7f618815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 -- 172.21.15.139:0/3411788204 >> 172.21.15.139:0/3411788204 conn(0x7f61880afb90 msgr2=0x7f61880b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:45.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 -- 172.21.15.139:0/3411788204 shutdown_connections 2024-09-13T17:24:45.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.939+0000 7f618e600700 1 -- 172.21.15.139:0/3411788204 wait complete. 2024-09-13T17:24:45.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.943+0000 7f618e600700 1 Processor -- start 2024-09-13T17:24:45.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.943+0000 7f618e600700 1 -- start start 2024-09-13T17:24:45.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.943+0000 7f618e600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 0x7f61880a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61881467c0 0x7f61880aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61881609c0 0x7f618813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618814c790 con 0x7f61880b0f80 2024-09-13T17:24:45.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61880ce690 con 0x7f61881609c0 2024-09-13T17:24:45.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618814c3f0 con 0x7f61881467c0 2024-09-13T17:24:45.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 0x7f61880a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 0x7f61880a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36432/0 (socket says 172.21.15.139:36432) 2024-09-13T17:24:45.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 -- 172.21.15.139:0/1740651297 learned_addr learned my addr 172.21.15.139:0/1740651297 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:45.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187e00700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61881609c0 0x7f618813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6186a00700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61881467c0 0x7f61880aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 -- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61881467c0 msgr2=0x7f61880aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61881467c0 0x7f61880aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 -- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61881609c0 msgr2=0x7f618813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:45.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61881609c0 0x7f618813d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:45.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 -- 172.21.15.139:0/1740651297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740094b0 con 0x7f61880b0f80 2024-09-13T17:24:45.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6186a00700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61881467c0 0x7f61880aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:45.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187e00700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61881609c0 0x7f618813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:45.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f6187400700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 0x7f61880a9e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f617800e9d0 tx=0x7f617800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178009720 con 0x7f61880b0f80 2024-09-13T17:24:45.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800c850 con 0x7f61880b0f80 2024-09-13T17:24:45.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800cbc0 con 0x7f61880b0f80 2024-09-13T17:24:45.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618813e090 con 0x7f61880b0f80 2024-09-13T17:24:45.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618813e650 con 0x7f61880b0f80 2024-09-13T17:24:45.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f617800cd20 con 0x7f61880b0f80 2024-09-13T17:24:45.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.947+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6188146ba0 con 0x7f61880b0f80 2024-09-13T17:24:45.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.951+0000 7f617f400700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6168066730 0x7f6168068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:45.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.951+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6178084590 con 0x7f61880b0f80 2024-09-13T17:24:45.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.951+0000 7f6186a00700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6168066730 0x7f6168068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:45.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.951+0000 7f6186a00700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6168066730 0x7f6168068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6174009850 tx=0x7f6174008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:45.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:45.959+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6178051600 con 0x7f61880b0f80 2024-09-13T17:24:46.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.175+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f61880a9a30 con 0x7f61880b0f80 2024-09-13T17:24:46.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.175+0000 7f617f400700 1 -- 172.21.15.139:0/1740651297 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6178054c20 con 0x7f61880b0f80 2024-09-13T17:24:46.179 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:46.179 INFO:teuthology.orchestra.run.smithi139.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:24:46.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6168066730 msgr2=0x7f6168068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6168066730 0x7f6168068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6174009850 tx=0x7f6174008030 comp rx=0 tx=0).stop 2024-09-13T17:24:46.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 msgr2=0x7f61880a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 0x7f61880a9e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f617800e9d0 tx=0x7f617800ed90 comp rx=0 tx=0).stop 2024-09-13T17:24:46.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 shutdown_connections 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6168066730 0x7f6168068bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61881609c0 0x7f618813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61881467c0 0x7f61880aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 --2- 172.21.15.139:0/1740651297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61880b0f80 0x7f61880a9e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 >> 172.21.15.139:0/1740651297 conn(0x7f61880afb90 msgr2=0x7f61880b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 shutdown_connections 2024-09-13T17:24:46.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.179+0000 7f618e600700 1 -- 172.21.15.139:0/1740651297 wait complete. 2024-09-13T17:24:46.206 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:24:46.206 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:46.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.371+0000 7f22a1400700 1 Processor -- start 2024-09-13T17:24:46.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.371+0000 7f22a1400700 1 -- start start 2024-09-13T17:24:46.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f22a1400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f22a1400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c0cd890 con 0x7f229c0b3280 2024-09-13T17:24:46.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f22a1400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c14aab0 con 0x7f229c0cd450 2024-09-13T17:24:46.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f22a1400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0cc3b0 con 0x7f229c14a6d0 2024-09-13T17:24:46.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f22a0a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f229c0b3280 0x7f229c161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51376/0 (socket says 172.21.15.139:51376) 2024-09-13T17:24:46.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f22a0a00700 1 -- 172.21.15.139:0/3565556000 learned_addr learned my addr 172.21.15.139:0/3565556000 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:46.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229be00700 1 --2- 172.21.15.139:0/3565556000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616012627 0 0) 0x7f229c0cd890 con 0x7f229c0b3280 2024-09-13T17:24:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22800035d0 con 0x7f229c0b3280 2024-09-13T17:24:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616147667 0 0) 0x7f229c14aab0 con 0x7f229c0cd450 2024-09-13T17:24:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f229c0cd890 con 0x7f229c0cd450 2024-09-13T17:24:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229be00700 1 -- 172.21.15.139:0/3565556000 >> v1:172.21.15.176:6789/0 conn(0x7f229c0cd450 legacy=0x7f229c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229be00700 1 -- 172.21.15.139:0/3565556000 >> v1:172.21.15.139:6789/0 conn(0x7f229c0b3280 legacy=0x7f229c161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229be00700 1 -- 172.21.15.139:0/3565556000 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0cc690 con 0x7f229c14a6d0 2024-09-13T17:24:46.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.375+0000 7f229be00700 1 --2- 172.21.15.139:0/3565556000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c0cbd40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f228c009880 tx=0x7f228c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ad95e299e185f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:46.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c011830 con 0x7f229c14a6d0 2024-09-13T17:24:46.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c011990 con 0x7f229c14a6d0 2024-09-13T17:24:46.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f229b400700 1 -- 172.21.15.139:0/3565556000 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c011d20 con 0x7f229c14a6d0 2024-09-13T17:24:46.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 -- 172.21.15.139:0/3565556000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 msgr2=0x7f229c0cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 --2- 172.21.15.139:0/3565556000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c0cbd40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f228c009880 tx=0x7f228c009b90 comp rx=0 tx=0).stop 2024-09-13T17:24:46.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 -- 172.21.15.139:0/3565556000 shutdown_connections 2024-09-13T17:24:46.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 --2- 172.21.15.139:0/3565556000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c0cbd40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 -- 172.21.15.139:0/3565556000 >> 172.21.15.139:0/3565556000 conn(0x7f229c0ce9d0 msgr2=0x7f229c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:46.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 -- 172.21.15.139:0/3565556000 shutdown_connections 2024-09-13T17:24:46.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.379+0000 7f22a1400700 1 -- 172.21.15.139:0/3565556000 wait complete. 2024-09-13T17:24:46.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 Processor -- start 2024-09-13T17:24:46.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 -- start start 2024-09-13T17:24:46.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 0x7f229c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229c0cd450 0x7f229c1f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c06aa90 con 0x7f229c0b3280 2024-09-13T17:24:46.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c144c00 con 0x7f229c0cd450 2024-09-13T17:24:46.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a1400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c140c70 con 0x7f229c14a6d0 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 0x7f229c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 0x7f229c1445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36440/0 (socket says 172.21.15.139:36440) 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 -- 172.21.15.139:0/203471379 learned_addr learned my addr 172.21.15.139:0/203471379 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f2293e00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229c0cd450 0x7f229c1f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f22a0a00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 -- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 msgr2=0x7f229c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 -- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229c0cd450 msgr2=0x7f229c1f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229c0cd450 0x7f229c1f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.383+0000 7f229be00700 1 -- 172.21.15.139:0/203471379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0094b0 con 0x7f229c0b3280 2024-09-13T17:24:46.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f229be00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 0x7f229c1445c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f228c013040 tx=0x7f228c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:46.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c01a8c0 con 0x7f229c0b3280 2024-09-13T17:24:46.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c01e070 con 0x7f229c0b3280 2024-09-13T17:24:46.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c13feb0 con 0x7f229c0b3280 2024-09-13T17:24:46.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c01ac80 con 0x7f229c0b3280 2024-09-13T17:24:46.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c140470 con 0x7f229c0b3280 2024-09-13T17:24:46.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.387+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c071e90 con 0x7f229c0b3280 2024-09-13T17:24:46.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.391+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f228c02d450 con 0x7f229c0b3280 2024-09-13T17:24:46.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.391+0000 7f2298c00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2278066730 0x7f2278068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.391+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f228c0852f0 con 0x7f229c0b3280 2024-09-13T17:24:46.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.391+0000 7f2293e00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2278066730 0x7f2278068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.391+0000 7f2293e00700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2278066730 0x7f2278068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f229c1413e0 tx=0x7f2284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:46.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.395+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f228c0522e0 con 0x7f229c0b3280 2024-09-13T17:24:46.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.587+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f229c148ac0 con 0x7f229c0b3280 2024-09-13T17:24:46.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f2298c00700 1 -- 172.21.15.139:0/203471379 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f228c055900 con 0x7f229c0b3280 2024-09-13T17:24:46.594 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:46.594 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:46.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2278066730 msgr2=0x7f2278068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2278066730 0x7f2278068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f229c1413e0 tx=0x7f2284009040 comp rx=0 tx=0).stop 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 msgr2=0x7f229c1445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 0x7f229c1445c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f228c013040 tx=0x7f228c004770 comp rx=0 tx=0).stop 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 shutdown_connections 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2278066730 0x7f2278068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f229c14a6d0 0x7f229c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f229c0cd450 0x7f229c1f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 --2- 172.21.15.139:0/203471379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f229c0b3280 0x7f229c1445c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 >> 172.21.15.139:0/203471379 conn(0x7f229c0ce9d0 msgr2=0x7f229c1478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 shutdown_connections 2024-09-13T17:24:46.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.591+0000 7f22a1400700 1 -- 172.21.15.139:0/203471379 wait complete. 2024-09-13T17:24:46.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:46.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 Processor -- start 2024-09-13T17:24:46.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 -- start start 2024-09-13T17:24:46.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42b0144770 0x7f42b00ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b006d9b0 0x7f42b015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b015c160 con 0x7f42b015b1c0 2024-09-13T17:24:46.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b015c540 con 0x7f42b0144770 2024-09-13T17:24:46.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.795+0000 7f42b5600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0144b50 con 0x7f42b006d9b0 2024-09-13T17:24:46.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42ae000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f42b015b1c0 0x7f42b006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51380/0 (socket says 172.21.15.139:51380) 2024-09-13T17:24:46.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42ae000700 1 -- 172.21.15.139:0/2051342788 learned_addr learned my addr 172.21.15.139:0/2051342788 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:46.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42af400700 1 --2- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b006d9b0 0x7f42b015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42aea00700 1 --2- 172.21.15.139:0/2051342788 >> v2:172.21.15.176:3300/0 conn(0x7f42b0144770 0x7f42b00ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42aea00700 1 -- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b006d9b0 msgr2=0x7f42b015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:46.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42aea00700 1 --2- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b006d9b0 0x7f42b015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42aea00700 1 -- 172.21.15.139:0/2051342788 >> v1:172.21.15.139:6789/0 conn(0x7f42b015b1c0 legacy=0x7f42b006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42aea00700 1 -- 172.21.15.139:0/2051342788 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b015b620 con 0x7f42b0144770 2024-09-13T17:24:46.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42ad600700 1 -- 172.21.15.139:0/2051342788 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347098159 0 0) 0x7f42b015c160 con 0x7f42b015b1c0 2024-09-13T17:24:46.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42aea00700 1 --2- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b00ce5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009d90 tx=0x7f42a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113aa9637fa33496 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:46.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42ad600700 1 -- 172.21.15.139:0/2051342788 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a000e070 con 0x7f42b0144770 2024-09-13T17:24:46.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42ad600700 1 -- 172.21.15.139:0/2051342788 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a000bb20 con 0x7f42b0144770 2024-09-13T17:24:46.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42ad600700 1 -- 172.21.15.139:0/2051342788 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0012430 con 0x7f42b0144770 2024-09-13T17:24:46.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 -- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 msgr2=0x7f42b00ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 --2- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b00ce5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009d90 tx=0x7f42a000b330 comp rx=0 tx=0).stop 2024-09-13T17:24:46.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 -- 172.21.15.139:0/2051342788 shutdown_connections 2024-09-13T17:24:46.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 --2- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b006d9b0 0x7f42b015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 --2- 172.21.15.139:0/2051342788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b00ce5f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 -- 172.21.15.139:0/2051342788 >> 172.21.15.139:0/2051342788 conn(0x7f42b006b1e0 msgr2=0x7f42b006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:46.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.799+0000 7f42b5600700 1 -- 172.21.15.139:0/2051342788 shutdown_connections 2024-09-13T17:24:46.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.803+0000 7f42b5600700 1 -- 172.21.15.139:0/2051342788 wait complete. 2024-09-13T17:24:46.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.803+0000 7f42b5600700 1 Processor -- start 2024-09-13T17:24:46.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.803+0000 7f42b5600700 1 -- start start 2024-09-13T17:24:46.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 0x7f42b015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b01f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b015b1c0 0x7f42b01f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00abd90 con 0x7f42b006d9b0 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00ac710 con 0x7f42b0144770 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00a9770 con 0x7f42b015b1c0 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 0x7f42b015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 0x7f42b015a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36452/0 (socket says 172.21.15.139:36452) 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 -- 172.21.15.139:0/1606290057 learned_addr learned my addr 172.21.15.139:0/1606290057 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42af400700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b015b1c0 0x7f42b01f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42ae000700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b01f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 -- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b015b1c0 msgr2=0x7f42b01f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b015b1c0 0x7f42b01f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 -- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 msgr2=0x7f42b01f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b01f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 -- 172.21.15.139:0/1606290057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a0009a70 con 0x7f42b006d9b0 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42aea00700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 0x7f42b015a740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f42b006fd20 tx=0x7f42a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0012430 con 0x7f42b006d9b0 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0020070 con 0x7f42b006d9b0 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0012ea0 con 0x7f42b006d9b0 2024-09-13T17:24:46.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b00a91b0 con 0x7f42b006d9b0 2024-09-13T17:24:46.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.807+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b00ac9b0 con 0x7f42b006d9b0 2024-09-13T17:24:46.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.811+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b00ac570 con 0x7f42b006d9b0 2024-09-13T17:24:46.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.811+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42a0004280 con 0x7f42b006d9b0 2024-09-13T17:24:46.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.815+0000 7f42a6a00700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4290066730 0x7f4290068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:46.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.815+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42a0022070 con 0x7f42b006d9b0 2024-09-13T17:24:46.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.815+0000 7f42ae000700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4290066730 0x7f4290068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:46.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.815+0000 7f42ae000700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4290066730 0x7f4290068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ae340 tx=0x7f429c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:46.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:46.819+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42b00ac570 con 0x7f42b006d9b0 2024-09-13T17:24:47.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.007+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42b00ac570 con 0x7f42b006d9b0 2024-09-13T17:24:47.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.007+0000 7f42a6a00700 1 -- 172.21.15.139:0/1606290057 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42b00ac570 con 0x7f42b006d9b0 2024-09-13T17:24:47.012 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4290066730 msgr2=0x7f4290068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4290066730 0x7f4290068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ae340 tx=0x7f429c007e00 comp rx=0 tx=0).stop 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 msgr2=0x7f42b015a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 0x7f42b015a740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f42b006fd20 tx=0x7f42a0004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 shutdown_connections 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4290066730 0x7f4290068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b015b1c0 0x7f42b01f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0144770 0x7f42b01f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 --2- 172.21.15.139:0/1606290057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b006d9b0 0x7f42b015a740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.011+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 >> 172.21.15.139:0/1606290057 conn(0x7f42b006b1e0 msgr2=0x7f42b006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.015+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 shutdown_connections 2024-09-13T17:24:47.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.015+0000 7f42b5600700 1 -- 172.21.15.139:0/1606290057 wait complete. 2024-09-13T17:24:47.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:47.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.223+0000 7fb086000700 1 Processor -- start 2024-09-13T17:24:47.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.223+0000 7fb086000700 1 -- start start 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb086000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb08006d9b0 0x7fb0800706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb086000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb080162550 0x7fb080070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb086000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800cb580 con 0x7fb0800702c0 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb086000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb080071e30 con 0x7fb080162550 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb086000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800712b0 con 0x7fb08006d9b0 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb080162550 0x7fb080070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb080162550 0x7fb080070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36456/0 (socket says 172.21.15.139:36456) 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 -- 172.21.15.139:0/4080388881 learned_addr learned my addr 172.21.15.139:0/4080388881 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:47.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07ea00700 1 --2- 172.21.15.139:0/4080388881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb08006d9b0 0x7fb0800706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 -- 172.21.15.139:0/4080388881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb08006d9b0 msgr2=0x7fb0800706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 --2- 172.21.15.139:0/4080388881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb08006d9b0 0x7fb0800706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 -- 172.21.15.139:0/4080388881 >> v1:172.21.15.176:6789/0 conn(0x7fb0800702c0 legacy=0x7fb08006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 -- 172.21.15.139:0/4080388881 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080071590 con 0x7fb080162550 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07fe00700 1 --2- 172.21.15.139:0/4080388881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080070be0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb078009e50 tx=0x7fb07800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830d22289a48eb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07e000700 1 -- 172.21.15.139:0/4080388881 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800e070 con 0x7fb080162550 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07e000700 1 -- 172.21.15.139:0/4080388881 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800b910 con 0x7fb080162550 2024-09-13T17:24:47.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.227+0000 7fb07e000700 1 -- 172.21.15.139:0/4080388881 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800bcc0 con 0x7fb080162550 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 -- 172.21.15.139:0/4080388881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 msgr2=0x7fb080070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 --2- 172.21.15.139:0/4080388881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080070be0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb078009e50 tx=0x7fb07800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 -- 172.21.15.139:0/4080388881 shutdown_connections 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 --2- 172.21.15.139:0/4080388881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080070be0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 --2- 172.21.15.139:0/4080388881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb08006d9b0 0x7fb0800706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 -- 172.21.15.139:0/4080388881 >> 172.21.15.139:0/4080388881 conn(0x7fb08006b1e0 msgr2=0x7fb08006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 -- 172.21.15.139:0/4080388881 shutdown_connections 2024-09-13T17:24:47.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 -- 172.21.15.139:0/4080388881 wait complete. 2024-09-13T17:24:47.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 Processor -- start 2024-09-13T17:24:47.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.231+0000 7fb086000700 1 -- start start 2024-09-13T17:24:47.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb08006d9b0 0x7fb0800b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0800702c0 0x7fb080143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801f7690 con 0x7fb080162550 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801f6a80 con 0x7fb08006d9b0 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801f6d60 con 0x7fb0800702c0 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080163ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36458/0 (socket says 172.21.15.139:36458) 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 -- 172.21.15.139:0/2285338175 learned_addr learned my addr 172.21.15.139:0/2285338175 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07f400700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb08006d9b0 0x7fb0800b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07ea00700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0800702c0 0x7fb080143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 -- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0800702c0 msgr2=0x7fb080143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0800702c0 0x7fb080143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 -- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb08006d9b0 msgr2=0x7fb0800b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb08006d9b0 0x7fb0800b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 -- 172.21.15.139:0/2285338175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078009b30 con 0x7fb080162550 2024-09-13T17:24:47.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07f400700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb08006d9b0 0x7fb0800b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb07fe00700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080163ab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb080067d20 tx=0x7fb078004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078004960 con 0x7fb080162550 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780099b0 con 0x7fb080162550 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07801b670 con 0x7fb080162550 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0801f7040 con 0x7fb080162550 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800b3730 con 0x7fb080162550 2024-09-13T17:24:47.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.235+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0801f7840 con 0x7fb080162550 2024-09-13T17:24:47.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.239+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb07801b7d0 con 0x7fb080162550 2024-09-13T17:24:47.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.239+0000 7fb077400700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb060066730 0x7fb060068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.239+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb078085e20 con 0x7fb080162550 2024-09-13T17:24:47.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.239+0000 7fb07f400700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb060066730 0x7fb060068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.243+0000 7fb07f400700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb060066730 0x7fb060068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb070000f60 tx=0x7fb070009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.247+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0801f7840 con 0x7fb080162550 2024-09-13T17:24:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.427+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0801f77d0 con 0x7fb080162550 2024-09-13T17:24:47.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.427+0000 7fb077400700 1 -- 172.21.15.139:0/2285338175 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb078052e90 con 0x7fb080162550 2024-09-13T17:24:47.430 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:47.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.427+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb060066730 msgr2=0x7fb060068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.427+0000 7fb086000700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb060066730 0x7fb060068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb070000f60 tx=0x7fb070009040 comp rx=0 tx=0).stop 2024-09-13T17:24:47.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.427+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 msgr2=0x7fb080163ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.427+0000 7fb086000700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080163ab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb080067d20 tx=0x7fb078004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 shutdown_connections 2024-09-13T17:24:47.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb060066730 0x7fb060068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb080162550 0x7fb080163ab0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0800702c0 0x7fb080143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 --2- 172.21.15.139:0/2285338175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb08006d9b0 0x7fb0800b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 >> 172.21.15.139:0/2285338175 conn(0x7fb08006b1e0 msgr2=0x7fb0800ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 shutdown_connections 2024-09-13T17:24:47.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.431+0000 7fb086000700 1 -- 172.21.15.139:0/2285338175 wait complete. 2024-09-13T17:24:47.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:47.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.623+0000 7f5276200700 1 Processor -- start 2024-09-13T17:24:47.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.623+0000 7f5276200700 1 -- start start 2024-09-13T17:24:47.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5276200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f527006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5276200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5270071c80 0x7f527006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5276200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5270071560 con 0x7f527015cc10 2024-09-13T17:24:47.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5276200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527015cff0 con 0x7f5270071c80 2024-09-13T17:24:47.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5276200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5270070950 con 0x7f52700b4310 2024-09-13T17:24:47.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5274e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f527015cc10 0x7f52700b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51390/0 (socket says 172.21.15.139:51390) 2024-09-13T17:24:47.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5274e00700 1 -- 172.21.15.139:0/2229538228 learned_addr learned my addr 172.21.15.139:0/2229538228 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526fe00700 1 --2- 172.21.15.139:0/2229538228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f527006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f5275800700 1 --2- 172.21.15.139:0/2229538228 >> v2:172.21.15.176:3300/0 conn(0x7f5270071c80 0x7f527006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526f400700 1 -- 172.21.15.139:0/2229538228 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219783049 0 0) 0x7f5270071560 con 0x7f527015cc10 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526f400700 1 -- 172.21.15.139:0/2229538228 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52580035d0 con 0x7f527015cc10 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526fe00700 1 -- 172.21.15.139:0/2229538228 >> v2:172.21.15.176:3300/0 conn(0x7f5270071c80 msgr2=0x7f527006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526fe00700 1 --2- 172.21.15.139:0/2229538228 >> v2:172.21.15.176:3300/0 conn(0x7f5270071c80 0x7f527006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526fe00700 1 -- 172.21.15.139:0/2229538228 >> v1:172.21.15.139:6789/0 conn(0x7f527015cc10 legacy=0x7f52700b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526fe00700 1 -- 172.21.15.139:0/2229538228 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270070c30 con 0x7f52700b4310 2024-09-13T17:24:47.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.627+0000 7f526fe00700 1 --2- 172.21.15.139:0/2229538228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f527006bc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f525c009850 tx=0x7f525c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668b79bc039e15c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f526f400700 1 -- 172.21.15.139:0/2229538228 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c011830 con 0x7f52700b4310 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f526f400700 1 -- 172.21.15.139:0/2229538228 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c011990 con 0x7f52700b4310 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f526f400700 1 -- 172.21.15.139:0/2229538228 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c011d40 con 0x7f52700b4310 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 -- 172.21.15.139:0/2229538228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 msgr2=0x7f527006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 --2- 172.21.15.139:0/2229538228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f527006bc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f525c009850 tx=0x7f525c009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 -- 172.21.15.139:0/2229538228 shutdown_connections 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 --2- 172.21.15.139:0/2229538228 >> v2:172.21.15.176:3300/0 conn(0x7f5270071c80 0x7f527006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 --2- 172.21.15.139:0/2229538228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f527006bc20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 -- 172.21.15.139:0/2229538228 >> 172.21.15.139:0/2229538228 conn(0x7f527006ece0 msgr2=0x7f52700b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 -- 172.21.15.139:0/2229538228 shutdown_connections 2024-09-13T17:24:47.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 -- 172.21.15.139:0/2229538228 wait complete. 2024-09-13T17:24:47.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 Processor -- start 2024-09-13T17:24:47.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.631+0000 7f5276200700 1 -- start start 2024-09-13T17:24:47.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5270071c80 0x7f52701efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f5270154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 0x7f527015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701573a0 con 0x7f527015cc10 2024-09-13T17:24:47.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701f2ab0 con 0x7f5270071c80 2024-09-13T17:24:47.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52701f2d90 con 0x7f52700b4310 2024-09-13T17:24:47.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 0x7f527015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 0x7f527015f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36460/0 (socket says 172.21.15.139:36460) 2024-09-13T17:24:47.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 -- 172.21.15.139:0/1198360799 learned_addr learned my addr 172.21.15.139:0/1198360799 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:47.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5274e00700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5270071c80 0x7f52701efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f526fe00700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f5270154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 -- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 msgr2=0x7f5270154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f5270154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 -- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5270071c80 msgr2=0x7f52701efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5270071c80 0x7f52701efad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 -- 172.21.15.139:0/1198360799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0094b0 con 0x7f527015cc10 2024-09-13T17:24:47.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5275800700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 0x7f527015f8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f526800efc0 tx=0x7f526800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800cc90 con 0x7f527015cc10 2024-09-13T17:24:47.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526800f040 con 0x7f527015cc10 2024-09-13T17:24:47.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680146c0 con 0x7f527015cc10 2024-09-13T17:24:47.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52701f3070 con 0x7f527015cc10 2024-09-13T17:24:47.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.635+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52701f3630 con 0x7f527015cc10 2024-09-13T17:24:47.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.639+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700b3c00 con 0x7f527015cc10 2024-09-13T17:24:47.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.639+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5268014820 con 0x7f527015cc10 2024-09-13T17:24:47.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.643+0000 7f526cc00700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5250066730 0x7f5250068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.643+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5268085010 con 0x7f527015cc10 2024-09-13T17:24:47.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.643+0000 7f5274e00700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5250066730 0x7f5250068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.643+0000 7f5274e00700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5250066730 0x7f5250068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5264007fd0 tx=0x7f5264007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.647+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5268052090 con 0x7f527015cc10 2024-09-13T17:24:47.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.831+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52700b3770 con 0x7f527015cc10 2024-09-13T17:24:47.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.831+0000 7f526cc00700 1 -- 172.21.15.139:0/1198360799 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52680180a0 con 0x7f527015cc10 2024-09-13T17:24:47.836 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:24:47.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5250066730 msgr2=0x7f5250068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5250066730 0x7f5250068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5264007fd0 tx=0x7f5264007de0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 msgr2=0x7f527015f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 0x7f527015f8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f526800efc0 tx=0x7f526800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 shutdown_connections 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5250066730 0x7f5250068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f527015cc10 0x7f527015f8e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52700b4310 0x7f5270154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 --2- 172.21.15.139:0/1198360799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5270071c80 0x7f52701efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 >> 172.21.15.139:0/1198360799 conn(0x7f527006ece0 msgr2=0x7f5270157520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 shutdown_connections 2024-09-13T17:24:47.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:47.835+0000 7f5276200700 1 -- 172.21.15.139:0/1198360799 wait complete. 2024-09-13T17:24:47.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:48.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.023+0000 7fd70f200700 1 Processor -- start 2024-09-13T17:24:48.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.023+0000 7fd70f200700 1 -- start start 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70f200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd710071570 0x7fd71015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70f200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd71013f810 0x7fd71013fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70f200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71013f0c0 con 0x7fd710071190 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70f200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71015a720 con 0x7fd71013f810 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70f200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71015aa00 con 0x7fd710071570 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd71013f810 0x7fd71013fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd71013f810 0x7fd71013fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36470/0 (socket says 172.21.15.139:36470) 2024-09-13T17:24:48.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 -- 172.21.15.139:0/2340271576 learned_addr learned my addr 172.21.15.139:0/2340271576 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:48.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70d400700 1 --2- 172.21.15.139:0/2340271576 >> v2:172.21.15.176:3300/0 conn(0x7fd710071570 0x7fd71015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 -- 172.21.15.139:0/2340271576 >> v2:172.21.15.176:3300/0 conn(0x7fd710071570 msgr2=0x7fd71015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:48.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 --2- 172.21.15.139:0/2340271576 >> v2:172.21.15.176:3300/0 conn(0x7fd710071570 0x7fd71015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 -- 172.21.15.139:0/2340271576 >> v1:172.21.15.139:6789/0 conn(0x7fd710071190 legacy=0x7fd710159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.027+0000 7fd70e800700 1 -- 172.21.15.139:0/2340271576 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71015ace0 con 0x7fd71013f810 2024-09-13T17:24:48.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70e800700 1 --2- 172.21.15.139:0/2340271576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd71013f810 0x7fd71013fbf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd71006a420 tx=0x7fd70800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97beea770f2d1298 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70ca00700 1 -- 172.21.15.139:0/2340271576 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70800e070 con 0x7fd71013f810 2024-09-13T17:24:48.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70ca00700 1 -- 172.21.15.139:0/2340271576 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70800b9c0 con 0x7fd71013f810 2024-09-13T17:24:48.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70ca00700 1 -- 172.21.15.139:0/2340271576 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70800bd70 con 0x7fd71013f810 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 -- 172.21.15.139:0/2340271576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd71013f810 msgr2=0x7fd71013fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 --2- 172.21.15.139:0/2340271576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd71013f810 0x7fd71013fbf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd71006a420 tx=0x7fd70800b330 comp rx=0 tx=0).stop 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 -- 172.21.15.139:0/2340271576 shutdown_connections 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 --2- 172.21.15.139:0/2340271576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd71013f810 0x7fd71013fbf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 --2- 172.21.15.139:0/2340271576 >> v2:172.21.15.176:3300/0 conn(0x7fd710071570 0x7fd71015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 -- 172.21.15.139:0/2340271576 >> 172.21.15.139:0/2340271576 conn(0x7fd7100ce9d0 msgr2=0x7fd7100cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 -- 172.21.15.139:0/2340271576 shutdown_connections 2024-09-13T17:24:48.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.031+0000 7fd70f200700 1 -- 172.21.15.139:0/2340271576 wait complete. 2024-09-13T17:24:48.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 Processor -- start 2024-09-13T17:24:48.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 -- start start 2024-09-13T17:24:48.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd710071190 0x7fd710159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 0x7fd71014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd71013f810 0x7fd710156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101546b0 con 0x7fd710071570 2024-09-13T17:24:48.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71013c730 con 0x7fd71013f810 2024-09-13T17:24:48.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70f200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd710159590 con 0x7fd710071190 2024-09-13T17:24:48.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 0x7fd71014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 0x7fd71014faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36480/0 (socket says 172.21.15.139:36480) 2024-09-13T17:24:48.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 -- 172.21.15.139:0/78386100 learned_addr learned my addr 172.21.15.139:0/78386100 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:48.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70de00700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd710071190 0x7fd710159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70e800700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd71013f810 0x7fd710156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 -- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd710071190 msgr2=0x7fd710159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd710071190 0x7fd710159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 -- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd71013f810 msgr2=0x7fd710156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd71013f810 0x7fd710156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 -- 172.21.15.139:0/78386100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708009b30 con 0x7fd710071570 2024-09-13T17:24:48.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70de00700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd710071190 0x7fd710159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:48.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.035+0000 7fd70d400700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 0x7fd71014faf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00e760 tx=0x7fd6fc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc013610 con 0x7fd710071570 2024-09-13T17:24:48.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc013770 con 0x7fd710071570 2024-09-13T17:24:48.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd710152ff0 con 0x7fd710071570 2024-09-13T17:24:48.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc013ae0 con 0x7fd710071570 2024-09-13T17:24:48.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7101535b0 con 0x7fd710071570 2024-09-13T17:24:48.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71013d6f0 con 0x7fd710071570 2024-09-13T17:24:48.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.039+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6fc013c40 con 0x7fd710071570 2024-09-13T17:24:48.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.043+0000 7fd706000700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd6f0066730 0x7fd6f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.043+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6fc0840c0 con 0x7fd710071570 2024-09-13T17:24:48.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.043+0000 7fd70de00700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd6f0066730 0x7fd6f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.043+0000 7fd70de00700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd6f0066730 0x7fd6f0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd700000f60 tx=0x7fd700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.047+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6fc051130 con 0x7fd710071570 2024-09-13T17:24:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.227+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd71015caa0 con 0x7fd710071570 2024-09-13T17:24:48.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.227+0000 7fd706000700 1 -- 172.21.15.139:0/78386100 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd6fc054750 con 0x7fd710071570 2024-09-13T17:24:48.232 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd6f0066730 msgr2=0x7fd6f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd6f0066730 0x7fd6f0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd700000f60 tx=0x7fd700009040 comp rx=0 tx=0).stop 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 msgr2=0x7fd71014faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 0x7fd71014faf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00e760 tx=0x7fd6fc00ea70 comp rx=0 tx=0).stop 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 shutdown_connections 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd6f0066730 0x7fd6f0068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd71013f810 0x7fd710156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd710071570 0x7fd71014faf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 --2- 172.21.15.139:0/78386100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd710071190 0x7fd710159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 >> 172.21.15.139:0/78386100 conn(0x7fd7100ce9d0 msgr2=0x7fd7100cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 shutdown_connections 2024-09-13T17:24:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.231+0000 7fd70f200700 1 -- 172.21.15.139:0/78386100 wait complete. 2024-09-13T17:24:48.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.427+0000 7f009ce00700 1 Processor -- start 2024-09-13T17:24:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.427+0000 7f009ce00700 1 -- start start 2024-09-13T17:24:48.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.427+0000 7f009ce00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f009815f5c0 0x7f0098143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980b6370 con 0x7f009815ef90 2024-09-13T17:24:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980b6650 con 0x7f009815ebb0 2024-09-13T17:24:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980b6930 con 0x7f009815f5c0 2024-09-13T17:24:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0097e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f009815ef90 0x7f00980b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51414/0 (socket says 172.21.15.139:51414) 2024-09-13T17:24:48.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0097e00700 1 -- 172.21.15.139:0/4078762210 learned_addr learned my addr 172.21.15.139:0/4078762210 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:48.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096a00700 1 --2- 172.21.15.139:0/4078762210 >> v2:172.21.15.139:3300/0 conn(0x7f009815f5c0 0x7f0098143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998448556 0 0) 0x7f00980b6370 con 0x7f009815ef90 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f007c0035d0 con 0x7f009815ef90 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001221962 0 0) 0x7f00980b6650 con 0x7f009815ebb0 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00980b6370 con 0x7f009815ebb0 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096a00700 1 -- 172.21.15.139:0/4078762210 >> v1:172.21.15.176:6789/0 conn(0x7f009815ebb0 legacy=0x7f00981434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096a00700 1 -- 172.21.15.139:0/4078762210 >> v1:172.21.15.139:6789/0 conn(0x7f009815ef90 legacy=0x7f00980b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096a00700 1 -- 172.21.15.139:0/4078762210 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980b6c10 con 0x7f009815f5c0 2024-09-13T17:24:48.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096a00700 1 --2- 172.21.15.139:0/4078762210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815f5c0 0x7f0098143be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0084009850 tx=0x7f0084009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe573e21aa2e2d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084011830 con 0x7f009815f5c0 2024-09-13T17:24:48.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084011990 con 0x7f009815f5c0 2024-09-13T17:24:48.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f0096000700 1 -- 172.21.15.139:0/4078762210 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084011d00 con 0x7f009815f5c0 2024-09-13T17:24:48.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- 172.21.15.139:0/4078762210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815f5c0 msgr2=0x7f0098143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 --2- 172.21.15.139:0/4078762210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815f5c0 0x7f0098143be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0084009850 tx=0x7f0084009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:48.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- 172.21.15.139:0/4078762210 shutdown_connections 2024-09-13T17:24:48.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 --2- 172.21.15.139:0/4078762210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815f5c0 0x7f0098143be0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- 172.21.15.139:0/4078762210 >> 172.21.15.139:0/4078762210 conn(0x7f0098071fa0 msgr2=0x7f0098072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- 172.21.15.139:0/4078762210 shutdown_connections 2024-09-13T17:24:48.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.431+0000 7f009ce00700 1 -- 172.21.15.139:0/4078762210 wait complete. 2024-09-13T17:24:48.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 Processor -- start 2024-09-13T17:24:48.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 -- start start 2024-09-13T17:24:48.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 0x7f0098139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f009815ef90 0x7f009815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f009815f5c0 0x7f00980cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009806d920 con 0x7f009815ebb0 2024-09-13T17:24:48.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009806d3f0 con 0x7f009815ef90 2024-09-13T17:24:48.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.435+0000 7f009ce00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009806d640 con 0x7f009815f5c0 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 0x7f0098139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 0x7f0098139170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36502/0 (socket says 172.21.15.139:36502) 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 -- 172.21.15.139:0/1143142553 learned_addr learned my addr 172.21.15.139:0/1143142553 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0096a00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f009815ef90 0x7f009815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097e00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f009815f5c0 0x7f00980cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 -- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f009815f5c0 msgr2=0x7f00980cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f009815f5c0 0x7f00980cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 -- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f009815ef90 msgr2=0x7f009815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f009815ef90 0x7f009815b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 -- 172.21.15.139:0/1143142553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840094b0 con 0x7f009815ebb0 2024-09-13T17:24:48.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f0097400700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 0x7f0098139170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f008800c520 tx=0x7f008800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880052d0 con 0x7f009815ebb0 2024-09-13T17:24:48.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0088005450 con 0x7f009815ebb0 2024-09-13T17:24:48.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880038e0 con 0x7f009815ebb0 2024-09-13T17:24:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009815d920 con 0x7f009815ebb0 2024-09-13T17:24:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0098139770 con 0x7f009815ebb0 2024-09-13T17:24:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.439+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00980677e0 con 0x7f009815ebb0 2024-09-13T17:24:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.443+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0088003a40 con 0x7f009815ebb0 2024-09-13T17:24:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.443+0000 7f008f400700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0078066760 0x7f0078068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.443+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0088083770 con 0x7f009815ebb0 2024-09-13T17:24:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.443+0000 7f0096a00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0078066760 0x7f0078068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.443+0000 7f0096a00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0078066760 0x7f0078068c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00840090b0 tx=0x7f0084008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.451+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0088050880 con 0x7f009815ebb0 2024-09-13T17:24:48.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.675+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f009815d780 con 0x7f009815ebb0 2024-09-13T17:24:48.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f008f400700 1 -- 172.21.15.139:0/1143142553 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f009815d780 con 0x7f009815ebb0 2024-09-13T17:24:48.682 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:48.682 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0078066760 msgr2=0x7f0078068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0078066760 0x7f0078068c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00840090b0 tx=0x7f0084008030 comp rx=0 tx=0).stop 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 msgr2=0x7f0098139170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 0x7f0098139170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f008800c520 tx=0x7f008800c830 comp rx=0 tx=0).stop 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 shutdown_connections 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0078066760 0x7f0078068c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f009815f5c0 0x7f00980cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f009815ef90 0x7f009815b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 --2- 172.21.15.139:0/1143142553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f009815ebb0 0x7f0098139170 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 >> 172.21.15.139:0/1143142553 conn(0x7f0098071fa0 msgr2=0x7f00980b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.679+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 shutdown_connections 2024-09-13T17:24:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.683+0000 7f009ce00700 1 -- 172.21.15.139:0/1143142553 wait complete. 2024-09-13T17:24:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:24:48.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:48.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 Processor -- start 2024-09-13T17:24:48.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 -- start start 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c880ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c8815b1c0 0x7f2c8806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2c8806d7e0 0x7f2c8815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8806dc90 con 0x7f2c8815b1c0 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8815c160 con 0x7f2c8806d7e0 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c8f600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8815c540 con 0x7f2c88144770 2024-09-13T17:24:48.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c87e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c8815b1c0 0x7f2c8806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c87e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c8815b1c0 0x7f2c8806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36516/0 (socket says 172.21.15.139:36516) 2024-09-13T17:24:48.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.879+0000 7f2c87e00700 1 -- 172.21.15.139:0/1594065598 learned_addr learned my addr 172.21.15.139:0/1594065598 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:48.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8cc00700 1 --2- 172.21.15.139:0/1594065598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c880ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8d600700 1 --2- 172.21.15.139:0/1594065598 >> v2:172.21.15.176:3300/0 conn(0x7f2c8806d7e0 0x7f2c8815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87e00700 1 -- 172.21.15.139:0/1594065598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 msgr2=0x7f2c880ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:48.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87e00700 1 --2- 172.21.15.139:0/1594065598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c880ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87e00700 1 -- 172.21.15.139:0/1594065598 >> v2:172.21.15.176:3300/0 conn(0x7f2c8806d7e0 msgr2=0x7f2c8815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87e00700 1 --2- 172.21.15.139:0/1594065598 >> v2:172.21.15.176:3300/0 conn(0x7f2c8806d7e0 0x7f2c8815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87e00700 1 -- 172.21.15.139:0/1594065598 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c88144b50 con 0x7f2c8815b1c0 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8d600700 1 --2- 172.21.15.139:0/1594065598 >> v2:172.21.15.176:3300/0 conn(0x7f2c8806d7e0 0x7f2c8815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87e00700 1 --2- 172.21.15.139:0/1594065598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8815b1c0 0x7f2c8806d2a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c8806df80 tx=0x7f2c74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5f1d381386cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87400700 1 -- 172.21.15.139:0/1594065598 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400b8a0 con 0x7f2c8815b1c0 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87400700 1 -- 172.21.15.139:0/1594065598 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7400ba00 con 0x7f2c8815b1c0 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c87400700 1 -- 172.21.15.139:0/1594065598 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400bd90 con 0x7f2c8815b1c0 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 -- 172.21.15.139:0/1594065598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8815b1c0 msgr2=0x7f2c8806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 --2- 172.21.15.139:0/1594065598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8815b1c0 0x7f2c8806d2a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c8806df80 tx=0x7f2c74009bf0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 -- 172.21.15.139:0/1594065598 shutdown_connections 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 --2- 172.21.15.139:0/1594065598 >> v2:172.21.15.176:3300/0 conn(0x7f2c8806d7e0 0x7f2c8815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 --2- 172.21.15.139:0/1594065598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8815b1c0 0x7f2c8806d2a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 --2- 172.21.15.139:0/1594065598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c880ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 -- 172.21.15.139:0/1594065598 >> 172.21.15.139:0/1594065598 conn(0x7f2c8806b1e0 msgr2=0x7f2c8806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 -- 172.21.15.139:0/1594065598 shutdown_connections 2024-09-13T17:24:48.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.883+0000 7f2c8f600700 1 -- 172.21.15.139:0/1594065598 wait complete. 2024-09-13T17:24:48.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 Processor -- start 2024-09-13T17:24:48.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 -- start start 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 0x7f2c881400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c8815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c8815b1c0 0x7f2c880c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880c3d30 con 0x7f2c8806d7e0 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88140620 con 0x7f2c8815b1c0 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8f600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c881f2ff0 con 0x7f2c88144770 2024-09-13T17:24:48.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 0x7f2c881400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 0x7f2c881400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36528/0 (socket says 172.21.15.139:36528) 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 -- 172.21.15.139:0/3098235832 learned_addr learned my addr 172.21.15.139:0/3098235832 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c87e00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c8815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8d600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c8815b1c0 0x7f2c880c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 -- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 msgr2=0x7f2c8815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c8815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 -- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c8815b1c0 msgr2=0x7f2c880c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c8815b1c0 0x7f2c880c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.887+0000 7f2c8cc00700 1 -- 172.21.15.139:0/3098235832 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74009570 con 0x7f2c8806d7e0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c8cc00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 0x7f2c881400e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00e790 tx=0x7f2c7c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c013610 con 0x7f2c8806d7e0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c013770 con 0x7f2c8806d7e0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c013ae0 con 0x7f2c8806d7e0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c881f32d0 con 0x7f2c8806d7e0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c881f3890 con 0x7f2c8806d7e0 2024-09-13T17:24:48.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c881f3a80 con 0x7f2c8806d7e0 2024-09-13T17:24:48.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.891+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c7c013c40 con 0x7f2c8806d7e0 2024-09-13T17:24:48.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.895+0000 7f2c84c00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c68066730 0x7f2c68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.895+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c7c0840b0 con 0x7f2c8806d7e0 2024-09-13T17:24:48.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.895+0000 7f2c87e00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c68066730 0x7f2c68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.895+0000 7f2c87e00700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c68066730 0x7f2c68068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c8806df80 tx=0x7f2c74008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:48.903+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c881f3a80 con 0x7f2c8806d7e0 2024-09-13T17:24:49.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.083+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c881f3a80 con 0x7f2c8806d7e0 2024-09-13T17:24:49.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.087+0000 7f2c84c00700 1 -- 172.21.15.139:0/3098235832 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f2c881f3a80 con 0x7f2c8806d7e0 2024-09-13T17:24:49.091 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:49.091 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c68066730 msgr2=0x7f2c68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c68066730 0x7f2c68068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c8806df80 tx=0x7f2c74008030 comp rx=0 tx=0).stop 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 msgr2=0x7f2c881400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 0x7f2c881400e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00e790 tx=0x7f2c7c00eaa0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 shutdown_connections 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2c68066730 0x7f2c68068bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c8815b1c0 0x7f2c880c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c88144770 0x7f2c8815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 --2- 172.21.15.139:0/3098235832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c8806d7e0 0x7f2c881400e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 >> 172.21.15.139:0/3098235832 conn(0x7f2c8806b1e0 msgr2=0x7f2c8815df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 shutdown_connections 2024-09-13T17:24:49.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.091+0000 7f2c8f600700 1 -- 172.21.15.139:0/3098235832 wait complete. 2024-09-13T17:24:49.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:49.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:49.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.287+0000 7fe60dc00700 1 Processor -- start 2024-09-13T17:24:49.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.287+0000 7fe60dc00700 1 -- start start 2024-09-13T17:24:49.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ebb0 0x7fe6080b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe60815f5c0 0x7fe6081434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080b41a0 con 0x7fe60815ef90 2024-09-13T17:24:49.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080b6370 con 0x7fe60815f5c0 2024-09-13T17:24:49.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080b6650 con 0x7fe60815ebb0 2024-09-13T17:24:49.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe60815f5c0 0x7fe6081434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60d200700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe60815ef90 0x7fe608143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51428/0 (socket says 172.21.15.139:51428) 2024-09-13T17:24:49.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60d200700 1 -- 172.21.15.139:0/2319967546 learned_addr learned my addr 172.21.15.139:0/2319967546 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:49.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe60815f5c0 0x7fe6081434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36532/0 (socket says 172.21.15.139:36532) 2024-09-13T17:24:49.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607e00700 1 --2- 172.21.15.139:0/2319967546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ebb0 0x7fe6080b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 -- 172.21.15.139:0/2319967546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ebb0 msgr2=0x7fe6080b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:49.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 --2- 172.21.15.139:0/2319967546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ebb0 0x7fe6080b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe606a00700 1 -- 172.21.15.139:0/2319967546 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926991713 0 0) 0x7fe600001490 con 0x7fe60815ef90 2024-09-13T17:24:49.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 -- 172.21.15.139:0/2319967546 >> v1:172.21.15.139:6789/0 conn(0x7fe60815ef90 legacy=0x7fe608143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 -- 172.21.15.139:0/2319967546 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080b6930 con 0x7fe60815f5c0 2024-09-13T17:24:49.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe607400700 1 --2- 172.21.15.139:0/2319967546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815f5c0 0x7fe6081434d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009850 tx=0x7fe5f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c2b1fe89620a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe606a00700 1 -- 172.21.15.139:0/2319967546 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4011830 con 0x7fe60815f5c0 2024-09-13T17:24:49.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe606a00700 1 -- 172.21.15.139:0/2319967546 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4011990 con 0x7fe60815f5c0 2024-09-13T17:24:49.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe606a00700 1 -- 172.21.15.139:0/2319967546 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4011d40 con 0x7fe60815f5c0 2024-09-13T17:24:49.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 -- 172.21.15.139:0/2319967546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815f5c0 msgr2=0x7fe6081434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 --2- 172.21.15.139:0/2319967546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815f5c0 0x7fe6081434d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009850 tx=0x7fe5f4009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:49.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 -- 172.21.15.139:0/2319967546 shutdown_connections 2024-09-13T17:24:49.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 --2- 172.21.15.139:0/2319967546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815f5c0 0x7fe6081434d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 --2- 172.21.15.139:0/2319967546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ebb0 0x7fe6080b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.291+0000 7fe60dc00700 1 -- 172.21.15.139:0/2319967546 >> 172.21.15.139:0/2319967546 conn(0x7fe608071fa0 msgr2=0x7fe608072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 -- 172.21.15.139:0/2319967546 shutdown_connections 2024-09-13T17:24:49.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 -- 172.21.15.139:0/2319967546 wait complete. 2024-09-13T17:24:49.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 Processor -- start 2024-09-13T17:24:49.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 -- start start 2024-09-13T17:24:49.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 0x7fe608157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ef90 0x7fe60813d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe60815f5c0 0x7fe608141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608157560 con 0x7fe60815ebb0 2024-09-13T17:24:49.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60813c9f0 con 0x7fe60815f5c0 2024-09-13T17:24:49.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60dc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080cabc0 con 0x7fe60815ef90 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe607e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 0x7fe608157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe607e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 0x7fe608157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36536/0 (socket says 172.21.15.139:36536) 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe607e00700 1 -- 172.21.15.139:0/1644311110 learned_addr learned my addr 172.21.15.139:0/1644311110 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe60d200700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe60815f5c0 0x7fe608141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.295+0000 7fe607400700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ef90 0x7fe60813d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe607e00700 1 -- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ef90 msgr2=0x7fe60813d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe607e00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ef90 0x7fe60813d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe607e00700 1 -- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe60815f5c0 msgr2=0x7fe608141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe607e00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe60815f5c0 0x7fe608141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe607e00700 1 -- 172.21.15.139:0/1644311110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40094b0 con 0x7fe60815ebb0 2024-09-13T17:24:49.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe607e00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 0x7fe608157020 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e9d0 tx=0x7fe5f800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8009720 con 0x7fe60815ebb0 2024-09-13T17:24:49.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800c850 con 0x7fe60815ebb0 2024-09-13T17:24:49.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6080caea0 con 0x7fe60815ebb0 2024-09-13T17:24:49.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800cbc0 con 0x7fe60815ebb0 2024-09-13T17:24:49.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6080cb460 con 0x7fe60815ebb0 2024-09-13T17:24:49.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.299+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6080677e0 con 0x7fe60815ebb0 2024-09-13T17:24:49.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.303+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5f800cd20 con 0x7fe60815ebb0 2024-09-13T17:24:49.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.303+0000 7fe5ffe00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe5e8066780 0x7fe5e8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.303+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5f8084500 con 0x7fe60815ebb0 2024-09-13T17:24:49.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.303+0000 7fe607400700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe5e8066780 0x7fe5e8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.303+0000 7fe607400700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe5e8066780 0x7fe5e8068c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40090b0 tx=0x7fe5f401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.311+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5f80515f0 con 0x7fe60815ebb0 2024-09-13T17:24:49.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.487+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6080b3c60 con 0x7fe60815ebb0 2024-09-13T17:24:49.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.487+0000 7fe5ffe00700 1 -- 172.21.15.139:0/1644311110 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5f8054c10 con 0x7fe60815ebb0 2024-09-13T17:24:49.492 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:24:49.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe5e8066780 msgr2=0x7fe5e8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe5e8066780 0x7fe5e8068c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40090b0 tx=0x7fe5f401c040 comp rx=0 tx=0).stop 2024-09-13T17:24:49.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 msgr2=0x7fe608157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 0x7fe608157020 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e9d0 tx=0x7fe5f800ece0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 shutdown_connections 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fe5e8066780 0x7fe5e8068c40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe60815f5c0 0x7fe608141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe60815ef90 0x7fe60813d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 --2- 172.21.15.139:0/1644311110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe60815ebb0 0x7fe608157020 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 >> 172.21.15.139:0/1644311110 conn(0x7fe608071fa0 msgr2=0x7fe6080cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 shutdown_connections 2024-09-13T17:24:49.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.491+0000 7fe60dc00700 1 -- 172.21.15.139:0/1644311110 wait complete. 2024-09-13T17:24:49.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:49.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.683+0000 7fcf50c00700 1 Processor -- start 2024-09-13T17:24:49.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.683+0000 7fcf50c00700 1 -- start start 2024-09-13T17:24:49.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf50c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcf4c06d9b0 0x7fcf4c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf50c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf4c15b1c0 0x7fcf4c15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf50c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c15c160 con 0x7fcf4c144770 2024-09-13T17:24:49.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf50c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c15c540 con 0x7fcf4c06d9b0 2024-09-13T17:24:49.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf50c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c144b50 con 0x7fcf4c15b1c0 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcf4c06d9b0 0x7fcf4c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcf4c144770 0x7fcf4c06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51434/0 (socket says 172.21.15.139:51434) 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49e00700 1 -- 172.21.15.139:0/144474053 learned_addr learned my addr 172.21.15.139:0/144474053 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf4a800700 1 --2- 172.21.15.139:0/144474053 >> v2:172.21.15.176:3300/0 conn(0x7fcf4c15b1c0 0x7fcf4c15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49400700 1 -- 172.21.15.139:0/144474053 >> v2:172.21.15.176:3300/0 conn(0x7fcf4c15b1c0 msgr2=0x7fcf4c15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49400700 1 --2- 172.21.15.139:0/144474053 >> v2:172.21.15.176:3300/0 conn(0x7fcf4c15b1c0 0x7fcf4c15c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49400700 1 -- 172.21.15.139:0/144474053 >> v1:172.21.15.139:6789/0 conn(0x7fcf4c144770 legacy=0x7fcf4c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49400700 1 -- 172.21.15.139:0/144474053 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c15b5f0 con 0x7fcf4c06d9b0 2024-09-13T17:24:49.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf49400700 1 --2- 172.21.15.139:0/144474053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ce5f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06e3c0 tx=0x7fcf38009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b72d8ba3433d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf48a00700 1 -- 172.21.15.139:0/144474053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011830 con 0x7fcf4c06d9b0 2024-09-13T17:24:49.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf48a00700 1 -- 172.21.15.139:0/144474053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38011990 con 0x7fcf4c06d9b0 2024-09-13T17:24:49.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.687+0000 7fcf48a00700 1 -- 172.21.15.139:0/144474053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011d20 con 0x7fcf4c06d9b0 2024-09-13T17:24:49.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 -- 172.21.15.139:0/144474053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c06d9b0 msgr2=0x7fcf4c0ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 --2- 172.21.15.139:0/144474053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ce5f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06e3c0 tx=0x7fcf38009b30 comp rx=0 tx=0).stop 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 -- 172.21.15.139:0/144474053 shutdown_connections 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 --2- 172.21.15.139:0/144474053 >> v2:172.21.15.176:3300/0 conn(0x7fcf4c15b1c0 0x7fcf4c15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 --2- 172.21.15.139:0/144474053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ce5f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 -- 172.21.15.139:0/144474053 >> 172.21.15.139:0/144474053 conn(0x7fcf4c06b1e0 msgr2=0x7fcf4c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 -- 172.21.15.139:0/144474053 shutdown_connections 2024-09-13T17:24:49.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 -- 172.21.15.139:0/144474053 wait complete. 2024-09-13T17:24:49.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 Processor -- start 2024-09-13T17:24:49.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.691+0000 7fcf50c00700 1 -- start start 2024-09-13T17:24:49.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 0x7fcf4c1f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf4c15b1c0 0x7fcf4c1f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c135660 con 0x7fcf4c144770 2024-09-13T17:24:49.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0c4cb0 con 0x7fcf4c15b1c0 2024-09-13T17:24:49.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0c4f90 con 0x7fcf4c06d9b0 2024-09-13T17:24:49.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 0x7fcf4c1f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 0x7fcf4c1f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36546/0 (socket says 172.21.15.139:36546) 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 -- 172.21.15.139:0/1739105461 learned_addr learned my addr 172.21.15.139:0/1739105461 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf4a800700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf4c15b1c0 0x7fcf4c1f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49e00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 -- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4c06d9b0 msgr2=0x7fcf4c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 -- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf4c15b1c0 msgr2=0x7fcf4c1f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf4c15b1c0 0x7fcf4c1f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 -- 172.21.15.139:0/1739105461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380094b0 con 0x7fcf4c144770 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf4a800700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf4c15b1c0 0x7fcf4c1f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:49.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf49400700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 0x7fcf4c1f5b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf38014040 tx=0x7fcf38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380036c0 con 0x7fcf4c144770 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3801e070 con 0x7fcf4c144770 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0c5270 con 0x7fcf4c144770 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38003a40 con 0x7fcf4c144770 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.695+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c0caf30 con 0x7fcf4c144770 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.699+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0cb120 con 0x7fcf4c144770 2024-09-13T17:24:49.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.699+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf38003ba0 con 0x7fcf4c144770 2024-09-13T17:24:49.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.699+0000 7fcf42000700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf2c066730 0x7fcf2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.699+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf38085530 con 0x7fcf4c144770 2024-09-13T17:24:49.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.699+0000 7fcf49e00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf2c066730 0x7fcf2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.699+0000 7fcf49e00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf2c066730 0x7fcf2c068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c005cb0 tx=0x7fcf3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.703+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf380525a0 con 0x7fcf4c144770 2024-09-13T17:24:49.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.879+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf4c0ce5f0 con 0x7fcf4c144770 2024-09-13T17:24:49.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf42000700 1 -- 172.21.15.139:0/1739105461 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf38055bc0 con 0x7fcf4c144770 2024-09-13T17:24:49.885 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:49.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf2c066730 msgr2=0x7fcf2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf2c066730 0x7fcf2c068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c005cb0 tx=0x7fcf3c009040 comp rx=0 tx=0).stop 2024-09-13T17:24:49.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 msgr2=0x7fcf4c1f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 0x7fcf4c1f5b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf38014040 tx=0x7fcf38004770 comp rx=0 tx=0).stop 2024-09-13T17:24:49.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 shutdown_connections 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf2c066730 0x7fcf2c068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf4c15b1c0 0x7fcf4c1f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf4c144770 0x7fcf4c1f5b20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 --2- 172.21.15.139:0/1739105461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4c06d9b0 0x7fcf4c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 >> 172.21.15.139:0/1739105461 conn(0x7fcf4c06b1e0 msgr2=0x7fcf4c0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 shutdown_connections 2024-09-13T17:24:49.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:49.883+0000 7fcf50c00700 1 -- 172.21.15.139:0/1739105461 wait complete. 2024-09-13T17:24:49.907 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 Processor -- start 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 -- start start 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15ab30 0x7fb92c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb92c15f530 0x7fb92c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92c0b6340 con 0x7fb92c15af10 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92c0b3de0 con 0x7fb92c15f530 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.075+0000 7fb931a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0b6070 con 0x7fb92c15ab30 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92a000700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fb92c15af10 0x7fb92c0cf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:38924/0 (socket says 172.21.15.139:38924) 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92a000700 1 -- 172.21.15.139:0/1508923835 learned_addr learned my addr 172.21.15.139:0/1508923835 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92aa00700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15ab30 0x7fb92c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92b400700 1 --2- 172.21.15.139:0/1508923835 >> v2:172.21.15.176:3300/0 conn(0x7fb92c15f530 0x7fb92c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb929600700 1 -- 172.21.15.139:0/1508923835 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262238245 0 0) 0x7fb92c0b6340 con 0x7fb92c15af10 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb929600700 1 -- 172.21.15.139:0/1508923835 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9100035d0 con 0x7fb92c15af10 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92b400700 1 -- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15ab30 msgr2=0x7fb92c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92b400700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15ab30 0x7fb92c0b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92b400700 1 -- 172.21.15.139:0/1508923835 >> v1:172.21.15.176:6789/0 conn(0x7fb92c15af10 legacy=0x7fb92c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92b400700 1 -- 172.21.15.139:0/1508923835 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c06f730 con 0x7fb92c15f530 2024-09-13T17:24:50.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92aa00700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15ab30 0x7fb92c0b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:50.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb92b400700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15f530 0x7fb92c0d0d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d90db2ab4066d735 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb929600700 1 -- 172.21.15.139:0/1508923835 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400e070 con 0x7fb92c15f530 2024-09-13T17:24:50.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb929600700 1 -- 172.21.15.139:0/1508923835 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400bb20 con 0x7fb92c15f530 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb929600700 1 -- 172.21.15.139:0/1508923835 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400be90 con 0x7fb92c15f530 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb931a00700 1 -- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15f530 msgr2=0x7fb92c0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.079+0000 7fb931a00700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15f530 0x7fb92c0d0d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.083+0000 7fb931a00700 1 -- 172.21.15.139:0/1508923835 shutdown_connections 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.083+0000 7fb931a00700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15f530 0x7fb92c0d0d50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.083+0000 7fb931a00700 1 --2- 172.21.15.139:0/1508923835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15ab30 0x7fb92c0b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.083+0000 7fb931a00700 1 -- 172.21.15.139:0/1508923835 >> 172.21.15.139:0/1508923835 conn(0x7fb92c06a390 msgr2=0x7fb92c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.083+0000 7fb931a00700 1 -- 172.21.15.139:0/1508923835 shutdown_connections 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.083+0000 7fb931a00700 1 -- 172.21.15.139:0/1508923835 wait complete. 2024-09-13T17:24:50.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 Processor -- start 2024-09-13T17:24:50.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 -- start start 2024-09-13T17:24:50.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15ab30 0x7fb92c144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb92c15af10 0x7fb92c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 0x7fb92c145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c157830 con 0x7fb92c15af10 2024-09-13T17:24:50.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c145030 con 0x7fb92c15ab30 2024-09-13T17:24:50.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb931a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c1454b0 con 0x7fb92c15f530 2024-09-13T17:24:50.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92aa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15ab30 0x7fb92c144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb92c15af10 0x7fb92c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 0x7fb92c145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 0x7fb92c145940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52966/0 (socket says 172.21.15.139:52966) 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 -- 172.21.15.139:0/1481916118 learned_addr learned my addr 172.21.15.139:0/1481916118 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 -- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15ab30 msgr2=0x7fb92c144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15ab30 0x7fb92c144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 -- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb92c15af10 msgr2=0x7fb92c1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb92c15af10 0x7fb92c1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 -- 172.21.15.139:0/1481916118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0094b0 con 0x7fb92c15f530 2024-09-13T17:24:50.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.087+0000 7fb92b400700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 0x7fb92c145940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb92c073bc0 tx=0x7fb924004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924012630 con 0x7fb92c15f530 2024-09-13T17:24:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924004980 con 0x7fb92c15f530 2024-09-13T17:24:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240129f0 con 0x7fb92c15f530 2024-09-13T17:24:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb924009a70 con 0x7fb92c15f530 2024-09-13T17:24:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c157270 con 0x7fb92c15f530 2024-09-13T17:24:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c145280 con 0x7fb92c15f530 2024-09-13T17:24:50.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb924012b50 con 0x7fb92c15f530 2024-09-13T17:24:50.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb922a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb90c066760 0x7fb90c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.091+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb924086190 con 0x7fb92c15f530 2024-09-13T17:24:50.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.095+0000 7fb92aa00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb90c066760 0x7fb90c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.095+0000 7fb92aa00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb90c066760 0x7fb90c068c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009ce0 tx=0x7fb91c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.103+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb924053450 con 0x7fb92c15f530 2024-09-13T17:24:50.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.283+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb92c145640 con 0x7fb92c15f530 2024-09-13T17:24:50.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.287+0000 7fb922a00700 1 -- 172.21.15.139:0/1481916118 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb924056a70 con 0x7fb92c15f530 2024-09-13T17:24:50.289 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:24:50.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb90c066760 msgr2=0x7fb90c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb90c066760 0x7fb90c068c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009ce0 tx=0x7fb91c009240 comp rx=0 tx=0).stop 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 msgr2=0x7fb92c145940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 0x7fb92c145940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb92c073bc0 tx=0x7fb924004af0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 shutdown_connections 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb90c066760 0x7fb90c068c20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb92c15f530 0x7fb92c145940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb92c15af10 0x7fb92c1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 --2- 172.21.15.139:0/1481916118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb92c15ab30 0x7fb92c144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 >> 172.21.15.139:0/1481916118 conn(0x7fb92c06a390 msgr2=0x7fb92c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 shutdown_connections 2024-09-13T17:24:50.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.291+0000 7fb931a00700 1 -- 172.21.15.139:0/1481916118 wait complete. 2024-09-13T17:24:50.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:50.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.479+0000 7f940be00700 1 Processor -- start 2024-09-13T17:24:50.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.479+0000 7f940be00700 1 -- start start 2024-09-13T17:24:50.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940be00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c070140 con 0x7f940c15aff0 2024-09-13T17:24:50.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940be00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c070420 con 0x7f940c0cddd0 2024-09-13T17:24:50.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c070700 con 0x7f940c144300 2024-09-13T17:24:50.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f9402000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f940c15aff0 0x7f940c0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51436/0 (socket says 172.21.15.139:51436) 2024-09-13T17:24:50.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f9402000700 1 -- 172.21.15.139:0/4023666014 learned_addr learned my addr 172.21.15.139:0/4023666014 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:50.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940aa00700 1 --2- 172.21.15.139:0/4023666014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940a000700 1 -- 172.21.15.139:0/4023666014 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492596845 0 0) 0x7f940c070140 con 0x7f940c15aff0 2024-09-13T17:24:50.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940a000700 1 -- 172.21.15.139:0/4023666014 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f00035d0 con 0x7f940c15aff0 2024-09-13T17:24:50.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940a000700 1 -- 172.21.15.139:0/4023666014 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952185903 0 0) 0x7f940c070420 con 0x7f940c0cddd0 2024-09-13T17:24:50.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940aa00700 1 -- 172.21.15.139:0/4023666014 >> v1:172.21.15.176:6789/0 conn(0x7f940c0cddd0 legacy=0x7f940c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940aa00700 1 -- 172.21.15.139:0/4023666014 >> v1:172.21.15.139:6789/0 conn(0x7f940c15aff0 legacy=0x7f940c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.483+0000 7f940aa00700 1 -- 172.21.15.139:0/4023666014 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c0709e0 con 0x7f940c144300 2024-09-13T17:24:50.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940aa00700 1 --2- 172.21.15.139:0/4023666014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c06d620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009dc0 tx=0x7f93fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b88d242e1252c9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940a000700 1 -- 172.21.15.139:0/4023666014 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00e070 con 0x7f940c144300 2024-09-13T17:24:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940a000700 1 -- 172.21.15.139:0/4023666014 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc00bb20 con 0x7f940c144300 2024-09-13T17:24:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940a000700 1 -- 172.21.15.139:0/4023666014 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00bed0 con 0x7f940c144300 2024-09-13T17:24:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 -- 172.21.15.139:0/4023666014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 msgr2=0x7f940c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 --2- 172.21.15.139:0/4023666014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c06d620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009dc0 tx=0x7f93fc00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 -- 172.21.15.139:0/4023666014 shutdown_connections 2024-09-13T17:24:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 --2- 172.21.15.139:0/4023666014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c06d620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 -- 172.21.15.139:0/4023666014 >> 172.21.15.139:0/4023666014 conn(0x7f940c0ce9d0 msgr2=0x7f940c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 -- 172.21.15.139:0/4023666014 shutdown_connections 2024-09-13T17:24:50.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.487+0000 7f940be00700 1 -- 172.21.15.139:0/4023666014 wait complete. 2024-09-13T17:24:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 Processor -- start 2024-09-13T17:24:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 -- start start 2024-09-13T17:24:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f940c0cddd0 0x7f940c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 0x7f940c159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c13fcf0 con 0x7f940c15aff0 2024-09-13T17:24:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c158610 con 0x7f940c0cddd0 2024-09-13T17:24:50.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c13ee60 con 0x7f940c144300 2024-09-13T17:24:50.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 0x7f940c159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940aa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f940c0cddd0 0x7f940c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 0x7f940c159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36558/0 (socket says 172.21.15.139:36558) 2024-09-13T17:24:50.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f940b400700 1 -- 172.21.15.139:0/2761399204 learned_addr learned my addr 172.21.15.139:0/2761399204 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:50.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.491+0000 7f9402000700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940b400700 1 -- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 msgr2=0x7f940c140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940b400700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940b400700 1 -- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f940c0cddd0 msgr2=0x7f940c0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940b400700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f940c0cddd0 0x7f940c0caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940b400700 1 -- 172.21.15.139:0/2761399204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009a70 con 0x7f940c15aff0 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940aa00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f940c0cddd0 0x7f940c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940b400700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 0x7f940c159530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9404007fd0 tx=0x7f940400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040054e0 con 0x7f940c15aff0 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400ce30 con 0x7f940c15aff0 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c13f070 con 0x7f940c15aff0 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040038e0 con 0x7f940c15aff0 2024-09-13T17:24:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c13f630 con 0x7f940c15aff0 2024-09-13T17:24:50.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.495+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c13fe30 con 0x7f940c15aff0 2024-09-13T17:24:50.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.499+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9404003a40 con 0x7f940c15aff0 2024-09-13T17:24:50.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.499+0000 7f9403400700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f93e8066730 0x7f93e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.499+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9404083750 con 0x7f940c15aff0 2024-09-13T17:24:50.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.499+0000 7f940aa00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f93e8066730 0x7f93e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.499+0000 7f940aa00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f93e8066730 0x7f93e8068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f93fc014040 tx=0x7f93fc01e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.507+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f940c13fe30 con 0x7f940c15aff0 2024-09-13T17:24:50.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.687+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f940c13fe30 con 0x7f940c15aff0 2024-09-13T17:24:50.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.687+0000 7f9403400700 1 -- 172.21.15.139:0/2761399204 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9404017020 con 0x7f940c15aff0 2024-09-13T17:24:50.691 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.691+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f93e8066730 msgr2=0x7f93e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.691+0000 7f940be00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f93e8066730 0x7f93e8068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f93fc014040 tx=0x7f93fc01e040 comp rx=0 tx=0).stop 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.691+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 msgr2=0x7f940c159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.691+0000 7f940be00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 0x7f940c159530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9404007fd0 tx=0x7f940400c730 comp rx=0 tx=0).stop 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 shutdown_connections 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f93e8066730 0x7f93e8068bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f940c15aff0 0x7f940c159530 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f940c144300 0x7f940c140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 --2- 172.21.15.139:0/2761399204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f940c0cddd0 0x7f940c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 >> 172.21.15.139:0/2761399204 conn(0x7f940c0ce9d0 msgr2=0x7f940c0af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 shutdown_connections 2024-09-13T17:24:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.695+0000 7f940be00700 1 -- 172.21.15.139:0/2761399204 wait complete. 2024-09-13T17:24:50.719 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:50.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.879+0000 7fb83e200700 1 Processor -- start 2024-09-13T17:24:50.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.879+0000 7fb83e200700 1 -- start start 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb83e200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb838144770 0x7fb8380ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb83e200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb83815b1c0 0x7fb83806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb83e200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83815c160 con 0x7fb83806d7e0 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb83e200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83806dc90 con 0x7fb83815b1c0 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb83e200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83815c540 con 0x7fb838144770 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fb83806d7e0 0x7fb83815e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:38956/0 (socket says 172.21.15.139:38956) 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837e00700 1 -- 172.21.15.139:0/3632893522 learned_addr learned my addr 172.21.15.139:0/3632893522 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb838144770 0x7fb8380ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb82fe00700 1 --2- 172.21.15.139:0/3632893522 >> v2:172.21.15.176:3300/0 conn(0x7fb83815b1c0 0x7fb83806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837400700 1 -- 172.21.15.139:0/3632893522 >> v2:172.21.15.176:3300/0 conn(0x7fb83815b1c0 msgr2=0x7fb83806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837400700 1 --2- 172.21.15.139:0/3632893522 >> v2:172.21.15.176:3300/0 conn(0x7fb83815b1c0 0x7fb83806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837400700 1 -- 172.21.15.139:0/3632893522 >> v1:172.21.15.176:6789/0 conn(0x7fb83806d7e0 legacy=0x7fb83815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb836a00700 1 -- 172.21.15.139:0/3632893522 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856105337 0 0) 0x7fb83815c160 con 0x7fb83806d7e0 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837400700 1 -- 172.21.15.139:0/3632893522 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838144b50 con 0x7fb838144770 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.883+0000 7fb837400700 1 --2- 172.21.15.139:0/3632893522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb838144770 0x7fb8380ce5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb828009850 tx=0x7fb828009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd44555ead7cd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb836a00700 1 -- 172.21.15.139:0/3632893522 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828011830 con 0x7fb838144770 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb836a00700 1 -- 172.21.15.139:0/3632893522 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828011990 con 0x7fb838144770 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb836a00700 1 -- 172.21.15.139:0/3632893522 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828011d40 con 0x7fb838144770 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 -- 172.21.15.139:0/3632893522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb838144770 msgr2=0x7fb8380ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 --2- 172.21.15.139:0/3632893522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb838144770 0x7fb8380ce5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb828009850 tx=0x7fb828009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:50.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 -- 172.21.15.139:0/3632893522 shutdown_connections 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 --2- 172.21.15.139:0/3632893522 >> v2:172.21.15.176:3300/0 conn(0x7fb83815b1c0 0x7fb83806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 --2- 172.21.15.139:0/3632893522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb838144770 0x7fb8380ce5f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 -- 172.21.15.139:0/3632893522 >> 172.21.15.139:0/3632893522 conn(0x7fb83806b1e0 msgr2=0x7fb83806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 -- 172.21.15.139:0/3632893522 shutdown_connections 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.887+0000 7fb83e200700 1 -- 172.21.15.139:0/3632893522 wait complete. 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 Processor -- start 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 -- start start 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 0x7fb8381401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb838144770 0x7fb8380c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb83815b1c0 0x7fb8380c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8381f3da0 con 0x7fb83806d7e0 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380aaa30 con 0x7fb838144770 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb83e200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380c3ff0 con 0x7fb83815b1c0 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 0x7fb8381401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 0x7fb8381401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36562/0 (socket says 172.21.15.139:36562) 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 -- 172.21.15.139:0/2461481098 learned_addr learned my addr 172.21.15.139:0/2461481098 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837e00700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb83815b1c0 0x7fb8380c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb82fe00700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb838144770 0x7fb8380c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 -- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb83815b1c0 msgr2=0x7fb8380c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb83815b1c0 0x7fb8380c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 -- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb838144770 msgr2=0x7fb8380c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb838144770 0x7fb8380c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 -- 172.21.15.139:0/2461481098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280094b0 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.891+0000 7fb837400700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 0x7fb8381401c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8280090b0 tx=0x7fb828004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82801a990 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82801f070 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380aaca0 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82801ad30 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8380ab260 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8380cd160 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.895+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb82801b430 con 0x7fb83806d7e0 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.899+0000 7fb82f400700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb814066730 0x7fb814068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.899+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb828085530 con 0x7fb83806d7e0 2024-09-13T17:24:50.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.899+0000 7fb82fe00700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb814066730 0x7fb814068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.899+0000 7fb82fe00700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb814066730 0x7fb814068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8380b0690 tx=0x7fb820009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:50.903+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8280525a0 con 0x7fb83806d7e0 2024-09-13T17:24:51.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.127+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb838140700 con 0x7fb83806d7e0 2024-09-13T17:24:51.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.131+0000 7fb82f400700 1 -- 172.21.15.139:0/2461481098 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7fb828006ce0 con 0x7fb83806d7e0 2024-09-13T17:24:51.134 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:51.134 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:51.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.131+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb814066730 msgr2=0x7fb814068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.131+0000 7fb83e200700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb814066730 0x7fb814068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8380b0690 tx=0x7fb820009240 comp rx=0 tx=0).stop 2024-09-13T17:24:51.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.131+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 msgr2=0x7fb8381401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.131+0000 7fb83e200700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 0x7fb8381401c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8280090b0 tx=0x7fb828004770 comp rx=0 tx=0).stop 2024-09-13T17:24:51.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.131+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 shutdown_connections 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb814066730 0x7fb814068bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb83815b1c0 0x7fb8380c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb838144770 0x7fb8380c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 --2- 172.21.15.139:0/2461481098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83806d7e0 0x7fb8381401c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 >> 172.21.15.139:0/2461481098 conn(0x7fb83806b1e0 msgr2=0x7fb8380cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 shutdown_connections 2024-09-13T17:24:51.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.135+0000 7fb83e200700 1 -- 172.21.15.139:0/2461481098 wait complete. 2024-09-13T17:24:51.140 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:24:51.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:51.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.335+0000 7f4d92600700 1 Processor -- start 2024-09-13T17:24:51.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.335+0000 7f4d92600700 1 -- start start 2024-09-13T17:24:51.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d92600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c159bd0 0x7f4d8c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d92600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4d8c0721e0 0x7f4d8c070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d92600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0705c0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d92600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c159fb0 con 0x7f4d8c0721e0 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d92600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0cb920 con 0x7f4d8c159bd0 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8be00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f4d8c0712c0 0x7f4d8c06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51452/0 (socket says 172.21.15.139:51452) 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8be00700 1 -- 172.21.15.139:0/1216423164 learned_addr learned my addr 172.21.15.139:0/1216423164 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8b400700 1 --2- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c159bd0 0x7f4d8c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8aa00700 1 --2- 172.21.15.139:0/1216423164 >> v2:172.21.15.176:3300/0 conn(0x7f4d8c0721e0 0x7f4d8c070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8a000700 1 -- 172.21.15.139:0/1216423164 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603997789 0 0) 0x7f4d8c0705c0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8a000700 1 -- 172.21.15.139:0/1216423164 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d700035d0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8aa00700 1 -- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c159bd0 msgr2=0x7f4d8c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:51.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8aa00700 1 --2- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c159bd0 0x7f4d8c0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8aa00700 1 -- 172.21.15.139:0/1216423164 >> v1:172.21.15.139:6789/0 conn(0x7f4d8c0712c0 legacy=0x7f4d8c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8aa00700 1 -- 172.21.15.139:0/1216423164 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0cbc00 con 0x7f4d8c0721e0 2024-09-13T17:24:51.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.339+0000 7f4d8aa00700 1 --2- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c0721e0 0x7f4d8c070d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009850 tx=0x7f4d78009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa732c63350439a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d8a000700 1 -- 172.21.15.139:0/1216423164 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78011830 con 0x7f4d8c0721e0 2024-09-13T17:24:51.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d8a000700 1 -- 172.21.15.139:0/1216423164 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78011990 con 0x7f4d8c0721e0 2024-09-13T17:24:51.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d8a000700 1 -- 172.21.15.139:0/1216423164 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78011d40 con 0x7f4d8c0721e0 2024-09-13T17:24:51.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 -- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c0721e0 msgr2=0x7f4d8c070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 --2- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c0721e0 0x7f4d8c070d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009850 tx=0x7f4d78009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:51.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 -- 172.21.15.139:0/1216423164 shutdown_connections 2024-09-13T17:24:51.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 --2- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c0721e0 0x7f4d8c070d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 --2- 172.21.15.139:0/1216423164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c159bd0 0x7f4d8c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 -- 172.21.15.139:0/1216423164 >> 172.21.15.139:0/1216423164 conn(0x7f4d8c06b1e0 msgr2=0x7f4d8c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:51.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 -- 172.21.15.139:0/1216423164 shutdown_connections 2024-09-13T17:24:51.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 -- 172.21.15.139:0/1216423164 wait complete. 2024-09-13T17:24:51.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.343+0000 7f4d92600700 1 Processor -- start 2024-09-13T17:24:51.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 -- start start 2024-09-13T17:24:51.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 0x7f4d8c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c0721e0 0x7f4d8c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c159bd0 0x7f4d8c15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c15b580 con 0x7f4d8c0712c0 2024-09-13T17:24:51.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c15a660 con 0x7f4d8c159bd0 2024-09-13T17:24:51.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c15a900 con 0x7f4d8c0721e0 2024-09-13T17:24:51.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 0x7f4d8c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 0x7f4d8c15a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36570/0 (socket says 172.21.15.139:36570) 2024-09-13T17:24:51.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 -- 172.21.15.139:0/2584858469 learned_addr learned my addr 172.21.15.139:0/2584858469 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8aa00700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c0721e0 0x7f4d8c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8be00700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c159bd0 0x7f4d8c15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 -- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c0721e0 msgr2=0x7f4d8c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c0721e0 0x7f4d8c15c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 -- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c159bd0 msgr2=0x7f4d8c15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c159bd0 0x7f4d8c15cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 -- 172.21.15.139:0/2584858469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780094b0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d8b400700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 0x7f4d8c15a120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00e9d0 tx=0x7f4d7c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c009720 con 0x7f4d8c0712c0 2024-09-13T17:24:51.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00c850 con 0x7f4d8c0712c0 2024-09-13T17:24:51.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c15abe0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00cbc0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.347+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c15b1a0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.351+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c15b7f0 con 0x7f4d8c0712c0 2024-09-13T17:24:51.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.351+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d7c00cd20 con 0x7f4d8c0712c0 2024-09-13T17:24:51.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.355+0000 7f4d83400700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d6c066730 0x7f4d6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.355+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d7c084600 con 0x7f4d8c0712c0 2024-09-13T17:24:51.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.355+0000 7f4d8aa00700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d6c066730 0x7f4d6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.355+0000 7f4d8aa00700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d6c066730 0x7f4d6c068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d780090b0 tx=0x7f4d78008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.359+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d7c051600 con 0x7f4d8c0712c0 2024-09-13T17:24:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.555+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d8c06db20 con 0x7f4d8c0712c0 2024-09-13T17:24:51.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.559+0000 7f4d83400700 1 -- 172.21.15.139:0/2584858469 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f4d7c054c20 con 0x7f4d8c0712c0 2024-09-13T17:24:51.562 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:51.562 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":25,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:19.923322+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d6c066730 msgr2=0x7f4d6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d6c066730 0x7f4d6c068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d780090b0 tx=0x7f4d78008030 comp rx=0 tx=0).stop 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 msgr2=0x7f4d8c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 0x7f4d8c15a120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00e9d0 tx=0x7f4d7c00ed90 comp rx=0 tx=0).stop 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 shutdown_connections 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d6c066730 0x7f4d6c068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d8c159bd0 0x7f4d8c15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8c0721e0 0x7f4d8c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 --2- 172.21.15.139:0/2584858469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d8c0712c0 0x7f4d8c15a120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 >> 172.21.15.139:0/2584858469 conn(0x7f4d8c06b1e0 msgr2=0x7f4d8c06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:51.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 shutdown_connections 2024-09-13T17:24:51.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.563+0000 7f4d92600700 1 -- 172.21.15.139:0/2584858469 wait complete. 2024-09-13T17:24:51.588 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:51.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.763+0000 7f2ebd800700 1 Processor -- start 2024-09-13T17:24:51.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.763+0000 7f2ebd800700 1 -- start start 2024-09-13T17:24:51.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2ebd800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2eb80b3280 0x7f2eb80cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2ebd800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2ebd800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb8071ff0 con 0x7f2eb814a6d0 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2ebd800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb80cd8e0 con 0x7f2eb80b3280 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2ebd800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb814aab0 con 0x7f2eb80cd450 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eb7e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2eb814a6d0 0x7f2eb80b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:51468/0 (socket says 172.21.15.139:51468) 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eb7e00700 1 -- 172.21.15.139:0/1217683311 learned_addr learned my addr 172.21.15.139:0/1217683311 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:51.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eaf400700 1 --2- 172.21.15.139:0/1217683311 >> v2:172.21.15.139:3300/0 conn(0x7f2eb80b3280 0x7f2eb80cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2ebce00700 1 --2- 172.21.15.139:0/1217683311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eb7400700 1 -- 172.21.15.139:0/1217683311 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89655528 0 0) 0x7f2ea8001490 con 0x7f2eb814a6d0 2024-09-13T17:24:51.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eb7400700 1 -- 172.21.15.139:0/1217683311 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c0035d0 con 0x7f2eb814a6d0 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eaf400700 1 -- 172.21.15.139:0/1217683311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 msgr2=0x7f2eb8071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eaf400700 1 --2- 172.21.15.139:0/1217683311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eaf400700 1 -- 172.21.15.139:0/1217683311 >> v1:172.21.15.139:6789/0 conn(0x7f2eb814a6d0 legacy=0x7f2eb80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eaf400700 1 -- 172.21.15.139:0/1217683311 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80cc3b0 con 0x7f2eb80b3280 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.767+0000 7f2eaf400700 1 --2- 172.21.15.139:0/1217683311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb80cbd40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009850 tx=0x7f2ea0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03cd05d70378a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2eb7400700 1 -- 172.21.15.139:0/1217683311 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0011830 con 0x7f2eb80b3280 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2eb7400700 1 -- 172.21.15.139:0/1217683311 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0011990 con 0x7f2eb80b3280 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2eb7400700 1 -- 172.21.15.139:0/1217683311 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0011d40 con 0x7f2eb80b3280 2024-09-13T17:24:51.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 -- 172.21.15.139:0/1217683311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 msgr2=0x7f2eb80cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 --2- 172.21.15.139:0/1217683311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb80cbd40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009850 tx=0x7f2ea0009b60 comp rx=0 tx=0).stop 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 -- 172.21.15.139:0/1217683311 shutdown_connections 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 --2- 172.21.15.139:0/1217683311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 --2- 172.21.15.139:0/1217683311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb80cbd40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 -- 172.21.15.139:0/1217683311 >> 172.21.15.139:0/1217683311 conn(0x7f2eb80ce9d0 msgr2=0x7f2eb80cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 -- 172.21.15.139:0/1217683311 shutdown_connections 2024-09-13T17:24:51.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.771+0000 7f2ebd800700 1 -- 172.21.15.139:0/1217683311 wait complete. 2024-09-13T17:24:51.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 Processor -- start 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 -- start start 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb81f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8163d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb814a6d0 0x7f2eb8164250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb806c820 con 0x7f2eb80b3280 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb806c180 con 0x7f2eb814a6d0 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebd800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81f7670 con 0x7f2eb80cd450 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb81f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb81f7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36594/0 (socket says 172.21.15.139:36594) 2024-09-13T17:24:51.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2eb7e00700 1 -- 172.21.15.139:0/585949249 learned_addr learned my addr 172.21.15.139:0/585949249 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:51.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.775+0000 7f2ebce00700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb814a6d0 0x7f2eb8164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eaf400700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb7e00700 1 -- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 msgr2=0x7f2eb8163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb7e00700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8163d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb7e00700 1 -- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb814a6d0 msgr2=0x7f2eb8164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb7e00700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb814a6d0 0x7f2eb8164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb7e00700 1 -- 172.21.15.139:0/585949249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00094b0 con 0x7f2eb80b3280 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb7e00700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb81f7a90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800cbc0 tx=0x7f2ea800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800a9e0 con 0x7f2eb80b3280 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800ab40 con 0x7f2eb80b3280 2024-09-13T17:24:51.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8012400 con 0x7f2eb80b3280 2024-09-13T17:24:51.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb806c440 con 0x7f2eb80b3280 2024-09-13T17:24:51.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb806ce20 con 0x7f2eb80b3280 2024-09-13T17:24:51.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.779+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb80cee50 con 0x7f2eb80b3280 2024-09-13T17:24:51.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.783+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ea801b3b0 con 0x7f2eb80b3280 2024-09-13T17:24:51.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.783+0000 7f2eb4c00700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2e94066730 0x7f2e94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:51.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.783+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ea8083e00 con 0x7f2eb80b3280 2024-09-13T17:24:51.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.783+0000 7f2eaf400700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2e94066730 0x7f2e94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:51.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.783+0000 7f2eaf400700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2e94066730 0x7f2e94068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00090b0 tx=0x7f2ea0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:51.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:51.791+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ea8050e70 con 0x7f2eb80b3280 2024-09-13T17:24:52.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.019+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2eb8071ff0 con 0x7f2eb80b3280 2024-09-13T17:24:52.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.023+0000 7f2eb4c00700 1 -- 172.21.15.139:0/585949249 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f2eb8071ff0 con 0x7f2eb80b3280 2024-09-13T17:24:52.026 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:24:52.026 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:52.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2e94066730 msgr2=0x7f2e94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2e94066730 0x7f2e94068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00090b0 tx=0x7f2ea0008030 comp rx=0 tx=0).stop 2024-09-13T17:24:52.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 msgr2=0x7f2eb81f7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb81f7a90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800cbc0 tx=0x7f2ea800cca0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 shutdown_connections 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2e94066730 0x7f2e94068bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb814a6d0 0x7f2eb8164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb80cd450 0x7f2eb8163d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 --2- 172.21.15.139:0/585949249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb80b3280 0x7f2eb81f7a90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 >> 172.21.15.139:0/585949249 conn(0x7f2eb80ce9d0 msgr2=0x7f2eb806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 shutdown_connections 2024-09-13T17:24:52.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.027+0000 7f2ebd800700 1 -- 172.21.15.139:0/585949249 wait complete. 2024-09-13T17:24:52.033 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:24:52.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:24:15.421146+0000', 'modified': '2024-09-13T17:24:40.558647+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6834/4065509262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 4065509262}, {'type': 'v1', 'addr': '172.21.15.176:6834', 'nonce': 4065509262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:24:52.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:24:52.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 Processor -- start 2024-09-13T17:24:52.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 -- start start 2024-09-13T17:24:52.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae4144300 0x7fdae406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdae40cddd0 0x7fdae40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae4070140 con 0x7fdae415aff0 2024-09-13T17:24:52.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae4070420 con 0x7fdae40cddd0 2024-09-13T17:24:52.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae9000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4070700 con 0x7fdae4144300 2024-09-13T17:24:52.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdae40cddd0 0x7fdae40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdae40cddd0 0x7fdae40711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36608/0 (socket says 172.21.15.139:36608) 2024-09-13T17:24:52.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdadaa00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fdae415aff0 0x7fdae40cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:38962/0 (socket says 172.21.15.139:38962) 2024-09-13T17:24:52.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3e00700 1 -- 172.21.15.139:0/3715641716 learned_addr learned my addr 172.21.15.139:0/3715641716 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:52.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3400700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae4144300 0x7fdae406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3e00700 1 -- 172.21.15.139:0/3715641716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae4144300 msgr2=0x7fdae406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3e00700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae4144300 0x7fdae406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.627+0000 7fdae3e00700 1 -- 172.21.15.139:0/3715641716 >> v1:172.21.15.176:6789/0 conn(0x7fdae415aff0 legacy=0x7fdae40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae3e00700 1 -- 172.21.15.139:0/3715641716 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40709e0 con 0x7fdae40cddd0 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae3400700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae4144300 0x7fdae406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae3e00700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae40cddd0 0x7fdae40711e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009910 tx=0x7fdadc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f731aeb9e4b4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae2a00700 1 -- 172.21.15.139:0/3715641716 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00ba60 con 0x7fdae40cddd0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae2a00700 1 -- 172.21.15.139:0/3715641716 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc00bbc0 con 0x7fdae40cddd0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae2a00700 1 -- 172.21.15.139:0/3715641716 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc009e60 con 0x7fdae40cddd0 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 -- 172.21.15.139:0/3715641716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae40cddd0 msgr2=0x7fdae40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae40cddd0 0x7fdae40711e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009910 tx=0x7fdadc009c20 comp rx=0 tx=0).stop 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 -- 172.21.15.139:0/3715641716 shutdown_connections 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae40cddd0 0x7fdae40711e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 --2- 172.21.15.139:0/3715641716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae4144300 0x7fdae406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 -- 172.21.15.139:0/3715641716 >> 172.21.15.139:0/3715641716 conn(0x7fdae40ce9d0 msgr2=0x7fdae40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 -- 172.21.15.139:0/3715641716 shutdown_connections 2024-09-13T17:24:52.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.631+0000 7fdae9000700 1 -- 172.21.15.139:0/3715641716 wait complete. 2024-09-13T17:24:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 Processor -- start 2024-09-13T17:24:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 -- start start 2024-09-13T17:24:52.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae40cddd0 0x7fdae41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 0x7fdae40c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae415aff0 0x7fdae40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae413bc70 con 0x7fdae4144300 2024-09-13T17:24:52.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae413cef0 con 0x7fdae40cddd0 2024-09-13T17:24:52.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae9000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c4f50 con 0x7fdae415aff0 2024-09-13T17:24:52.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 0x7fdae40c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 0x7fdae40c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36620/0 (socket says 172.21.15.139:36620) 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 -- 172.21.15.139:0/3677931211 learned_addr learned my addr 172.21.15.139:0/3677931211 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae3400700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae40cddd0 0x7fdae41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdae3e00700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae415aff0 0x7fdae40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 -- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae415aff0 msgr2=0x7fdae40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae415aff0 0x7fdae40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 -- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae40cddd0 msgr2=0x7fdae41597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae40cddd0 0x7fdae41597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 -- 172.21.15.139:0/3677931211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc009570 con 0x7fdae4144300 2024-09-13T17:24:52.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.635+0000 7fdadaa00700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 0x7fdae40c43e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c6b0 tx=0x7fdacc00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.639+0000 7fdadbe00700 1 -- 172.21.15.139:0/3677931211 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc005cd0 con 0x7fdae4144300 2024-09-13T17:24:52.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.639+0000 7fdadbe00700 1 -- 172.21.15.139:0/3677931211 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc005e30 con 0x7fdae4144300 2024-09-13T17:24:52.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.639+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae40c5230 con 0x7fdae4144300 2024-09-13T17:24:52.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.639+0000 7fdadbe00700 1 -- 172.21.15.139:0/3677931211 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0072d0 con 0x7fdae4144300 2024-09-13T17:24:52.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.639+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae4155ca0 con 0x7fdae4144300 2024-09-13T17:24:52.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdadbe00700 1 -- 172.21.15.139:0/3677931211 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdacc007430 con 0x7fdae4144300 2024-09-13T17:24:52.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 Processor -- start 2024-09-13T17:24:52.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdadbe00700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdac0066730 0x7fdac0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 -- start start 2024-09-13T17:24:52.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdadbe00700 1 -- 172.21.15.139:0/3677931211 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdacc0838b0 con 0x7fdae4144300 2024-09-13T17:24:52.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdae3400700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdac0066730 0x7fdac0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d7a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d76d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d76ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d6ccd80 con 0x3d783d00 2024-09-13T17:24:52.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d6ca510 con 0x3d7a56c0 2024-09-13T17:24:52.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x3d6c5e00 con 0x3d7a4da0 2024-09-13T17:24:52.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d76d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d76d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36624/0 (socket says 172.21.15.139:36624) 2024-09-13T17:24:52.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdadaa00700 1 -- 172.21.15.139:0/4188782507 learned_addr learned my addr 172.21.15.139:0/4188782507 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:52.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdae3400700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdac0066730 0x7fdac0068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009b20 tx=0x7fdad4003aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.643+0000 7fdae3e00700 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d76ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdae3400700 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d7a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdadaa00700 1 -- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 msgr2=0x3d7a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdadaa00700 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d7a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdadaa00700 1 -- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 msgr2=0x3d76ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdadaa00700 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d76ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdadaa00700 1 -- 172.21.15.139:0/4188782507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3d538960 con 0x3d783d00 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdae3400700 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d7a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:52.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdadaa00700 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d76d890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0070a0 tx=0x7fdacc054270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2277a4aaafd97f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdad3e00700 1 -- 172.21.15.139:0/4188782507 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc05c940 con 0x3d783d00 2024-09-13T17:24:52.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdad3e00700 1 -- 172.21.15.139:0/4188782507 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc0076e0 con 0x3d783d00 2024-09-13T17:24:52.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.647+0000 7fdad3e00700 1 -- 172.21.15.139:0/4188782507 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0529a0 con 0x3d783d00 2024-09-13T17:24:52.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 -- 172.21.15.139:0/4188782507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 msgr2=0x3d76d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d76d890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0070a0 tx=0x7fdacc054270 comp rx=0 tx=0).stop 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 -- 172.21.15.139:0/4188782507 shutdown_connections 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d76ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d76d890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 --2- 172.21.15.139:0/4188782507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d7a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 -- 172.21.15.139:0/4188782507 >> 172.21.15.139:0/4188782507 conn(0x3d4ed4d0 msgr2=0x3d786c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 -- 172.21.15.139:0/4188782507 shutdown_connections 2024-09-13T17:24:52.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 -- 172.21.15.139:0/4188782507 wait complete. 2024-09-13T17:24:52.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 -- start start 2024-09-13T17:24:52.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.651+0000 7fdaed994740 1 Processor -- start 2024-09-13T17:24:52.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d7ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d75e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d683730 con 0x3d783d00 2024-09-13T17:24:52.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d6895b0 con 0x3d7a56c0 2024-09-13T17:24:52.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x3d571aa0 con 0x3d7a4da0 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 10 client.0 _ll_register_callbacks cb 0x3d6bf610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d7ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d7ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36628/0 (socket says 172.21.15.139:36628) 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 -- 172.21.15.139:0/3258627704 learned_addr learned my addr 172.21.15.139:0/3258627704 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdadaa00700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d75e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3e00700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 -- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 msgr2=0x3d75e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d75e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 -- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 msgr2=0x3d7a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 -- 172.21.15.139:0/3258627704 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae4155ca0 con 0x3d783d00 2024-09-13T17:24:52.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdae3400700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d7ab340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdad40166d0 tx=0x7fdad4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165d9351596fa2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdad0c00700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T17:24:52.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdad0c00700 1 -- 172.21.15.139:0/3258627704 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4021610 con 0x3d783d00 2024-09-13T17:24:52.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdad0c00700 1 -- 172.21.15.139:0/3258627704 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdad4021770 con 0x3d783d00 2024-09-13T17:24:52.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3d4fa1e0 con 0x3d783d00 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdad0c00700 1 -- 172.21.15.139:0/3258627704 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdad4021930 con 0x3d783d00 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 10 client.4776 fetch_fsmap learned FSMap version 8 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x3d68c220 con 0x3d783d00 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdad0c00700 1 -- 172.21.15.139:0/3258627704 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3d4fa1e0 con 0x3d783d00 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.655+0000 7fdad0c00700 1 -- 172.21.15.139:0/3258627704 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fdad4021a90 con 0x3d783d00 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 10 client.4776 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 10 client.4776 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 20 client.4776 populate_metadata read hostname 'smithi139' 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d75d200 0x3d75d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 4 client.4776 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 --> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3d544460 con 0x3d75d200 2024-09-13T17:24:52.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdadaa00700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d75d200 0x3d75d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdadaa00700 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d75d200 0x3d75d5e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f543b57f8b768312 server_cookie=ab6824b356e53366 in_seq=0 out_seq=0 2024-09-13T17:24:52.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdad0c00700 10 client.4776 ms_handle_connect on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:52.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdad0c00700 1 -- 172.21.15.139:0/3258627704 <== mds.0 v2:172.21.15.176:6832/4065509262 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3d544460 con 0x3d75d200 2024-09-13T17:24:52.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdad0c00700 10 client.4776 handle_command_reply: tid=0 2024-09-13T17:24:52.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 client.4776 shutdown 2024-09-13T17:24:52.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 msgr2=0x3d7ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d7ab340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdad40166d0 tx=0x7fdad4012000 comp rx=0 tx=0).stop 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 shutdown_connections 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d75d200 0x3d75d5e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a4da0 0x3d75e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 --2- 172.21.15.139:0/3258627704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d7ab340 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdad0c00700 0 client.4776 ms_handle_reset on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 >> 172.21.15.139:0/3258627704 conn(0x3d4ed4d0 msgr2=0x3d780780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 shutdown_connections 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 1 -- 172.21.15.139:0/3258627704 wait complete. 2024-09-13T17:24:52.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.659+0000 7fdaed994740 20 client.4776 trim_cache size 0 max 16384 2024-09-13T17:24:52.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.679+0000 7fdaed994740 1 Processor -- start 2024-09-13T17:24:52.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.679+0000 7fdaed994740 1 -- start start 2024-09-13T17:24:52.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdaed994740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d79f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a4da0 0x3d79fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 0x3d75be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdaed994740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d6c9670 con 0x3d783d00 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d6c5610 con 0x3d7a4da0 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x3d66e020 con 0x3d7a56c0 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d79f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 0x3d75be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 0x3d75be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:53080/0 (socket says 172.21.15.139:53080) 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 -- 172.21.15.139:0/4091695329 learned_addr learned my addr 172.21.15.139:0/4091695329 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:52.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a4da0 0x3d79fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 -- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a4da0 msgr2=0x3d79fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a4da0 0x3d79fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 -- 172.21.15.139:0/4091695329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 msgr2=0x3d79f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d79f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 -- 172.21.15.139:0/4091695329 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3d783610 con 0x3d7a56c0 2024-09-13T17:24:52.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdadaa00700 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a4da0 0x3d79fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:52.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdae3e00700 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 0x3d75be20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00b3c0 tx=0x7fdadc010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f335620e9ea7c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdad8c00700 1 -- 172.21.15.139:0/4091695329 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc020070 con 0x3d7a56c0 2024-09-13T17:24:52.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdad8c00700 1 -- 172.21.15.139:0/4091695329 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc021040 con 0x3d7a56c0 2024-09-13T17:24:52.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.683+0000 7fdad8c00700 1 -- 172.21.15.139:0/4091695329 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00bee0 con 0x3d7a56c0 2024-09-13T17:24:52.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 -- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 msgr2=0x3d75be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 0x3d75be20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00b3c0 tx=0x7fdadc010000 comp rx=0 tx=0).stop 2024-09-13T17:24:52.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 -- 172.21.15.139:0/4091695329 shutdown_connections 2024-09-13T17:24:52.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d7a56c0 0x3d75be20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a4da0 0x3d79fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 --2- 172.21.15.139:0/4091695329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d783d00 0x3d79f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 -- 172.21.15.139:0/4091695329 >> 172.21.15.139:0/4091695329 conn(0x3d4ed4d0 msgr2=0x3d75b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 -- 172.21.15.139:0/4091695329 shutdown_connections 2024-09-13T17:24:52.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 -- 172.21.15.139:0/4091695329 wait complete. 2024-09-13T17:24:52.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 -- start start 2024-09-13T17:24:52.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 Processor -- start 2024-09-13T17:24:52.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d783d00 0x3d805fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.687+0000 7fdaed994740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 0x3d8064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7c3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d7aa4a0 con 0x3d7a4da0 2024-09-13T17:24:52.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x3d7a53e0 con 0x3d7a56c0 2024-09-13T17:24:52.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x3d760290 con 0x3d783d00 2024-09-13T17:24:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 10 client.0 _ll_register_callbacks cb 0x3d71c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 0x3d8064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 0x3d8064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36636/0 (socket says 172.21.15.139:36636) 2024-09-13T17:24:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 -- 172.21.15.139:0/1939536880 learned_addr learned my addr 172.21.15.139:0/1939536880 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdae3e00700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdae3400700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d783d00 0x3d805fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 -- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d783d00 msgr2=0x3d805fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d783d00 0x3d805fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 -- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 msgr2=0x3d7c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 -- 172.21.15.139:0/1939536880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc071a90 con 0x3d7a4da0 2024-09-13T17:24:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdadaa00700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 0x3d8064f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00ce70 tx=0x7fdacc083070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e663d927b43e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdad0c00700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdad0c00700 1 -- 172.21.15.139:0/1939536880 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc081040 con 0x3d7a4da0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdad0c00700 1 -- 172.21.15.139:0/1939536880 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdacc080070 con 0x3d7a4da0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdacc0076e0 con 0x3d7a4da0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdad0c00700 1 -- 172.21.15.139:0/1939536880 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdacc0543d0 con 0x3d7a4da0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 10 client.4782 fetch_fsmap learned FSMap version 8 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fdae40709e0 con 0x3d7a4da0 2024-09-13T17:24:52.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdad0c00700 1 -- 172.21.15.139:0/1939536880 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc0076e0 con 0x3d7a4da0 2024-09-13T17:24:52.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdad0c00700 1 -- 172.21.15.139:0/1939536880 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fdacc079070 con 0x3d7a4da0 2024-09-13T17:24:52.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 10 client.4782 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T17:24:52.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 10 client.4782 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 20 client.4782 populate_metadata read hostname 'smithi139' 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d7a8b50 0x3d7a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 4 client.4782 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 --> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] -- command(tid 0: {"prefix": "status"}) v1 -- 0x3d5691e0 con 0x3d7a8b50 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.691+0000 7fdae3400700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d7a8b50 0x3d7a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae3400700 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d7a8b50 0x3d7a8f30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba90f9531d809933 server_cookie=5d9338c9629eed54 in_seq=0 out_seq=0 2024-09-13T17:24:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdad0c00700 10 client.4782 ms_handle_connect on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdad0c00700 1 -- 172.21.15.139:0/1939536880 <== mds.0 v2:172.21.15.176:6832/4065509262 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x3d5691e0 con 0x3d7a8b50 2024-09-13T17:24:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdad0c00700 10 client.4782 handle_command_reply: tid=0 2024-09-13T17:24:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 client.4782 shutdown 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 msgr2=0x3d8064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 0x3d8064f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00ce70 tx=0x7fdacc083070 comp rx=0 tx=0).stop 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 shutdown_connections 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:6832/4065509262,v1:172.21.15.176:6834/4065509262] conn(0x3d7a8b50 0x3d7a8f30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdad0c00700 0 client.4782 ms_handle_reset on v2:172.21.15.176:6832/4065509262 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x3d7a56c0 0x3d7c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x3d7a4da0 0x3d8064f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 --2- 172.21.15.139:0/1939536880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x3d783d00 0x3d805fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 >> 172.21.15.139:0/1939536880 conn(0x3d4ed4d0 msgr2=0x3d75bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 shutdown_connections 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 1 -- 172.21.15.139:0/1939536880 wait complete. 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdaed994740 20 client.4782 trim_cache size 0 max 16384 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "a6cff629-1d3c-470e-abc7-14e2fbc4e0ad", 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2024-09-13T17:24:52.701 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4294, 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 37.269896537999998, 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 8, 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 25, 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 25, 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 41.768938128999999 2024-09-13T17:24:52.702 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdac0066730 msgr2=0x7fdac0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdac0066730 0x7fdac0068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009b20 tx=0x7fdad4003aa0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 msgr2=0x7fdae40c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 0x7fdae40c43e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c6b0 tx=0x7fdacc00ca70 comp rx=0 tx=0).stop 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 shutdown_connections 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fdac0066730 0x7fdac0068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdae415aff0 0x7fdae40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae4144300 0x7fdae40c43e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 --2- 172.21.15.139:0/3677931211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdae40cddd0 0x7fdae41597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 >> 172.21.15.139:0/3677931211 conn(0x7fdae40ce9d0 msgr2=0x7fdae406d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 shutdown_connections 2024-09-13T17:24:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:52.695+0000 7fdae9000700 1 -- 172.21.15.139:0/3677931211 wait complete. 2024-09-13T17:24:52.725 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T17:24:52.734 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T17:24:52.734 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T17:24:52.735 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T17:24:52.735 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T17:24:52.787 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T17:24:52.787 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T17:24:52.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:52.787 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:24:52.806 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T17:24:52.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:52.806 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:24:52.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:52.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-13T17:24:53.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:53.433 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:24:53.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:53.454 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-13T17:24:53.536 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2024-09-13T17:24:53.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:24:53.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:53.540 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-13T17:24:53.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:53.562 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-13T17:24:53.653 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-13T17:24:53.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:24:53.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:53.658 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-13T17:24:53.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:53.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-13T17:24:53.771 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-13T17:24:53.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:24:53.775 INFO:tasks.kclient:client.0 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-13T17:24:53.775 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:24:53.775 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:53.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:24:53.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.943+0000 7f75d3200700 1 Processor -- start 2024-09-13T17:24:53.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.943+0000 7f75d3200700 1 -- start start 2024-09-13T17:24:53.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d415aff0 0x7f75d40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75d40cdc00 0x7f75d40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d4070140 con 0x7f75d4144300 2024-09-13T17:24:53.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d40ce070 con 0x7f75d40cdc00 2024-09-13T17:24:53.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4070420 con 0x7f75d415aff0 2024-09-13T17:24:53.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75d40cdc00 0x7f75d40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75d40cdc00 0x7f75d40711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36648/0 (socket says 172.21.15.139:36648) 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 -- 172.21.15.139:0/628366944 learned_addr learned my addr 172.21.15.139:0/628366944 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75cbe00700 1 --2- 172.21.15.139:0/628366944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d415aff0 0x7f75d40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 -- 172.21.15.139:0/628366944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d415aff0 msgr2=0x7f75d40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 --2- 172.21.15.139:0/628366944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d415aff0 0x7f75d40cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 -- 172.21.15.139:0/628366944 >> v1:172.21.15.176:6789/0 conn(0x7f75d4144300 legacy=0x7f75d406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 -- 172.21.15.139:0/628366944 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4070700 con 0x7f75d40cdc00 2024-09-13T17:24:53.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d2800700 1 --2- 172.21.15.139:0/628366944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d40711e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009e50 tx=0x7f75cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e205d1f8502453aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d1400700 1 -- 172.21.15.139:0/628366944 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00e070 con 0x7f75d40cdc00 2024-09-13T17:24:53.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d1400700 1 -- 172.21.15.139:0/628366944 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00b910 con 0x7f75d40cdc00 2024-09-13T17:24:53.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d1400700 1 -- 172.21.15.139:0/628366944 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00bcc0 con 0x7f75d40cdc00 2024-09-13T17:24:53.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 -- 172.21.15.139:0/628366944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 msgr2=0x7f75d40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 --2- 172.21.15.139:0/628366944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d40711e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009e50 tx=0x7f75cc00b330 comp rx=0 tx=0).stop 2024-09-13T17:24:53.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.947+0000 7f75d3200700 1 -- 172.21.15.139:0/628366944 shutdown_connections 2024-09-13T17:24:53.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 --2- 172.21.15.139:0/628366944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d40711e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 --2- 172.21.15.139:0/628366944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d415aff0 0x7f75d40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 -- 172.21.15.139:0/628366944 >> 172.21.15.139:0/628366944 conn(0x7f75d40ce9d0 msgr2=0x7f75d40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:53.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 -- 172.21.15.139:0/628366944 shutdown_connections 2024-09-13T17:24:53.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 -- 172.21.15.139:0/628366944 wait complete. 2024-09-13T17:24:53.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 Processor -- start 2024-09-13T17:24:53.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.951+0000 7f75d3200700 1 -- start start 2024-09-13T17:24:53.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d4138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d4144300 0x7f75d41f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d415aff0 0x7f75d413a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4138ff0 con 0x7f75d40cdc00 2024-09-13T17:24:53.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d413e200 con 0x7f75d415aff0 2024-09-13T17:24:53.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d413e4e0 con 0x7f75d4144300 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d4138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d4138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36652/0 (socket says 172.21.15.139:36652) 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 -- 172.21.15.139:0/4103867956 learned_addr learned my addr 172.21.15.139:0/4103867956 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d2800700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d415aff0 0x7f75d413a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75cbe00700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d4144300 0x7f75d41f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 -- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d4144300 msgr2=0x7f75d41f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d4144300 0x7f75d41f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 -- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d415aff0 msgr2=0x7f75d413a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d415aff0 0x7f75d413a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 -- 172.21.15.139:0/4103867956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009b30 con 0x7f75d40cdc00 2024-09-13T17:24:53.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d1e00700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d4138ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c500 tx=0x7f75c400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40052d0 con 0x7f75d40cdc00 2024-09-13T17:24:53.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4005430 con 0x7f75d40cdc00 2024-09-13T17:24:53.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d413e7c0 con 0x7f75d40cdc00 2024-09-13T17:24:53.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40055a0 con 0x7f75d40cdc00 2024-09-13T17:24:53.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.955+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d413ed80 con 0x7f75d40cdc00 2024-09-13T17:24:53.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.959+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d41446e0 con 0x7f75d40cdc00 2024-09-13T17:24:53.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.959+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75c40038e0 con 0x7f75d40cdc00 2024-09-13T17:24:53.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.959+0000 7f75ca000700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75b0066730 0x7f75b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:53.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.959+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75c4083800 con 0x7f75d40cdc00 2024-09-13T17:24:53.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.959+0000 7f75cbe00700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75b0066730 0x7f75b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:53.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.963+0000 7f75cbe00700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75b0066730 0x7f75b0068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75d40ae1e0 tx=0x7f75bc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:53.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:53.967+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75c4050870 con 0x7f75d40cdc00 2024-09-13T17:24:54.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.211+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f75d40b36d0 con 0x7f75d40cdc00 2024-09-13T17:24:54.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.211+0000 7f75ca000700 1 -- 172.21.15.139:0/4103867956 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f75c4053e90 con 0x7f75d40cdc00 2024-09-13T17:24:54.214 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75b0066730 msgr2=0x7f75b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75b0066730 0x7f75b0068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75d40ae1e0 tx=0x7f75bc009240 comp rx=0 tx=0).stop 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 msgr2=0x7f75d4138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d4138ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c500 tx=0x7f75c400c810 comp rx=0 tx=0).stop 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 shutdown_connections 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f75b0066730 0x7f75b0068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d415aff0 0x7f75d413a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d4144300 0x7f75d41f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 --2- 172.21.15.139:0/4103867956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d40cdc00 0x7f75d4138ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:54.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 >> 172.21.15.139:0/4103867956 conn(0x7f75d40ce9d0 msgr2=0x7f75d40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:54.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 shutdown_connections 2024-09-13T17:24:54.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:54.215+0000 7f75d3200700 1 -- 172.21.15.139:0/4103867956 wait complete. 2024-09-13T17:24:54.242 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:24:54.242 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:24:54.242 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-13T17:24:54.243 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:24:54.243 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:54.243 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:24:54.243 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:24:54.243 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:24:54.243 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:24:54.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.243 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-13T17:24:54.255 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:24:54.255 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:24:54.255 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:24:54.255 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:54.255 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-13T17:24:54.255 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:24:54.256 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42425sec preferred_lft 42425sec 2024-09-13T17:24:54.257 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link 2024-09-13T17:24:54.257 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:54.257 INFO:teuthology.orchestra.run.smithi139.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:24:54.257 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:42:b9:61:11:da brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:54.257 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:24:54.257 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:54.258 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:24:54.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.258 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:54.258 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:54.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:24:54.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2024-09-13T17:24:54.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2024-09-13T17:24:54.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:24:54.259 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:54.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.410 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:24:54.443 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-13T17:24:54.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.446 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-13T17:24:54.506 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-13T17:24:54.506 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi139.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi139.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:24:54.507 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:24:54.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.508 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:54.508 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:54.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:24:54.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:24:54.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:24:54.509 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:54.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.644 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:24:54.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.662 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-09-13T17:24:54.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.724 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:54.725 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:54.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:24:54.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:24:54.725 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:54.837 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:24:54.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:24:54.838 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:54.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:54.980 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:54.980 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:54.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-09-13T17:24:54.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:24:54.980 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:55.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:55.047 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:55.061 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:24:55.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:55.061 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:55.120 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T17:24:55.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:55.255 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:55.255 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:24:55.987 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:55.988 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:24:55.988 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-13T17:24:55.988 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with new device syntax: 0@a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.cephfs=/ 2024-09-13T17:24:55.988 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.139:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-13T17:24:55.994 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:24:55.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:55.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:56.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.024 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:24:56.094 INFO:teuthology.orchestra.run.smithi139.stdout:client4789 2024-09-13T17:24:56.094 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:24:56.094 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:56.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.157 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:24:56.227 INFO:teuthology.orchestra.run.smithi139.stdout:client4789 2024-09-13T17:24:56.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.228 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:24:56.293 INFO:teuthology.orchestra.run.smithi139.stdout:client4789 2024-09-13T17:24:56.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.294 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.client4789/status') 2024-09-13T17:24:56.378 INFO:teuthology.orchestra.run.smithi139.stdout:instance: client.4789 (3)172.21.15.139:0/4030990792 2024-09-13T17:24:56.378 INFO:teuthology.orchestra.run.smithi139.stdout:blocklisted: false 2024-09-13T17:24:56.379 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records in 2024-09-13T17:24:56.379 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records out 2024-09-13T17:24:56.379 INFO:teuthology.orchestra.run.smithi139.stderr:71 bytes copied, 0.000102876 s, 690 kB/s 2024-09-13T17:24:56.381 INFO:tasks.kclient:client.2 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-13T17:24:56.381 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:24:56.382 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:24:56.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:24:56.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc820a00700 1 Processor -- start 2024-09-13T17:24:56.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc820a00700 1 -- start start 2024-09-13T17:24:56.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc820a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfd0 0x7fc81c13d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc820a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c13f0c0 con 0x7fc81c071190 2024-09-13T17:24:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc820a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c15e3e0 con 0x7fc81c071570 2024-09-13T17:24:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc820a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c15a720 con 0x7fc81c15dfd0 2024-09-13T17:24:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81b400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc81c071190 0x7fc81c159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60868/0 (socket says 172.21.15.139:60868) 2024-09-13T17:24:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81b400700 1 -- 172.21.15.139:0/294720846 learned_addr learned my addr 172.21.15.139:0/294720846 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81be00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfd0 0x7fc81c13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016397514 0 0) 0x7fc81c13f0c0 con 0x7fc81c071190 2024-09-13T17:24:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8000057e0 con 0x7fc81c071190 2024-09-13T17:24:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003066390 0 0) 0x7fc81c15e3e0 con 0x7fc81c071570 2024-09-13T17:24:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81c13f0c0 con 0x7fc81c071570 2024-09-13T17:24:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 288481030 0 0) 0x7fc8000057e0 con 0x7fc81c071190 2024-09-13T17:24:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfd0 msgr2=0x7fc81c13d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.595+0000 7fc81a000700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfd0 0x7fc81c13d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 >> v1:172.21.15.176:6789/0 conn(0x7fc81c071570 legacy=0x7fc81c13f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c15aa00 con 0x7fc81c071190 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7fc80c001690 con 0x7fc81c071190 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 >> v1:172.21.15.139:6789/0 conn(0x7fc81c071190 legacy=0x7fc81c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800005df0 0x7fc8000061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc800006a80 0x7fc800006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc800007440 0x7fc80000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c15a720 con 0x7fc800006a80 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80000e230 con 0x7fc800007440 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80000e3f0 con 0x7fc800005df0 2024-09-13T17:24:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc800006a80 0x7fc800006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81b400700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800005df0 0x7fc8000061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81be00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc800007440 0x7fc80000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 -- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800005df0 msgr2=0x7fc8000061f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800005df0 0x7fc8000061f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 -- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc800007440 msgr2=0x7fc80000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc800007440 0x7fc80000dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 -- 172.21.15.139:0/294720846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8000057e0 con 0x7fc800006a80 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81aa00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc800006a80 0x7fc800006f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc804001960 tx=0x7fc800007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9722331ab00bfd60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804001450 con 0x7fc800006a80 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8040052f0 con 0x7fc800006a80 2024-09-13T17:24:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81a000700 1 -- 172.21.15.139:0/294720846 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040036a0 con 0x7fc800006a80 2024-09-13T17:24:56.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc820a00700 1 -- 172.21.15.139:0/294720846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc800006a80 msgr2=0x7fc800006f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc820a00700 1 --2- 172.21.15.139:0/294720846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc800006a80 0x7fc800006f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc804001960 tx=0x7fc800007ab0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc81be00700 1 -- 172.21.15.139:0/294720846 reap_dead start 2024-09-13T17:24:56.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc820a00700 1 -- 172.21.15.139:0/294720846 shutdown_connections 2024-09-13T17:24:56.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc820a00700 1 -- 172.21.15.139:0/294720846 >> 172.21.15.139:0/294720846 conn(0x7fc81c0ce9d0 msgr2=0x7fc81c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc820a00700 1 -- 172.21.15.139:0/294720846 shutdown_connections 2024-09-13T17:24:56.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.599+0000 7fc820a00700 1 -- 172.21.15.139:0/294720846 wait complete. 2024-09-13T17:24:56.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 Processor -- start 2024-09-13T17:24:56.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 -- start start 2024-09-13T17:24:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800006a80 0x7fc81c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 0x7fc81c158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c0c9700 0x7fc81c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c12f1c0 con 0x7fc81c158960 2024-09-13T17:24:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c159320 con 0x7fc81c0c9700 2024-09-13T17:24:56.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc820a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0caa70 con 0x7fc800006a80 2024-09-13T17:24:56.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc81aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 0x7fc81c158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc81aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 0x7fc81c158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60210/0 (socket says 172.21.15.139:60210) 2024-09-13T17:24:56.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.603+0000 7fc81aa00700 1 -- 172.21.15.139:0/2158700563 learned_addr learned my addr 172.21.15.139:0/2158700563 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:56.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81b400700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800006a80 0x7fc81c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81be00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c0c9700 0x7fc81c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81aa00700 1 -- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800006a80 msgr2=0x7fc81c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81aa00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800006a80 0x7fc81c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81aa00700 1 -- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c0c9700 msgr2=0x7fc81c0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81aa00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c0c9700 0x7fc81c0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81aa00700 1 -- 172.21.15.139:0/2158700563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0ca4b0 con 0x7fc81c158960 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81b400700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800006a80 0x7fc81c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc81aa00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 0x7fc81c158de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c3c0 tx=0x7fc8040012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804006c90 con 0x7fc81c158960 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804006df0 con 0x7fc81c158960 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0ca790 con 0x7fc81c158960 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804007280 con 0x7fc81c158960 2024-09-13T17:24:56.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c153710 con 0x7fc81c158960 2024-09-13T17:24:56.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.607+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c13f810 con 0x7fc81c158960 2024-09-13T17:24:56.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.611+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8040073e0 con 0x7fc81c158960 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.611+0000 7fc813400700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc7f8066730 0x7fc7f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:56.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.611+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc804085260 con 0x7fc81c158960 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.611+0000 7fc81b400700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc7f8066730 0x7fc7f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.611+0000 7fc81b400700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc7f8066730 0x7fc7f8068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc80c001eb0 tx=0x7fc80c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:56.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.615+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc804055d60 con 0x7fc81c158960 2024-09-13T17:24:56.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.847+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc81c0742b0 con 0x7fc81c158960 2024-09-13T17:24:56.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc813400700 1 -- 172.21.15.139:0/2158700563 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc8040558f0 con 0x7fc81c158960 2024-09-13T17:24:56.853 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc7f8066730 msgr2=0x7fc7f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc7f8066730 0x7fc7f8068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc80c001eb0 tx=0x7fc80c009040 comp rx=0 tx=0).stop 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 msgr2=0x7fc81c158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 0x7fc81c158de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c3c0 tx=0x7fc8040012d0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 shutdown_connections 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc7f8066730 0x7fc7f8068bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c0c9700 0x7fc81c0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc81c158960 0x7fc81c158de0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 --2- 172.21.15.139:0/2158700563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc800006a80 0x7fc81c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:56.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 >> 172.21.15.139:0/2158700563 conn(0x7fc81c0ce9d0 msgr2=0x7fc81c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:56.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.851+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 shutdown_connections 2024-09-13T17:24:56.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:56.855+0000 7fc820a00700 1 -- 172.21.15.139:0/2158700563 wait complete. 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:24:56.876 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:24:56.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.877 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-13T17:24:56.892 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:24:56.892 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:24:56.892 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:24:56.892 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:56.893 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42422sec preferred_lft 42422sec 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link 2024-09-13T17:24:56.894 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:42:b9:61:11:da brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:4c:5d:43:32:1f brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::a889:91ff:fe7a:9b84/64 scope link 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:24:56.895 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:4c:5d:43:32:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:24:56.896 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::4c:5dff:fe43:321f/64 scope link tentative 2024-09-13T17:24:56.896 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:56.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.897 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:24:56.977 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-13T17:24:56.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:56.980 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-13T17:24:57.039 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:24:57.040 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:24:57.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.041 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:57.041 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:57.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:24:57.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:24:57.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:24:57.042 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:57.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.180 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:24:57.198 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:24:57.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.200 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-09-13T17:24:57.258 INFO:teuthology.orchestra.run.smithi139.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T17:24:57.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.259 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:57.259 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:57.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:24:57.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T17:24:57.260 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:57.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:24:57.409 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:24:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:24:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:24:57.409 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 92:4b:2e:f2:96:5e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::904b:2eff:fef2:965e/64 scope link 2024-09-13T17:24:57.410 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:24:57.494 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 92:4b:2e:f2:96:5e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::904b:2eff:fef2:965e/64 scope link 2024-09-13T17:24:57.495 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:57.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T17:24:57.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.499 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T17:24:57.500 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:57.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.680 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:24:57.680 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:24:57.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.1 up 2024-09-13T17:24:57.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:24:57.680 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:24:57.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:57.747 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T17:24:57.758 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:24:57.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:57.759 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:24:57.820 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-13T17:24:57.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:57.949 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:57.949 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:24:57.977 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:57.977 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:24:57.977 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-13T17:24:57.977 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with new device syntax: 2@a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.cephfs=/ 2024-09-13T17:24:57.977 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.139:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-13T17:24:57.986 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:24:57.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:24:58.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:58.017 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:24:58.087 INFO:teuthology.orchestra.run.smithi139.stdout:client4628 2024-09-13T17:24:58.087 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:24:58.088 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:58.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:58.150 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:24:58.217 INFO:teuthology.orchestra.run.smithi139.stdout:client4628 2024-09-13T17:24:58.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:58.218 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:24:58.286 INFO:teuthology.orchestra.run.smithi139.stdout:client4628 2024-09-13T17:24:58.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:58.286 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.client4628/status') 2024-09-13T17:24:58.369 INFO:teuthology.orchestra.run.smithi139.stdout:instance: client.4628 (3)172.21.15.139:0/3949632338 2024-09-13T17:24:58.369 INFO:teuthology.orchestra.run.smithi139.stdout:blocklisted: false 2024-09-13T17:24:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records in 2024-09-13T17:24:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records out 2024-09-13T17:24:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:71 bytes copied, 0.000171563 s, 414 kB/s 2024-09-13T17:24:58.372 INFO:tasks.kclient:client.1 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-13T17:24:58.372 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:24:58.372 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:24:58.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:24:58.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.587+0000 7f469be00700 1 Processor -- start 2024-09-13T17:24:58.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.587+0000 7f469be00700 1 -- start start 2024-09-13T17:24:58.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469be00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f469c13f810 0x7f469c13fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469be00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c13f0c0 con 0x7f469c071570 2024-09-13T17:24:58.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469be00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c15a720 con 0x7f469c13f810 2024-09-13T17:24:58.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15aa00 con 0x7f469c071190 2024-09-13T17:24:58.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f469c13f810 0x7f469c13fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469a000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f469c071570 0x7f469c159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60874/0 (socket says 172.21.15.139:60874) 2024-09-13T17:24:58.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469a000700 1 -- 172.21.15.139:0/3903915613 learned_addr learned my addr 172.21.15.139:0/3903915613 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:24:58.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469aa00700 1 --2- 172.21.15.139:0/3903915613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469b400700 1 -- 172.21.15.139:0/3903915613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 msgr2=0x7f469c15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:58.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469b400700 1 --2- 172.21.15.139:0/3903915613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469b400700 1 -- 172.21.15.139:0/3903915613 >> v1:172.21.15.139:6789/0 conn(0x7f469c071570 legacy=0x7f469c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469b400700 1 -- 172.21.15.139:0/3903915613 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c15ace0 con 0x7f469c13f810 2024-09-13T17:24:58.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f4699600700 1 -- 172.21.15.139:0/3903915613 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095712409 0 0) 0x7f469c13f0c0 con 0x7f469c071570 2024-09-13T17:24:58.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.591+0000 7f469b400700 1 --2- 172.21.15.139:0/3903915613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c13f810 0x7f469c13fc60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4694009d90 tx=0x7f469400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572680d66510617f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f4699600700 1 -- 172.21.15.139:0/3903915613 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400e070 con 0x7f469c13f810 2024-09-13T17:24:58.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f4699600700 1 -- 172.21.15.139:0/3903915613 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469400bb20 con 0x7f469c13f810 2024-09-13T17:24:58.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f4699600700 1 -- 172.21.15.139:0/3903915613 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694012430 con 0x7f469c13f810 2024-09-13T17:24:58.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 -- 172.21.15.139:0/3903915613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c13f810 msgr2=0x7f469c13fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 --2- 172.21.15.139:0/3903915613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c13f810 0x7f469c13fc60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4694009d90 tx=0x7f469400b330 comp rx=0 tx=0).stop 2024-09-13T17:24:58.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 -- 172.21.15.139:0/3903915613 shutdown_connections 2024-09-13T17:24:58.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 --2- 172.21.15.139:0/3903915613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c13f810 0x7f469c13fc60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 --2- 172.21.15.139:0/3903915613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 -- 172.21.15.139:0/3903915613 >> 172.21.15.139:0/3903915613 conn(0x7f469c0ce9d0 msgr2=0x7f469c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 -- 172.21.15.139:0/3903915613 shutdown_connections 2024-09-13T17:24:58.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.595+0000 7f469be00700 1 -- 172.21.15.139:0/3903915613 wait complete. 2024-09-13T17:24:58.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 Processor -- start 2024-09-13T17:24:58.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 -- start start 2024-09-13T17:24:58.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c1f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 0x7f469c13c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f469c13f810 0x7f469c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1f3520 con 0x7f469c071570 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c4340 con 0x7f469c13f810 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c3cd0 con 0x7f469c071190 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 0x7f469c13c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 0x7f469c13c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60232/0 (socket says 172.21.15.139:60232) 2024-09-13T17:24:58.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 -- 172.21.15.139:0/3303351843 learned_addr learned my addr 172.21.15.139:0/3303351843 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:24:58.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469aa00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c1f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 -- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 msgr2=0x7f469c1f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469b400700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f469c13f810 0x7f469c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c1f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 -- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f469c13f810 msgr2=0x7f469c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f469c13f810 0x7f469c0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 -- 172.21.15.139:0/3303351843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009a70 con 0x7f469c071570 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469b400700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f469c13f810 0x7f469c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.599+0000 7f469a000700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 0x7f469c13c3b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f468800c550 tx=0x7f468800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688004ca0 con 0x7f469c071570 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688004e00 con 0x7f469c071570 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c1415c0 con 0x7f469c071570 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688007310 con 0x7f469c071570 2024-09-13T17:24:58.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c13c8f0 con 0x7f469c071570 2024-09-13T17:24:58.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0ce7e0 con 0x7f469c071570 2024-09-13T17:24:58.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.603+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4688007470 con 0x7f469c071570 2024-09-13T17:24:58.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.607+0000 7f4692a00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f467c066730 0x7f467c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.607+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4688084130 con 0x7f469c071570 2024-09-13T17:24:58.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.607+0000 7f469aa00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f467c066730 0x7f467c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.607+0000 7f469aa00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f467c066730 0x7f467c068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f469c13cea0 tx=0x7f468c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.611+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4688051240 con 0x7f469c071570 2024-09-13T17:24:58.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.851+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f469c13d760 con 0x7f469c071570 2024-09-13T17:24:58.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.851+0000 7f4692a00700 1 -- 172.21.15.139:0/3303351843 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4688007720 con 0x7f469c071570 2024-09-13T17:24:58.856 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f467c066730 msgr2=0x7f467c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f467c066730 0x7f467c068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f469c13cea0 tx=0x7f468c008040 comp rx=0 tx=0).stop 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 msgr2=0x7f469c13c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 0x7f469c13c3b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f468800c550 tx=0x7f468800c910 comp rx=0 tx=0).stop 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 shutdown_connections 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f467c066730 0x7f467c068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f469c13f810 0x7f469c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f469c071570 0x7f469c13c3b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 --2- 172.21.15.139:0/3303351843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f469c071190 0x7f469c1f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 >> 172.21.15.139:0/3303351843 conn(0x7f469c0ce9d0 msgr2=0x7f469c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 shutdown_connections 2024-09-13T17:24:58.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:24:58.855+0000 7f469be00700 1 -- 172.21.15.139:0/3303351843 wait complete. 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:24:58.881 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:24:58.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:58.882 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:58.900 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:24:58.901 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42425sec preferred_lft 42425sec 2024-09-13T17:24:58.902 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-09-13T17:24:58.902 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:58.902 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:24:58.902 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:a6:ac:70:2c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:24:58.902 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:24:58.902 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:24:58.903 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:24:58.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:58.903 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:24:58.903 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:24:58.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:24:58.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-09-13T17:24:58.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-09-13T17:24:58.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:24:58.904 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:24:59.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.054 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:24:59.085 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-13T17:24:59.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.090 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:24:59.174 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:24:59.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.175 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:24:59.175 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:24:59.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:24:59.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:24:59.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:24:59.175 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:24:59.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.302 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-13T17:24:59.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.318 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-13T17:24:59.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.383 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:24:59.383 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:24:59.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:24:59.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T17:24:59.383 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:24:59.491 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T17:24:59.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T17:24:59.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T17:24:59.493 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:24:59.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.645 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:24:59.645 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:24:59.645 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-13T17:24:59.645 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:24:59.645 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:24:59.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:59.711 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:24:59.725 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:24:59.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:24:59.725 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:24:59.788 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T17:24:59.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:59.789 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:59.915 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:24:59.915 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:25:00.625 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:00.626 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:25:00.626 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-13T17:25:00.626 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 1@a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.cephfs=/ 2024-09-13T17:25:00.626 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.139:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-13T17:25:00.634 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:25:00.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:00.634 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:25:00.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:00.666 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:00.742 INFO:teuthology.orchestra.run.smithi176.stdout:client4798 2024-09-13T17:25:00.742 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:00.743 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:00.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:00.805 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:00.873 INFO:teuthology.orchestra.run.smithi176.stdout:client4798 2024-09-13T17:25:00.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:00.873 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:00.937 INFO:teuthology.orchestra.run.smithi176.stdout:client4798 2024-09-13T17:25:00.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:00.938 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.client4798/status') 2024-09-13T17:25:01.018 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4798 (3)192.168.0.1:0/1631703362 2024-09-13T17:25:01.018 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-13T17:25:01.019 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-13T17:25:01.019 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-13T17:25:01.019 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 0.000141825 s, 487 kB/s 2024-09-13T17:25:01.021 INFO:tasks.kclient:client.3 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-13T17:25:01.021 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:25:01.021 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:25:01.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:25:01.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 Processor -- start 2024-09-13T17:25:01.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 -- start start 2024-09-13T17:25:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc898071190 0x7fc89815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc89813f810 0x7fc89813fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89813f0c0 con 0x7fc898071570 2024-09-13T17:25:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89815a720 con 0x7fc898071190 2024-09-13T17:25:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc89d600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89815aa00 con 0x7fc89813f810 2024-09-13T17:25:01.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc897400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc898071570 0x7fc898159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60878/0 (socket says 172.21.15.139:60878) 2024-09-13T17:25:01.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc897400700 1 -- 172.21.15.139:0/372231349 learned_addr learned my addr 172.21.15.139:0/372231349 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:01.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.195+0000 7fc897e00700 1 --2- 172.21.15.139:0/372231349 >> v2:172.21.15.139:3300/0 conn(0x7fc898071190 0x7fc89815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89cc00700 1 --2- 172.21.15.139:0/372231349 >> v2:172.21.15.176:3300/0 conn(0x7fc89813f810 0x7fc89813fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc897e00700 1 -- 172.21.15.139:0/372231349 >> v2:172.21.15.176:3300/0 conn(0x7fc89813f810 msgr2=0x7fc89813fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc897e00700 1 --2- 172.21.15.139:0/372231349 >> v2:172.21.15.176:3300/0 conn(0x7fc89813f810 0x7fc89813fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc897e00700 1 -- 172.21.15.139:0/372231349 >> v1:172.21.15.139:6789/0 conn(0x7fc898071570 legacy=0x7fc898159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc897e00700 1 -- 172.21.15.139:0/372231349 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89815ace0 con 0x7fc898071190 2024-09-13T17:25:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc896a00700 1 -- 172.21.15.139:0/372231349 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121537714 0 0) 0x7fc89813f0c0 con 0x7fc898071570 2024-09-13T17:25:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc897e00700 1 --2- 172.21.15.139:0/372231349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc898071190 0x7fc89815dfd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc89813ced0 tx=0x7fc88800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a195190e0101985 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc896a00700 1 -- 172.21.15.139:0/372231349 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800e070 con 0x7fc898071190 2024-09-13T17:25:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc896a00700 1 -- 172.21.15.139:0/372231349 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800bb20 con 0x7fc898071190 2024-09-13T17:25:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc896a00700 1 -- 172.21.15.139:0/372231349 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888012430 con 0x7fc898071190 2024-09-13T17:25:01.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 -- 172.21.15.139:0/372231349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc898071190 msgr2=0x7fc89815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 --2- 172.21.15.139:0/372231349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc898071190 0x7fc89815dfd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc89813ced0 tx=0x7fc88800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:01.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 -- 172.21.15.139:0/372231349 shutdown_connections 2024-09-13T17:25:01.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 --2- 172.21.15.139:0/372231349 >> v2:172.21.15.176:3300/0 conn(0x7fc89813f810 0x7fc89813fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 --2- 172.21.15.139:0/372231349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc898071190 0x7fc89815dfd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 -- 172.21.15.139:0/372231349 >> 172.21.15.139:0/372231349 conn(0x7fc8980ce9d0 msgr2=0x7fc8980cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 -- 172.21.15.139:0/372231349 shutdown_connections 2024-09-13T17:25:01.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.199+0000 7fc89d600700 1 -- 172.21.15.139:0/372231349 wait complete. 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.203+0000 7fc89d600700 1 Processor -- start 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.203+0000 7fc89d600700 1 -- start start 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc898071190 0x7fc898156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc898071570 0x7fc898158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 0x7fc898154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981422d0 con 0x7fc89813f810 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc898156f60 con 0x7fc898071190 2024-09-13T17:25:01.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc898158ec0 con 0x7fc898071570 2024-09-13T17:25:01.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 0x7fc898154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 0x7fc898154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60258/0 (socket says 172.21.15.139:60258) 2024-09-13T17:25:01.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 -- 172.21.15.139:0/1319006474 learned_addr learned my addr 172.21.15.139:0/1319006474 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:01.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc897e00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc898071190 0x7fc898156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc897400700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc898071570 0x7fc898158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 -- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc898071570 msgr2=0x7fc898158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc898071570 0x7fc898158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 -- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc898071190 msgr2=0x7fc898156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc898071190 0x7fc898156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 -- 172.21.15.139:0/1319006474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009a70 con 0x7fc89813f810 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89cc00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 0x7fc898154e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e850 tx=0x7fc89000eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890013680 con 0x7fc89813f810 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc898159a10 con 0x7fc89813f810 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890013800 con 0x7fc89813f810 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890013bb0 con 0x7fc89813f810 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.207+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc898141c80 con 0x7fc89813f810 2024-09-13T17:25:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.211+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc898142480 con 0x7fc89813f810 2024-09-13T17:25:01.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.211+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc890013d10 con 0x7fc89813f810 2024-09-13T17:25:01.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.211+0000 7fc88fe00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc874066760 0x7fc874068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.211+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc890084500 con 0x7fc89813f810 2024-09-13T17:25:01.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.211+0000 7fc897e00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc874066760 0x7fc874068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.215+0000 7fc897e00700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc874066760 0x7fc874068c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc888014040 tx=0x7fc888011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.219+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc898142480 con 0x7fc89813f810 2024-09-13T17:25:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.451+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc898142480 con 0x7fc89813f810 2024-09-13T17:25:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.451+0000 7fc88fe00700 1 -- 172.21.15.139:0/1319006474 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc898142480 con 0x7fc89813f810 2024-09-13T17:25:01.455 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc874066760 msgr2=0x7fc874068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc874066760 0x7fc874068c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc888014040 tx=0x7fc888011000 comp rx=0 tx=0).stop 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 msgr2=0x7fc898154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 0x7fc898154e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e850 tx=0x7fc89000eb60 comp rx=0 tx=0).stop 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 shutdown_connections 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc874066760 0x7fc874068c20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc89813f810 0x7fc898154e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc898071570 0x7fc898158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 --2- 172.21.15.139:0/1319006474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc898071190 0x7fc898156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 >> 172.21.15.139:0/1319006474 conn(0x7fc8980ce9d0 msgr2=0x7fc89813c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 shutdown_connections 2024-09-13T17:25:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:01.455+0000 7fc89d600700 1 -- 172.21.15.139:0/1319006474 wait complete. 2024-09-13T17:25:01.479 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:25:01.479 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:25:01.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-13T17:25:01.479 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T17:25:01.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:25:01.480 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:25:01.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:25:01.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:25:01.480 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:25:01.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.480 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-13T17:25:01.501 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:25:01.501 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:25:01.501 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:25:01.501 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.501 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-13T17:25:01.501 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42422sec preferred_lft 42422sec 2024-09-13T17:25:01.502 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:a6:ac:70:2c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:da:9d:fb:c3:2d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::9cb2:3ff:fe57:396f/64 scope link 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:25:01.503 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:da:9d:fb:c3:2d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:25:01.504 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::5cda:9dff:fefb:c32d/64 scope link 2024-09-13T17:25:01.504 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:01.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.505 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:25:01.584 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-13T17:25:01.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.588 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:25:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:25:01.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.650 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:25:01.650 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:25:01.650 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:25:01.650 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:25:01.650 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:25:01.650 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:25:01.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.777 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-13T17:25:01.790 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:25:01.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.792 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-13T17:25:01.852 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T17:25:01.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.854 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:25:01.854 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:25:01.854 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:25:01.854 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T17:25:01.854 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:25:01.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:01.966 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:25:02.006 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 32:11:65:24:9f:f8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3011:65ff:fe24:9ff8/64 scope link 2024-09-13T17:25:02.007 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.011 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:25:02.082 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:25:02.082 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 32:11:65:24:9f:f8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3011:65ff:fe24:9ff8/64 scope link 2024-09-13T17:25:02.083 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:02.086 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T17:25:02.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T17:25:02.087 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:25:02.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.268 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-09-13T17:25:02.268 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-13T17:25:02.268 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-09-13T17:25:02.268 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:25:02.268 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-13T17:25:02.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:25:02.331 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T17:25:02.347 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:25:02.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:25:02.348 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:25:02.404 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-13T17:25:02.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.405 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:02.535 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:02.536 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:25:02.562 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:02.562 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:25:02.562 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-13T17:25:02.562 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 3@a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.cephfs=/ 2024-09-13T17:25:02.562 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.139:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-13T17:25:02.568 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:25:02.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:25:02.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.597 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:02.665 INFO:teuthology.orchestra.run.smithi176.stdout:client4807 2024-09-13T17:25:02.666 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:02.666 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:02.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.726 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:02.799 INFO:teuthology.orchestra.run.smithi176.stdout:client4807 2024-09-13T17:25:02.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.799 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:02.861 INFO:teuthology.orchestra.run.smithi176.stdout:client4807 2024-09-13T17:25:02.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:02.862 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.client4807/status') 2024-09-13T17:25:02.943 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4807 (3)192.168.0.2:0/1799457314 2024-09-13T17:25:02.943 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-13T17:25:02.943 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-13T17:25:02.943 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-13T17:25:02.943 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 0.000133608 s, 516 kB/s 2024-09-13T17:25:02.945 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T17:25:02.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:03.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 Processor -- start 2024-09-13T17:25:03.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 -- start start 2024-09-13T17:25:03.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c146690 0x7fcf5c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcf5c0d1740 0x7fcf5c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0b1740 con 0x7fcf5c15e030 2024-09-13T17:25:03.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0d08c0 con 0x7fcf5c0d1740 2024-09-13T17:25:03.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.131+0000 7fcf61c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c15e490 con 0x7fcf5c146690 2024-09-13T17:25:03.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcf5c0d1740 0x7fcf5c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcf5c0d1740 0x7fcf5c0b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60274/0 (socket says 172.21.15.139:60274) 2024-09-13T17:25:03.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 -- 172.21.15.139:0/1891390913 learned_addr learned my addr 172.21.15.139:0/1891390913 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:03.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf53e00700 1 --1- 172.21.15.139:0/1891390913 >> v1:172.21.15.176:6789/0 conn(0x7fcf5c15e030 0x7fcf5c0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:46118/0 (socket says 172.21.15.139:46118) 2024-09-13T17:25:03.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf5be00700 1 --2- 172.21.15.139:0/1891390913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c146690 0x7fcf5c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 -- 172.21.15.139:0/1891390913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c146690 msgr2=0x7fcf5c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:03.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 --2- 172.21.15.139:0/1891390913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c146690 0x7fcf5c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 -- 172.21.15.139:0/1891390913 >> v1:172.21.15.176:6789/0 conn(0x7fcf5c15e030 legacy=0x7fcf5c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 -- 172.21.15.139:0/1891390913 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0b1990 con 0x7fcf5c0d1740 2024-09-13T17:25:03.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61200700 1 --2- 172.21.15.139:0/1891390913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c0b2750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009e50 tx=0x7fcf5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7b170e0e639122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf5b400700 1 -- 172.21.15.139:0/1891390913 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400e070 con 0x7fcf5c0d1740 2024-09-13T17:25:03.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf5b400700 1 -- 172.21.15.139:0/1891390913 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5400b910 con 0x7fcf5c0d1740 2024-09-13T17:25:03.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf5b400700 1 -- 172.21.15.139:0/1891390913 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400bcc0 con 0x7fcf5c0d1740 2024-09-13T17:25:03.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 -- 172.21.15.139:0/1891390913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 msgr2=0x7fcf5c0b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1891390913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c0b2750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009e50 tx=0x7fcf5400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 -- 172.21.15.139:0/1891390913 shutdown_connections 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1891390913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c0b2750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1891390913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c146690 0x7fcf5c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 -- 172.21.15.139:0/1891390913 >> 172.21.15.139:0/1891390913 conn(0x7fcf5c071fa0 msgr2=0x7fcf5c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 -- 172.21.15.139:0/1891390913 shutdown_connections 2024-09-13T17:25:03.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.135+0000 7fcf61c00700 1 -- 172.21.15.139:0/1891390913 wait complete. 2024-09-13T17:25:03.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 Processor -- start 2024-09-13T17:25:03.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 -- start start 2024-09-13T17:25:03.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c1f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5c146690 0x7fcf5c1efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c15e030 0x7fcf5c144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c143310 con 0x7fcf5c0d1740 2024-09-13T17:25:03.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0ccfa0 con 0x7fcf5c146690 2024-09-13T17:25:03.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.139+0000 7fcf61c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1f3a20 con 0x7fcf5c15e030 2024-09-13T17:25:03.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c1f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c1f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60290/0 (socket says 172.21.15.139:60290) 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 -- 172.21.15.139:0/1413194226 learned_addr learned my addr 172.21.15.139:0/1413194226 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf53e00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5c146690 0x7fcf5c1efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf61200700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c15e030 0x7fcf5c144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 -- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c15e030 msgr2=0x7fcf5c144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c15e030 0x7fcf5c144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 -- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5c146690 msgr2=0x7fcf5c1efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5c146690 0x7fcf5c1efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 -- 172.21.15.139:0/1413194226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009b30 con 0x7fcf5c0d1740 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf61200700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c15e030 0x7fcf5c144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf5be00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c1f34e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00e9d0 tx=0x7fcf4c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c009720 con 0x7fcf5c0d1740 2024-09-13T17:25:03.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00c850 con 0x7fcf5c0d1740 2024-09-13T17:25:03.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c143730 con 0x7fcf5c0d1740 2024-09-13T17:25:03.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00cbc0 con 0x7fcf5c0d1740 2024-09-13T17:25:03.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c142970 con 0x7fcf5c0d1740 2024-09-13T17:25:03.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.143+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0677e0 con 0x7fcf5c0d1740 2024-09-13T17:25:03.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.147+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf4c00cd20 con 0x7fcf5c0d1740 2024-09-13T17:25:03.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.147+0000 7fcf58c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf38066730 0x7fcf38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.147+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf4c084650 con 0x7fcf5c0d1740 2024-09-13T17:25:03.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.147+0000 7fcf53e00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf38066730 0x7fcf38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.147+0000 7fcf53e00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf38066730 0x7fcf38068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0cc9c0 tx=0x7fcf44007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.155+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf4c0515f0 con 0x7fcf5c0d1740 2024-09-13T17:25:03.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.343+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5c146a70 con 0x7fcf5c0d1740 2024-09-13T17:25:03.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.343+0000 7fcf58c00700 1 -- 172.21.15.139:0/1413194226 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7fcf4c054c10 con 0x7fcf5c0d1740 2024-09-13T17:25:03.349 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:03.349 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf38066730 msgr2=0x7fcf38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf38066730 0x7fcf38068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0cc9c0 tx=0x7fcf44007d90 comp rx=0 tx=0).stop 2024-09-13T17:25:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 msgr2=0x7fcf5c1f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c1f34e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00e9d0 tx=0x7fcf4c00ed90 comp rx=0 tx=0).stop 2024-09-13T17:25:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 shutdown_connections 2024-09-13T17:25:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcf38066730 0x7fcf38068bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5c15e030 0x7fcf5c144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5c146690 0x7fcf5c1efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 --2- 172.21.15.139:0/1413194226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf5c0d1740 0x7fcf5c1f34e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 >> 172.21.15.139:0/1413194226 conn(0x7fcf5c071fa0 msgr2=0x7fcf5c15d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 shutdown_connections 2024-09-13T17:25:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.347+0000 7fcf61c00700 1 -- 172.21.15.139:0/1413194226 wait complete. 2024-09-13T17:25:03.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:03.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:03.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.547+0000 7feaf7c00700 1 Processor -- start 2024-09-13T17:25:03.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.547+0000 7feaf7c00700 1 -- start start 2024-09-13T17:25:03.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaf7c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feaf00b4740 0x7feaf00b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaf7c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaf7c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00b50d0 con 0x7feaf0146750 2024-09-13T17:25:03.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaf7c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf015ef00 con 0x7feaf00b4740 2024-09-13T17:25:03.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaf7c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00cfbd0 con 0x7feaf015f320 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feaf00b4740 0x7feaf00b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feaf00b4740 0x7feaf00b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60302/0 (socket says 172.21.15.139:60302) 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 -- 172.21.15.139:0/2525967196 learned_addr learned my addr 172.21.15.139:0/2525967196 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaf5c00700 1 --2- 172.21.15.139:0/2525967196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 -- 172.21.15.139:0/2525967196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 msgr2=0x7feaf015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 --2- 172.21.15.139:0/2525967196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 -- 172.21.15.139:0/2525967196 >> v1:172.21.15.176:6789/0 conn(0x7feaf0146750 legacy=0x7feaf00cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 -- 172.21.15.139:0/2525967196 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00a8720 con 0x7feaf00b4740 2024-09-13T17:25:03.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaefe00700 1 --2- 172.21.15.139:0/2525967196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00b4b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feadc009940 tx=0x7feadc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa41d4ba06e67e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaef400700 1 -- 172.21.15.139:0/2525967196 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011830 con 0x7feaf00b4740 2024-09-13T17:25:03.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaef400700 1 -- 172.21.15.139:0/2525967196 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc011990 con 0x7feaf00b4740 2024-09-13T17:25:03.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.551+0000 7feaef400700 1 -- 172.21.15.139:0/2525967196 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011d20 con 0x7feaf00b4740 2024-09-13T17:25:03.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 -- 172.21.15.139:0/2525967196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 msgr2=0x7feaf00b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 --2- 172.21.15.139:0/2525967196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00b4b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feadc009940 tx=0x7feadc009c50 comp rx=0 tx=0).stop 2024-09-13T17:25:03.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 -- 172.21.15.139:0/2525967196 shutdown_connections 2024-09-13T17:25:03.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 --2- 172.21.15.139:0/2525967196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 --2- 172.21.15.139:0/2525967196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00b4b90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 -- 172.21.15.139:0/2525967196 >> 172.21.15.139:0/2525967196 conn(0x7feaf0072050 msgr2=0x7feaf00b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:03.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 -- 172.21.15.139:0/2525967196 shutdown_connections 2024-09-13T17:25:03.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 -- 172.21.15.139:0/2525967196 wait complete. 2024-09-13T17:25:03.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.555+0000 7feaf7c00700 1 Processor -- start 2024-09-13T17:25:03.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 -- start start 2024-09-13T17:25:03.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf0146750 0x7feaf00ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf00ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00cdd70 con 0x7feaf00b4740 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00c5330 con 0x7feaf0146750 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf7c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00c7ad0 con 0x7feaf015f320 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60316/0 (socket says 172.21.15.139:60316) 2024-09-13T17:25:03.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 -- 172.21.15.139:0/1548010756 learned_addr learned my addr 172.21.15.139:0/1548010756 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:03.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaefe00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf0146750 0x7feaf00ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf00ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 -- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 msgr2=0x7feaf00ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf00ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 -- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf0146750 msgr2=0x7feaf00ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf0146750 0x7feaf00ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 -- 172.21.15.139:0/1548010756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc009570 con 0x7feaf00b4740 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaf5200700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00cac70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feae400c530 tx=0x7feae400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.559+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40052d0 con 0x7feaf00b4740 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.563+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4005430 con 0x7feaf00b4740 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.563+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40055a0 con 0x7feaf00b4740 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.563+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf00cd7b0 con 0x7feaf00b4740 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.563+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf00c4fc0 con 0x7feaf00b4740 2024-09-13T17:25:03.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.563+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf015df90 con 0x7feaf00b4740 2024-09-13T17:25:03.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.563+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feae40038e0 con 0x7feaf00b4740 2024-09-13T17:25:03.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.567+0000 7feaecc00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fead0066730 0x7fead0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.567+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feae40837f0 con 0x7feaf00b4740 2024-09-13T17:25:03.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.567+0000 7feaefe00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fead0066730 0x7fead0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.567+0000 7feaefe00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fead0066730 0x7fead0068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feadc009910 tx=0x7feadc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.571+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feae4050710 con 0x7feaf00b4740 2024-09-13T17:25:03.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.747+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feaf00b50d0 con 0x7feaf00b4740 2024-09-13T17:25:03.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.747+0000 7feaecc00700 1 -- 172.21.15.139:0/1548010756 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7feaf00b50d0 con 0x7feaf00b4740 2024-09-13T17:25:03.752 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fead0066730 msgr2=0x7fead0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fead0066730 0x7fead0068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feadc009910 tx=0x7feadc008030 comp rx=0 tx=0).stop 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 msgr2=0x7feaf00cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00cac70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feae400c530 tx=0x7feae400c840 comp rx=0 tx=0).stop 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 shutdown_connections 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fead0066730 0x7fead0068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feaf015f320 0x7feaf00ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf0146750 0x7feaf00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 --2- 172.21.15.139:0/1548010756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaf00b4740 0x7feaf00cac70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 >> 172.21.15.139:0/1548010756 conn(0x7feaf0072050 msgr2=0x7feaf00ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 shutdown_connections 2024-09-13T17:25:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.751+0000 7feaf7c00700 1 -- 172.21.15.139:0/1548010756 wait complete. 2024-09-13T17:25:03.777 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:03.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.955+0000 7f2cec400700 1 Processor -- start 2024-09-13T17:25:03.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.955+0000 7f2cec400700 1 -- start start 2024-09-13T17:25:03.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2cec400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce40702c0 0x7f2ce406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2cec400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40cb580 con 0x7f2ce4162550 2024-09-13T17:25:03.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2cec400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce4071e30 con 0x7f2ce4070db0 2024-09-13T17:25:03.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2cec400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40712b0 con 0x7f2ce40702c0 2024-09-13T17:25:03.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2ce4162550 0x7f2ce40706a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60880/0 (socket says 172.21.15.139:60880) 2024-09-13T17:25:03.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9000700 1 -- 172.21.15.139:0/3096346762 learned_addr learned my addr 172.21.15.139:0/3096346762 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:03.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9a00700 1 --2- 172.21.15.139:0/3096346762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce40702c0 0x7f2ce406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce3e00700 1 -- 172.21.15.139:0/3096346762 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134610056 0 0) 0x7f2cd0001110 con 0x7f2ce4162550 2024-09-13T17:25:03.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce3e00700 1 -- 172.21.15.139:0/3096346762 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ccc0035d0 con 0x7f2ce4162550 2024-09-13T17:25:03.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9a00700 1 -- 172.21.15.139:0/3096346762 >> v1:172.21.15.176:6789/0 conn(0x7f2ce4070db0 legacy=0x7f2ce415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce3e00700 1 -- 172.21.15.139:0/3096346762 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609494237 0 0) 0x7f2ccc0035d0 con 0x7f2ce4162550 2024-09-13T17:25:03.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9a00700 1 -- 172.21.15.139:0/3096346762 >> v1:172.21.15.139:6789/0 conn(0x7f2ce4162550 legacy=0x7f2ce40706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9a00700 1 -- 172.21.15.139:0/3096346762 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4071590 con 0x7f2ce40702c0 2024-09-13T17:25:03.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce9a00700 1 --2- 172.21.15.139:0/3096346762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce40702c0 0x7f2ce406d2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009880 tx=0x7f2cd8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8591117c57e3d664 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce3e00700 1 -- 172.21.15.139:0/3096346762 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0001800 con 0x7f2ce40702c0 2024-09-13T17:25:03.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce3e00700 1 -- 172.21.15.139:0/3096346762 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd8004030 con 0x7f2ce40702c0 2024-09-13T17:25:03.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2ce3e00700 1 -- 172.21.15.139:0/3096346762 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80043c0 con 0x7f2ce40702c0 2024-09-13T17:25:03.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2cec400700 1 -- 172.21.15.139:0/3096346762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce40702c0 msgr2=0x7f2ce406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.959+0000 7f2cec400700 1 --2- 172.21.15.139:0/3096346762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce40702c0 0x7f2ce406d2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009880 tx=0x7f2cd8009b90 comp rx=0 tx=0).stop 2024-09-13T17:25:03.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- 172.21.15.139:0/3096346762 shutdown_connections 2024-09-13T17:25:03.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 --2- 172.21.15.139:0/3096346762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce40702c0 0x7f2ce406d2a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- 172.21.15.139:0/3096346762 >> 172.21.15.139:0/3096346762 conn(0x7f2ce406b1e0 msgr2=0x7f2ce406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:03.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- 172.21.15.139:0/3096346762 shutdown_connections 2024-09-13T17:25:03.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- 172.21.15.139:0/3096346762 wait complete. 2024-09-13T17:25:03.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 Processor -- start 2024-09-13T17:25:03.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- start start 2024-09-13T17:25:03.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce40702c0 0x7f2ce41441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 0x7f2ce4137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce4162550 0x7f2ce40b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b2cb0 con 0x7f2ce4070db0 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b3830 con 0x7f2ce40702c0 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2cec400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b2170 con 0x7f2ce4162550 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2ce9000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 0x7f2ce4137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2ce9000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 0x7f2ce4137630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60332/0 (socket says 172.21.15.139:60332) 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2ce9000700 1 -- 172.21.15.139:0/2996428939 learned_addr learned my addr 172.21.15.139:0/2996428939 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:03.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.963+0000 7f2ce9a00700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce40702c0 0x7f2ce41441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2cea400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce4162550 0x7f2ce40b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce9000700 1 -- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce4162550 msgr2=0x7f2ce40b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce9000700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce4162550 0x7f2ce40b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce9000700 1 -- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce40702c0 msgr2=0x7f2ce41441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce9000700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce40702c0 0x7f2ce41441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce9000700 1 -- 172.21.15.139:0/2996428939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd80094b0 con 0x7f2ce4070db0 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce9000700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 0x7f2ce4137630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c730 tx=0x7f2cd000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0004ca0 con 0x7f2ce4070db0 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40b2f00 con 0x7f2ce4070db0 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0004e00 con 0x7f2ce4070db0 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0007310 con 0x7f2ce4070db0 2024-09-13T17:25:03.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40b34c0 con 0x7f2ce4070db0 2024-09-13T17:25:03.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.967+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce40706a0 con 0x7f2ce4070db0 2024-09-13T17:25:03.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.971+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cd0007470 con 0x7f2ce4070db0 2024-09-13T17:25:03.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.971+0000 7f2ce1600700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2cc4066730 0x7f2cc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:03.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.971+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2cd0084130 con 0x7f2ce4070db0 2024-09-13T17:25:03.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.971+0000 7f2ce9a00700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2cc4066730 0x7f2cc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:03.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.971+0000 7f2ce9a00700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2cc4066730 0x7f2cc4068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80090b0 tx=0x7f2cd8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:03.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:03.979+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2cd0051050 con 0x7f2ce4070db0 2024-09-13T17:25:04.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.159+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ce40cb580 con 0x7f2ce4070db0 2024-09-13T17:25:04.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.159+0000 7f2ce1600700 1 -- 172.21.15.139:0/2996428939 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cd0007720 con 0x7f2ce4070db0 2024-09-13T17:25:04.164 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:04.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2cc4066730 msgr2=0x7f2cc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2cc4066730 0x7f2cc4068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80090b0 tx=0x7f2cd8010000 comp rx=0 tx=0).stop 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 msgr2=0x7f2ce4137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 0x7f2ce4137630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c730 tx=0x7f2cd000ca40 comp rx=0 tx=0).stop 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 shutdown_connections 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2cc4066730 0x7f2cc4068bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce4162550 0x7f2ce40b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ce4070db0 0x7f2ce4137630 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 --2- 172.21.15.139:0/2996428939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce40702c0 0x7f2ce41441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 >> 172.21.15.139:0/2996428939 conn(0x7f2ce406b1e0 msgr2=0x7f2ce406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:04.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 shutdown_connections 2024-09-13T17:25:04.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.163+0000 7f2cec400700 1 -- 172.21.15.139:0/2996428939 wait complete. 2024-09-13T17:25:04.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:04.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 Processor -- start 2024-09-13T17:25:04.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 -- start start 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f08e40b3280 0x7f08e40cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08e40cd450 0x7f08e4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40cd8a0 con 0x7f08e414a6d0 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e4071ff0 con 0x7f08e40b3280 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.355+0000 7f08e3e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e414aab0 con 0x7f08e40cd450 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f08e40b3280 0x7f08e40cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f08e40b3280 0x7f08e40cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60346/0 (socket says 172.21.15.139:60346) 2024-09-13T17:25:04.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 -- 172.21.15.139:0/3422068528 learned_addr learned my addr 172.21.15.139:0/3422068528 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:04.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3400700 1 --2- 172.21.15.139:0/3422068528 >> v2:172.21.15.176:3300/0 conn(0x7f08e40cd450 0x7f08e4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 -- 172.21.15.139:0/3422068528 >> v2:172.21.15.176:3300/0 conn(0x7f08e40cd450 msgr2=0x7f08e4071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:04.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 --2- 172.21.15.139:0/3422068528 >> v2:172.21.15.176:3300/0 conn(0x7f08e40cd450 0x7f08e4071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 -- 172.21.15.139:0/3422068528 >> v1:172.21.15.176:6789/0 conn(0x7f08e414a6d0 legacy=0x7f08e40b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 -- 172.21.15.139:0/3422068528 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40cc3b0 con 0x7f08e40b3280 2024-09-13T17:25:04.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08da000700 1 --2- 172.21.15.139:0/3422068528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e40b3280 0x7f08e40cbd40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f08e40b1af0 tx=0x7f08cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52baffc19b18975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:04.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e2000700 1 -- 172.21.15.139:0/3422068528 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00b8a0 con 0x7f08e40b3280 2024-09-13T17:25:04.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e2000700 1 -- 172.21.15.139:0/3422068528 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00ba00 con 0x7f08e40b3280 2024-09-13T17:25:04.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e2000700 1 -- 172.21.15.139:0/3422068528 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00bd90 con 0x7f08e40b3280 2024-09-13T17:25:04.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 -- 172.21.15.139:0/3422068528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e40b3280 msgr2=0x7f08e40cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 --2- 172.21.15.139:0/3422068528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e40b3280 0x7f08e40cbd40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f08e40b1af0 tx=0x7f08cc009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 -- 172.21.15.139:0/3422068528 shutdown_connections 2024-09-13T17:25:04.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 --2- 172.21.15.139:0/3422068528 >> v2:172.21.15.176:3300/0 conn(0x7f08e40cd450 0x7f08e4071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 --2- 172.21.15.139:0/3422068528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e40b3280 0x7f08e40cbd40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 -- 172.21.15.139:0/3422068528 >> 172.21.15.139:0/3422068528 conn(0x7f08e40ce9d0 msgr2=0x7f08e40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:04.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 -- 172.21.15.139:0/3422068528 shutdown_connections 2024-09-13T17:25:04.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.359+0000 7f08e3e00700 1 -- 172.21.15.139:0/3422068528 wait complete. 2024-09-13T17:25:04.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.363+0000 7f08e3e00700 1 Processor -- start 2024-09-13T17:25:04.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.363+0000 7f08e3e00700 1 -- start start 2024-09-13T17:25:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e40b3280 0x7f08e40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e40cd450 0x7f08e41450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 0x7f08e41f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e41455e0 con 0x7f08e414a6d0 2024-09-13T17:25:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40c5580 con 0x7f08e40b3280 2024-09-13T17:25:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e406b0b0 con 0x7f08e40cd450 2024-09-13T17:25:04.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 0x7f08e41f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 0x7f08e41f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60348/0 (socket says 172.21.15.139:60348) 2024-09-13T17:25:04.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 -- 172.21.15.139:0/250976132 learned_addr learned my addr 172.21.15.139:0/250976132 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:04.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e2a00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e40b3280 0x7f08e40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08da000700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e40cd450 0x7f08e41450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 -- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e40cd450 msgr2=0x7f08e41450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e40cd450 0x7f08e41450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 -- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e40b3280 msgr2=0x7f08e40c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e40b3280 0x7f08e40c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 -- 172.21.15.139:0/250976132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc009570 con 0x7f08e414a6d0 2024-09-13T17:25:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3400700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 0x7f08e41f9cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f08dc007e70 tx=0x7f08dc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc00ed30 con 0x7f08e414a6d0 2024-09-13T17:25:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc00eeb0 con 0x7f08e414a6d0 2024-09-13T17:25:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc014640 con 0x7f08e414a6d0 2024-09-13T17:25:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e40c52a0 con 0x7f08e414a6d0 2024-09-13T17:25:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.367+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e406ad40 con 0x7f08e414a6d0 2024-09-13T17:25:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.371+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e406b1f0 con 0x7f08e414a6d0 2024-09-13T17:25:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.371+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08dc0147a0 con 0x7f08e414a6d0 2024-09-13T17:25:04.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.371+0000 7f08dbe00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f08c0066730 0x7f08c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.371+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08dc084b70 con 0x7f08e414a6d0 2024-09-13T17:25:04.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.371+0000 7f08e2a00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f08c0066730 0x7f08c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.371+0000 7f08e2a00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f08c0066730 0x7f08c0068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08d4001800 tx=0x7f08d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.379+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08dc051bb0 con 0x7f08e414a6d0 2024-09-13T17:25:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.559+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08e40b1dc0 con 0x7f08e414a6d0 2024-09-13T17:25:04.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.559+0000 7f08dbe00700 1 -- 172.21.15.139:0/250976132 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08dc0551d0 con 0x7f08e414a6d0 2024-09-13T17:25:04.562 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f08c0066730 msgr2=0x7f08c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f08c0066730 0x7f08c0068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08d4001800 tx=0x7f08d4009040 comp rx=0 tx=0).stop 2024-09-13T17:25:04.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 msgr2=0x7f08e41f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 0x7f08e41f9cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f08dc007e70 tx=0x7f08dc00e3c0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 shutdown_connections 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f08c0066730 0x7f08c0068bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08e414a6d0 0x7f08e41f9cf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e40cd450 0x7f08e41450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 --2- 172.21.15.139:0/250976132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e40b3280 0x7f08e40c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 >> 172.21.15.139:0/250976132 conn(0x7f08e40ce9d0 msgr2=0x7f08e4148cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 shutdown_connections 2024-09-13T17:25:04.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.563+0000 7f08e3e00700 1 -- 172.21.15.139:0/250976132 wait complete. 2024-09-13T17:25:04.588 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:04.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.755+0000 7f5144a00700 1 Processor -- start 2024-09-13T17:25:04.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f5144a00700 1 -- start start 2024-09-13T17:25:04.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f5144a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f514015a530 0x7f5140164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f5144a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514015ab80 con 0x7f51400b3c00 2024-09-13T17:25:04.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f5144a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514006c680 con 0x7f514006d160 2024-09-13T17:25:04.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f5144a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514015ae60 con 0x7f514015a530 2024-09-13T17:25:04.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f513f400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f51400b3c00 0x7f51400b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58580/0 (socket says 172.21.15.139:58580) 2024-09-13T17:25:04.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f513f400700 1 -- 172.21.15.139:0/971420182 learned_addr learned my addr 172.21.15.139:0/971420182 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:04.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.759+0000 7f513fe00700 1 --2- 172.21.15.139:0/971420182 >> v2:172.21.15.139:3300/0 conn(0x7f514015a530 0x7f5140164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144255505 0 0) 0x7f514015ab80 con 0x7f51400b3c00 2024-09-13T17:25:04.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51240057e0 con 0x7f51400b3c00 2024-09-13T17:25:04.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1242632527 0 0) 0x7f51240057e0 con 0x7f51400b3c00 2024-09-13T17:25:04.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 >> v2:172.21.15.139:3300/0 conn(0x7f514015a530 msgr2=0x7f5140164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:04.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 --2- 172.21.15.139:0/971420182 >> v2:172.21.15.139:3300/0 conn(0x7f514015a530 0x7f5140164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 >> v1:172.21.15.176:6789/0 conn(0x7f514006d160 legacy=0x7f5140159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514006c960 con 0x7f51400b3c00 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f5130001670 con 0x7f51400b3c00 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 >> v1:172.21.15.139:6789/0 conn(0x7f51400b3c00 legacy=0x7f51400b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5124005c30 0x7f5124006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5124006a80 0x7f5124006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124007440 0x7f512400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514015ae60 con 0x7f5124005c30 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512400e2e0 con 0x7f5124006a80 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512400e4a0 con 0x7f5124007440 2024-09-13T17:25:04.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5124005c30 0x7f5124006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513ea00700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5124006a80 0x7f5124006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513fe00700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124007440 0x7f512400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 -- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124007440 msgr2=0x7f512400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124007440 0x7f512400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 -- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5124006a80 msgr2=0x7f5124006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5124006a80 0x7f5124006f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 -- 172.21.15.139:0/971420182 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240057e0 con 0x7f5124005c30 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513fe00700 1 -- 172.21.15.139:0/971420182 reap_dead start 2024-09-13T17:25:04.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513f400700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5124005c30 0x7f5124006050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f513000c320 tx=0x7f5124007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4156a98e3bd1f6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130007c30 con 0x7f5124005c30 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513000ce40 con 0x7f5124005c30 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.763+0000 7f513e000700 1 -- 172.21.15.139:0/971420182 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130005bc0 con 0x7f5124005c30 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 -- 172.21.15.139:0/971420182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5124005c30 msgr2=0x7f5124006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5124005c30 0x7f5124006050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f513000c320 tx=0x7f5124007ab0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 -- 172.21.15.139:0/971420182 shutdown_connections 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 --2- 172.21.15.139:0/971420182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5124005c30 0x7f5124006050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 -- 172.21.15.139:0/971420182 >> 172.21.15.139:0/971420182 conn(0x7f514006ed30 msgr2=0x7f51400b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 -- 172.21.15.139:0/971420182 shutdown_connections 2024-09-13T17:25:04.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 -- 172.21.15.139:0/971420182 wait complete. 2024-09-13T17:25:04.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.767+0000 7f5144a00700 1 Processor -- start 2024-09-13T17:25:04.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 -- start start 2024-09-13T17:25:04.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124005c30 0x7f514013dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5140150110 0x7f5140153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 0x7f51400b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b0710 con 0x7f51400afd50 2024-09-13T17:25:04.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140155f20 con 0x7f5140150110 2024-09-13T17:25:04.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5140156170 con 0x7f5124005c30 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 0x7f51400b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 0x7f51400b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51646/0 (socket says 172.21.15.139:51646) 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 -- 172.21.15.139:0/682106439 learned_addr learned my addr 172.21.15.139:0/682106439 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513f400700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124005c30 0x7f514013dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513ea00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5140150110 0x7f5140153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 -- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124005c30 msgr2=0x7f514013dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124005c30 0x7f514013dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 -- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5140150110 msgr2=0x7f5140153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5140150110 0x7f5140153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 -- 172.21.15.139:0/682106439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140156450 con 0x7f51400afd50 2024-09-13T17:25:04.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513ea00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5140150110 0x7f5140153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:04.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f513fe00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 0x7f51400b01d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f514006ab60 tx=0x7f5138011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:04.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513800e040 con 0x7f51400afd50 2024-09-13T17:25:04.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513800f040 con 0x7f51400afd50 2024-09-13T17:25:04.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513800fc40 con 0x7f51400afd50 2024-09-13T17:25:04.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5140156730 con 0x7f51400afd50 2024-09-13T17:25:04.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.771+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140156cf0 con 0x7f51400afd50 2024-09-13T17:25:04.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.775+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5140154200 con 0x7f51400afd50 2024-09-13T17:25:04.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.775+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5138015430 con 0x7f51400afd50 2024-09-13T17:25:04.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.775+0000 7f5137400700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5120066730 0x7f5120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:04.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.775+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5138084d10 con 0x7f51400afd50 2024-09-13T17:25:04.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.779+0000 7f513f400700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5120066730 0x7f5120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:04.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.779+0000 7f513f400700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5120066730 0x7f5120068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5130000c00 tx=0x7f5130006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:04.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.783+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5138051cd0 con 0x7f51400afd50 2024-09-13T17:25:04.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.963+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f514015ab80 con 0x7f51400afd50 2024-09-13T17:25:04.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.963+0000 7f5137400700 1 -- 172.21.15.139:0/682106439 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f51380552f0 con 0x7f51400afd50 2024-09-13T17:25:04.967 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5120066730 msgr2=0x7f5120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5120066730 0x7f5120068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5130000c00 tx=0x7f5130006040 comp rx=0 tx=0).stop 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 msgr2=0x7f51400b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 0x7f51400b01d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f514006ab60 tx=0x7f5138011e20 comp rx=0 tx=0).stop 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 shutdown_connections 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5120066730 0x7f5120068bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51400afd50 0x7f51400b01d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5140150110 0x7f5140153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 --2- 172.21.15.139:0/682106439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5124005c30 0x7f514013dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:04.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 >> 172.21.15.139:0/682106439 conn(0x7f514006ed30 msgr2=0x7f5140157b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:04.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 shutdown_connections 2024-09-13T17:25:04.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:04.967+0000 7f5144a00700 1 -- 172.21.15.139:0/682106439 wait complete. 2024-09-13T17:25:04.992 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:05.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.155+0000 7fb3a4c00700 1 Processor -- start 2024-09-13T17:25:05.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.155+0000 7fb3a4c00700 1 -- start start 2024-09-13T17:25:05.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb3a4c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb3a00cee30 0x7fb3a006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb3a4c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a015aad0 con 0x7fb3a015cf00 2024-09-13T17:25:05.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb3a4c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a006be80 con 0x7fb3a015da80 2024-09-13T17:25:05.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb3a4c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a006c160 con 0x7fb3a00cee30 2024-09-13T17:25:05.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb3a00cee30 0x7fb3a006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb3a00cee30 0x7fb3a006b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51656/0 (socket says 172.21.15.139:51656) 2024-09-13T17:25:05.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 -- 172.21.15.139:0/3788411435 learned_addr learned my addr 172.21.15.139:0/3788411435 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:05.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39d400700 1 --1- 172.21.15.139:0/3788411435 >> v1:172.21.15.139:6789/0 conn(0x7fb3a015cf00 0x7fb3a015d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58596/0 (socket says 172.21.15.139:58596) 2024-09-13T17:25:05.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 -- 172.21.15.139:0/3788411435 >> v1:172.21.15.176:6789/0 conn(0x7fb3a015da80 legacy=0x7fb3a015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 -- 172.21.15.139:0/3788411435 >> v1:172.21.15.139:6789/0 conn(0x7fb3a015cf00 legacy=0x7fb3a015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 -- 172.21.15.139:0/3788411435 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a006c440 con 0x7fb3a00cee30 2024-09-13T17:25:05.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39ca00700 1 -- 172.21.15.139:0/3788411435 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549026434 0 0) 0x7fb3a015aad0 con 0x7fb3a015cf00 2024-09-13T17:25:05.164 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39de00700 1 --2- 172.21.15.139:0/3788411435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a00cee30 0x7fb3a006b5e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb390009910 tx=0x7fb390009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19144a26a2065ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:05.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39ca00700 1 -- 172.21.15.139:0/3788411435 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000ba60 con 0x7fb3a00cee30 2024-09-13T17:25:05.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39ca00700 1 -- 172.21.15.139:0/3788411435 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39000bbc0 con 0x7fb3a00cee30 2024-09-13T17:25:05.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.159+0000 7fb39ca00700 1 -- 172.21.15.139:0/3788411435 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390009e60 con 0x7fb3a00cee30 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 -- 172.21.15.139:0/3788411435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a00cee30 msgr2=0x7fb3a006b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/3788411435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a00cee30 0x7fb3a006b5e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb390009910 tx=0x7fb390009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 -- 172.21.15.139:0/3788411435 shutdown_connections 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/3788411435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a00cee30 0x7fb3a006b5e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 -- 172.21.15.139:0/3788411435 >> 172.21.15.139:0/3788411435 conn(0x7fb3a006e060 msgr2=0x7fb3a006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 -- 172.21.15.139:0/3788411435 shutdown_connections 2024-09-13T17:25:05.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 -- 172.21.15.139:0/3788411435 wait complete. 2024-09-13T17:25:05.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 Processor -- start 2024-09-13T17:25:05.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.163+0000 7fb3a4c00700 1 -- start start 2024-09-13T17:25:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a00cee30 0x7fb3a014fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 0x7fb3a00cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a015da80 0x7fb3a00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a01f3690 con 0x7fb3a015cf00 2024-09-13T17:25:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a01f6790 con 0x7fb3a015da80 2024-09-13T17:25:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a01f5e60 con 0x7fb3a00cee30 2024-09-13T17:25:05.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 0x7fb3a00cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 0x7fb3a00cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51662/0 (socket says 172.21.15.139:51662) 2024-09-13T17:25:05.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 -- 172.21.15.139:0/2994601438 learned_addr learned my addr 172.21.15.139:0/2994601438 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:05.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39de00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a00cee30 0x7fb3a014fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39e800700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a015da80 0x7fb3a00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 -- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a00cee30 msgr2=0x7fb3a014fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a00cee30 0x7fb3a014fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 -- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a015da80 msgr2=0x7fb3a00cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a015da80 0x7fb3a00cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 -- 172.21.15.139:0/2994601438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390009570 con 0x7fb3a015cf00 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb39d400700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 0x7fb3a00cab70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c550 tx=0x7fb38c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c004ca0 con 0x7fb3a015cf00 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c004e00 con 0x7fb3a015cf00 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a01f6140 con 0x7fb3a015cf00 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c007310 con 0x7fb3a015cf00 2024-09-13T17:25:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.167+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a01501d0 con 0x7fb3a015cf00 2024-09-13T17:25:05.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.171+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a01f6940 con 0x7fb3a015cf00 2024-09-13T17:25:05.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.171+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb38c007470 con 0x7fb3a015cf00 2024-09-13T17:25:05.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.175+0000 7fb396000700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb380066730 0x7fb380068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.175+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb38c0840e0 con 0x7fb3a015cf00 2024-09-13T17:25:05.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.175+0000 7fb39de00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb380066730 0x7fb380068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.175+0000 7fb39de00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb380066730 0x7fb380068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb390009c60 tx=0x7fb39001b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:05.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.179+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3a01f6940 con 0x7fb3a015cf00 2024-09-13T17:25:05.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.367+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3a01f6900 con 0x7fb3a015cf00 2024-09-13T17:25:05.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.371+0000 7fb396000700 1 -- 172.21.15.139:0/2994601438 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7fb38c051080 con 0x7fb3a015cf00 2024-09-13T17:25:05.375 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:05.375 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:05.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb380066730 msgr2=0x7fb380068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb380066730 0x7fb380068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb390009c60 tx=0x7fb39001b040 comp rx=0 tx=0).stop 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 msgr2=0x7fb3a00cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 0x7fb3a00cab70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c550 tx=0x7fb38c00c860 comp rx=0 tx=0).stop 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 shutdown_connections 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb380066730 0x7fb380068bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a015da80 0x7fb3a00cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a015cf00 0x7fb3a00cab70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 --2- 172.21.15.139:0/2994601438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a00cee30 0x7fb3a014fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 >> 172.21.15.139:0/2994601438 conn(0x7fb3a006e060 msgr2=0x7fb3a00b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 shutdown_connections 2024-09-13T17:25:05.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.375+0000 7fb3a4c00700 1 -- 172.21.15.139:0/2994601438 wait complete. 2024-09-13T17:25:05.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:05.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:05.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.579+0000 7fd5d7a00700 1 Processor -- start 2024-09-13T17:25:05.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.579+0000 7fd5d7a00700 1 -- start start 2024-09-13T17:25:05.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d7a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5d015ab30 0x7fd5d00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d7a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015af10 0x7fd5d00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d7a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00b6340 con 0x7fd5d015f530 2024-09-13T17:25:05.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d7a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00b3de0 con 0x7fd5d015ab30 2024-09-13T17:25:05.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d7a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00b6070 con 0x7fd5d015af10 2024-09-13T17:25:05.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cfe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015af10 0x7fd5d00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d5a00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd5d015f530 0x7fd5d00d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:60858/0 (socket says 172.21.15.139:60858) 2024-09-13T17:25:05.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d5a00700 1 -- 172.21.15.139:0/3487084411 learned_addr learned my addr 172.21.15.139:0/3487084411 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:05.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5d5000700 1 --2- 172.21.15.139:0/3487084411 >> v2:172.21.15.176:3300/0 conn(0x7fd5d015ab30 0x7fd5d00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cf400700 1 -- 172.21.15.139:0/3487084411 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163598605 0 0) 0x7fd5d00b6340 con 0x7fd5d015f530 2024-09-13T17:25:05.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cf400700 1 -- 172.21.15.139:0/3487084411 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b80035d0 con 0x7fd5d015f530 2024-09-13T17:25:05.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cfe00700 1 -- 172.21.15.139:0/3487084411 >> v2:172.21.15.176:3300/0 conn(0x7fd5d015ab30 msgr2=0x7fd5d00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:05.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cfe00700 1 --2- 172.21.15.139:0/3487084411 >> v2:172.21.15.176:3300/0 conn(0x7fd5d015ab30 0x7fd5d00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cfe00700 1 -- 172.21.15.139:0/3487084411 >> v1:172.21.15.176:6789/0 conn(0x7fd5d015f530 legacy=0x7fd5d00d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cfe00700 1 -- 172.21.15.139:0/3487084411 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d006f730 con 0x7fd5d015af10 2024-09-13T17:25:05.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cfe00700 1 --2- 172.21.15.139:0/3487084411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015af10 0x7fd5d00cf340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009850 tx=0x7fd5bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7bc0a86f5c38aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:05.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cf400700 1 -- 172.21.15.139:0/3487084411 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc011830 con 0x7fd5d015af10 2024-09-13T17:25:05.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cf400700 1 -- 172.21.15.139:0/3487084411 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc011990 con 0x7fd5d015af10 2024-09-13T17:25:05.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.583+0000 7fd5cf400700 1 -- 172.21.15.139:0/3487084411 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc011d40 con 0x7fd5d015af10 2024-09-13T17:25:05.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3487084411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015af10 msgr2=0x7fd5d00cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3487084411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015af10 0x7fd5d00cf340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009850 tx=0x7fd5bc009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:05.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3487084411 shutdown_connections 2024-09-13T17:25:05.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3487084411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015af10 0x7fd5d00cf340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3487084411 >> v2:172.21.15.176:3300/0 conn(0x7fd5d015ab30 0x7fd5d00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3487084411 >> 172.21.15.139:0/3487084411 conn(0x7fd5d006a390 msgr2=0x7fd5d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:05.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3487084411 shutdown_connections 2024-09-13T17:25:05.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.587+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3487084411 wait complete. 2024-09-13T17:25:05.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 Processor -- start 2024-09-13T17:25:05.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 -- start start 2024-09-13T17:25:05.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 0x7fd5d0151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d015af10 0x7fd5d01f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015f530 0x7fd5d0155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01f28c0 con 0x7fd5d015ab30 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0153c30 con 0x7fd5d015af10 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d7a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0152290 con 0x7fd5d015f530 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 0x7fd5d0151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 0x7fd5d0151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51666/0 (socket says 172.21.15.139:51666) 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 -- 172.21.15.139:0/3400055297 learned_addr learned my addr 172.21.15.139:0/3400055297 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5cfe00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d015af10 0x7fd5d01f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015f530 0x7fd5d0155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 -- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015f530 msgr2=0x7fd5d0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015f530 0x7fd5d0155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 -- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d015af10 msgr2=0x7fd5d01f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d015af10 0x7fd5d01f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.591+0000 7fd5d5000700 1 -- 172.21.15.139:0/3400055297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0094b0 con 0x7fd5d015ab30 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5d5000700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 0x7fd5d0151d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e840 tx=0x7fd5c400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40095a0 con 0x7fd5d015ab30 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c4013680 con 0x7fd5d015ab30 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d0153390 con 0x7fd5d015ab30 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40139f0 con 0x7fd5d015ab30 2024-09-13T17:25:05.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d0153950 con 0x7fd5d015ab30 2024-09-13T17:25:05.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.595+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d01f2b30 con 0x7fd5d015ab30 2024-09-13T17:25:05.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.599+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5c4013b50 con 0x7fd5d015ab30 2024-09-13T17:25:05.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.599+0000 7fd5ccc00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5b0066730 0x7fd5b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:05.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.599+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd5c40843c0 con 0x7fd5d015ab30 2024-09-13T17:25:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.599+0000 7fd5cfe00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5b0066730 0x7fd5b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:05.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.603+0000 7fd5cfe00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5b0066730 0x7fd5b0068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0090b0 tx=0x7fd5bc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:05.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.607+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5c4051360 con 0x7fd5d015ab30 2024-09-13T17:25:05.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.795+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5d00b5b30 con 0x7fd5d015ab30 2024-09-13T17:25:05.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.795+0000 7fd5ccc00700 1 -- 172.21.15.139:0/3400055297 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5c4054980 con 0x7fd5d015ab30 2024-09-13T17:25:05.798 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:05.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5b0066730 msgr2=0x7fd5b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5b0066730 0x7fd5b0068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0090b0 tx=0x7fd5bc008030 comp rx=0 tx=0).stop 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 msgr2=0x7fd5d0151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 0x7fd5d0151d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e840 tx=0x7fd5c400eb50 comp rx=0 tx=0).stop 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 shutdown_connections 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5b0066730 0x7fd5b0068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015f530 0x7fd5d0155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d015af10 0x7fd5d01f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 --2- 172.21.15.139:0/3400055297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5d015ab30 0x7fd5d0151d50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 >> 172.21.15.139:0/3400055297 conn(0x7fd5d006a390 msgr2=0x7fd5d00d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 shutdown_connections 2024-09-13T17:25:05.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.799+0000 7fd5d7a00700 1 -- 172.21.15.139:0/3400055297 wait complete. 2024-09-13T17:25:05.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:05.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.995+0000 7f279ca00700 1 Processor -- start 2024-09-13T17:25:05.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.995+0000 7f279ca00700 1 -- start start 2024-09-13T17:25:06.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f279ca00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f279814a6d0 0x7f27980cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f279ca00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f27980cd450 0x7f2798071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f279ca00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2798071ff0 con 0x7f27980b2b70 2024-09-13T17:25:06.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f279ca00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980cd8c0 con 0x7f279814a6d0 2024-09-13T17:25:06.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f279ca00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279814aab0 con 0x7f27980cd450 2024-09-13T17:25:06.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2796800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f279814a6d0 0x7f27980cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2797200700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f27980b2b70 0x7f279806fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58606/0 (socket says 172.21.15.139:58606) 2024-09-13T17:25:06.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2797200700 1 -- 172.21.15.139:0/2957536314 learned_addr learned my addr 172.21.15.139:0/2957536314 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:06.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2795e00700 1 --2- 172.21.15.139:0/2957536314 >> v2:172.21.15.176:3300/0 conn(0x7f27980cd450 0x7f2798071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2796800700 1 -- 172.21.15.139:0/2957536314 >> v2:172.21.15.176:3300/0 conn(0x7f27980cd450 msgr2=0x7f2798071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:06.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2796800700 1 --2- 172.21.15.139:0/2957536314 >> v2:172.21.15.176:3300/0 conn(0x7f27980cd450 0x7f2798071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2796800700 1 -- 172.21.15.139:0/2957536314 >> v1:172.21.15.139:6789/0 conn(0x7f27980b2b70 legacy=0x7f279806fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2796800700 1 -- 172.21.15.139:0/2957536314 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27980cc3b0 con 0x7f279814a6d0 2024-09-13T17:25:06.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2795400700 1 -- 172.21.15.139:0/2957536314 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486935519 0 0) 0x7f2790001490 con 0x7f27980b2b70 2024-09-13T17:25:06.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2796800700 1 --2- 172.21.15.139:0/2957536314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f279814a6d0 0x7f27980cbd40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f27980b1820 tx=0x7f2788009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f338038cf805f960 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2795400700 1 -- 172.21.15.139:0/2957536314 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788011830 con 0x7f279814a6d0 2024-09-13T17:25:06.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2795400700 1 -- 172.21.15.139:0/2957536314 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2788011990 con 0x7f279814a6d0 2024-09-13T17:25:06.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:05.999+0000 7f2795400700 1 -- 172.21.15.139:0/2957536314 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788011d20 con 0x7f279814a6d0 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 -- 172.21.15.139:0/2957536314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f279814a6d0 msgr2=0x7f27980cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 --2- 172.21.15.139:0/2957536314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f279814a6d0 0x7f27980cbd40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f27980b1820 tx=0x7f2788009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 -- 172.21.15.139:0/2957536314 shutdown_connections 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 --2- 172.21.15.139:0/2957536314 >> v2:172.21.15.176:3300/0 conn(0x7f27980cd450 0x7f2798071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 --2- 172.21.15.139:0/2957536314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f279814a6d0 0x7f27980cbd40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 -- 172.21.15.139:0/2957536314 >> 172.21.15.139:0/2957536314 conn(0x7f27980ce9d0 msgr2=0x7f27980cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 -- 172.21.15.139:0/2957536314 shutdown_connections 2024-09-13T17:25:06.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 -- 172.21.15.139:0/2957536314 wait complete. 2024-09-13T17:25:06.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 Processor -- start 2024-09-13T17:25:06.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.003+0000 7f279ca00700 1 -- start start 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27980b2b70 0x7f279813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 0x7f27981617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f279814a6d0 0x7f279806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798161d10 con 0x7f27980cd450 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279813ea70 con 0x7f279814a6d0 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279813ed50 con 0x7f27980b2b70 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 0x7f27981617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 0x7f27981617d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51688/0 (socket says 172.21.15.139:51688) 2024-09-13T17:25:06.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 -- 172.21.15.139:0/2526868834 learned_addr learned my addr 172.21.15.139:0/2526868834 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2796800700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27980b2b70 0x7f279813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2797200700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f279814a6d0 0x7f279806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 -- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27980b2b70 msgr2=0x7f279813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27980b2b70 0x7f279813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 -- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f279814a6d0 msgr2=0x7f279806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f279814a6d0 0x7f279806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 -- 172.21.15.139:0/2526868834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27880094b0 con 0x7f27980cd450 2024-09-13T17:25:06.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f2795e00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 0x7f27981617d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f278400e840 tx=0x7f278400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840095a0 con 0x7f27980cd450 2024-09-13T17:25:06.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278400c690 con 0x7f27980cd450 2024-09-13T17:25:06.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279813f030 con 0x7f27980cd450 2024-09-13T17:25:06.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400ca00 con 0x7f27980cd450 2024-09-13T17:25:06.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.007+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279813f5f0 con 0x7f27980cd450 2024-09-13T17:25:06.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.011+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2798071ab0 con 0x7f27980cd450 2024-09-13T17:25:06.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.011+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f278400cb60 con 0x7f27980cd450 2024-09-13T17:25:06.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.011+0000 7f278ea00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2778066730 0x7f2778068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.011+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2784084630 con 0x7f27980cd450 2024-09-13T17:25:06.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.011+0000 7f2796800700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2778066730 0x7f2778068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.015+0000 7f2796800700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2778066730 0x7f2778068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f27880090b0 tx=0x7f2788008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.019+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27840514b0 con 0x7f27980cd450 2024-09-13T17:25:06.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.199+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2798164900 con 0x7f27980cd450 2024-09-13T17:25:06.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.199+0000 7f278ea00700 1 -- 172.21.15.139:0/2526868834 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2784054ad0 con 0x7f27980cd450 2024-09-13T17:25:06.202 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2778066730 msgr2=0x7f2778068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2778066730 0x7f2778068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f27880090b0 tx=0x7f2788008030 comp rx=0 tx=0).stop 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 msgr2=0x7f27981617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 0x7f27981617d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f278400e840 tx=0x7f278400ec00 comp rx=0 tx=0).stop 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 shutdown_connections 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2778066730 0x7f2778068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f279814a6d0 0x7f279806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27980cd450 0x7f27981617d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 --2- 172.21.15.139:0/2526868834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27980b2b70 0x7f279813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 >> 172.21.15.139:0/2526868834 conn(0x7f27980ce9d0 msgr2=0x7f279806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:06.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 shutdown_connections 2024-09-13T17:25:06.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.203+0000 7f279ca00700 1 -- 172.21.15.139:0/2526868834 wait complete. 2024-09-13T17:25:06.229 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:06.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.407+0000 7f827fc00700 1 Processor -- start 2024-09-13T17:25:06.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.407+0000 7f827fc00700 1 -- start start 2024-09-13T17:25:06.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827fc00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f82780afad0 0x7f82780aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827fc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827fc00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780c6100 con 0x7f827815ced0 2024-09-13T17:25:06.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827fc00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780b0480 con 0x7f82780afad0 2024-09-13T17:25:06.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827fc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c63a0 con 0x7f82780ced50 2024-09-13T17:25:06.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827d200700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f827815ced0 0x7f82780c7310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:60870/0 (socket says 172.21.15.139:60870) 2024-09-13T17:25:06.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827d200700 1 -- 172.21.15.139:0/74251493 learned_addr learned my addr 172.21.15.139:0/74251493 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:06.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277e00700 1 --2- 172.21.15.139:0/74251493 >> v2:172.21.15.139:3300/0 conn(0x7f82780afad0 0x7f82780aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f827dc00700 1 --2- 172.21.15.139:0/74251493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277400700 1 -- 172.21.15.139:0/74251493 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272976184 0 0) 0x7f82780c6100 con 0x7f827815ced0 2024-09-13T17:25:06.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277400700 1 -- 172.21.15.139:0/74251493 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82600035d0 con 0x7f827815ced0 2024-09-13T17:25:06.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277e00700 1 -- 172.21.15.139:0/74251493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 msgr2=0x7f82780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:06.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277e00700 1 --2- 172.21.15.139:0/74251493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277e00700 1 -- 172.21.15.139:0/74251493 >> v1:172.21.15.176:6789/0 conn(0x7f827815ced0 legacy=0x7f82780c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277e00700 1 -- 172.21.15.139:0/74251493 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780c6680 con 0x7f82780afad0 2024-09-13T17:25:06.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277e00700 1 --2- 172.21.15.139:0/74251493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82780afad0 0x7f82780aff40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8264009850 tx=0x7f8264009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b043e0afb0ca5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277400700 1 -- 172.21.15.139:0/74251493 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264011830 con 0x7f82780afad0 2024-09-13T17:25:06.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277400700 1 -- 172.21.15.139:0/74251493 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8264011990 con 0x7f82780afad0 2024-09-13T17:25:06.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.411+0000 7f8277400700 1 -- 172.21.15.139:0/74251493 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264011d00 con 0x7f82780afad0 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 -- 172.21.15.139:0/74251493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82780afad0 msgr2=0x7f82780aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 --2- 172.21.15.139:0/74251493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82780afad0 0x7f82780aff40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8264009850 tx=0x7f8264009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 -- 172.21.15.139:0/74251493 shutdown_connections 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 --2- 172.21.15.139:0/74251493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 --2- 172.21.15.139:0/74251493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82780afad0 0x7f82780aff40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 -- 172.21.15.139:0/74251493 >> 172.21.15.139:0/74251493 conn(0x7f82780cd720 msgr2=0x7f82780cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 -- 172.21.15.139:0/74251493 shutdown_connections 2024-09-13T17:25:06.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.415+0000 7f827fc00700 1 -- 172.21.15.139:0/74251493 wait complete. 2024-09-13T17:25:06.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 Processor -- start 2024-09-13T17:25:06.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 -- start start 2024-09-13T17:25:06.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82780afad0 0x7f82781534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 0x7f82780b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780ae8b0 con 0x7f827815ced0 2024-09-13T17:25:06.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780aeb90 con 0x7f82780afad0 2024-09-13T17:25:06.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827fc00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780aee70 con 0x7f82780ced50 2024-09-13T17:25:06.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827dc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 0x7f82780b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827dc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 0x7f82780b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51712/0 (socket says 172.21.15.139:51712) 2024-09-13T17:25:06.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.419+0000 7f827dc00700 1 -- 172.21.15.139:0/3679182261 learned_addr learned my addr 172.21.15.139:0/3679182261 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:06.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f8277e00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827d200700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82780afad0 0x7f82781534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827dc00700 1 -- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 msgr2=0x7f82780b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827dc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827dc00700 1 -- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82780afad0 msgr2=0x7f82781534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827dc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82780afad0 0x7f82781534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827dc00700 1 -- 172.21.15.139:0/3679182261 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640094b0 con 0x7f827815ced0 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827d200700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82780afad0 0x7f82781534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827dc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 0x7f82780b24a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f827000efc0 tx=0x7f827000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000cd40 con 0x7f827815ced0 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000f040 con 0x7f827815ced0 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780af150 con 0x7f827815ced0 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700146c0 con 0x7f827815ced0 2024-09-13T17:25:06.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780c8ab0 con 0x7f827815ced0 2024-09-13T17:25:06.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82780af670 con 0x7f827815ced0 2024-09-13T17:25:06.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.423+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8270014820 con 0x7f827815ced0 2024-09-13T17:25:06.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.427+0000 7f8274c00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8258066760 0x7f8258068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.427+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8270084e70 con 0x7f827815ced0 2024-09-13T17:25:06.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.427+0000 7f827d200700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8258066760 0x7f8258068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.427+0000 7f827d200700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8258066760 0x7f8258068c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f826c0011e0 tx=0x7f826c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.431+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82780af670 con 0x7f827815ced0 2024-09-13T17:25:06.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.619+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82780af670 con 0x7f827815ced0 2024-09-13T17:25:06.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.619+0000 7f8274c00700 1 -- 172.21.15.139:0/3679182261 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82780af670 con 0x7f827815ced0 2024-09-13T17:25:06.623 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:06.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8258066760 msgr2=0x7f8258068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8258066760 0x7f8258068c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f826c0011e0 tx=0x7f826c009040 comp rx=0 tx=0).stop 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 msgr2=0x7f82780b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 0x7f82780b24a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f827000efc0 tx=0x7f827000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 shutdown_connections 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8258066760 0x7f8258068c20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f827815ced0 0x7f82780b24a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780ced50 0x7f82780b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 --2- 172.21.15.139:0/3679182261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82780afad0 0x7f82781534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 >> 172.21.15.139:0/3679182261 conn(0x7f82780cd720 msgr2=0x7f82780b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 shutdown_connections 2024-09-13T17:25:06.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.623+0000 7f827fc00700 1 -- 172.21.15.139:0/3679182261 wait complete. 2024-09-13T17:25:06.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:06.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.815+0000 7f5747200700 1 Processor -- start 2024-09-13T17:25:06.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.815+0000 7f5747200700 1 -- start start 2024-09-13T17:25:06.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.815+0000 7f5747200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5740146770 0x7f574006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.815+0000 7f5747200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57400ac890 0x7f57400b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.815+0000 7f5747200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5740071190 con 0x7f57400adc20 2024-09-13T17:25:06.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400ad8a0 con 0x7f5740146770 2024-09-13T17:25:06.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5740146b50 con 0x7f57400ac890 2024-09-13T17:25:06.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5740146770 0x7f574006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5745200700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f57400adc20 0x7f57400ae030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58612/0 (socket says 172.21.15.139:58612) 2024-09-13T17:25:06.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5745200700 1 -- 172.21.15.139:0/2690541210 learned_addr learned my addr 172.21.15.139:0/2690541210 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:06.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573f400700 1 --2- 172.21.15.139:0/2690541210 >> v2:172.21.15.176:3300/0 conn(0x7f57400ac890 0x7f57400b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573ea00700 1 -- 172.21.15.139:0/2690541210 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077216070 0 0) 0x7f5740071190 con 0x7f57400adc20 2024-09-13T17:25:06.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573ea00700 1 -- 172.21.15.139:0/2690541210 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57240035d0 con 0x7f57400adc20 2024-09-13T17:25:06.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573fe00700 1 -- 172.21.15.139:0/2690541210 >> v2:172.21.15.176:3300/0 conn(0x7f57400ac890 msgr2=0x7f57400b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:06.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573fe00700 1 --2- 172.21.15.139:0/2690541210 >> v2:172.21.15.176:3300/0 conn(0x7f57400ac890 0x7f57400b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573fe00700 1 -- 172.21.15.139:0/2690541210 >> v1:172.21.15.139:6789/0 conn(0x7f57400adc20 legacy=0x7f57400ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573fe00700 1 -- 172.21.15.139:0/2690541210 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400ad000 con 0x7f5740146770 2024-09-13T17:25:06.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573fe00700 1 --2- 172.21.15.139:0/2690541210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5740146770 0x7f574006d9e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5740073500 tx=0x7f5730009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1a549e02ed1504 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573ea00700 1 -- 172.21.15.139:0/2690541210 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730011830 con 0x7f5740146770 2024-09-13T17:25:06.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573ea00700 1 -- 172.21.15.139:0/2690541210 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730011990 con 0x7f5740146770 2024-09-13T17:25:06.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f573ea00700 1 -- 172.21.15.139:0/2690541210 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730011d00 con 0x7f5740146770 2024-09-13T17:25:06.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 -- 172.21.15.139:0/2690541210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5740146770 msgr2=0x7f574006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 --2- 172.21.15.139:0/2690541210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5740146770 0x7f574006d9e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5740073500 tx=0x7f5730009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:06.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 -- 172.21.15.139:0/2690541210 shutdown_connections 2024-09-13T17:25:06.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 --2- 172.21.15.139:0/2690541210 >> v2:172.21.15.176:3300/0 conn(0x7f57400ac890 0x7f57400b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 --2- 172.21.15.139:0/2690541210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5740146770 0x7f574006d9e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.819+0000 7f5747200700 1 -- 172.21.15.139:0/2690541210 >> 172.21.15.139:0/2690541210 conn(0x7f574006b1e0 msgr2=0x7f574006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:06.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 -- 172.21.15.139:0/2690541210 shutdown_connections 2024-09-13T17:25:06.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 -- 172.21.15.139:0/2690541210 wait complete. 2024-09-13T17:25:06.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 Processor -- start 2024-09-13T17:25:06.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 -- start start 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57400ac890 0x7f574015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 0x7f57400cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5740146770 0x7f57400cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57401414e0 con 0x7f57400adc20 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400cc310 con 0x7f5740146770 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.823+0000 7f5747200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400cc5f0 con 0x7f57400ac890 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 0x7f57400cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 0x7f57400cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51716/0 (socket says 172.21.15.139:51716) 2024-09-13T17:25:06.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 -- 172.21.15.139:0/3279174731 learned_addr learned my addr 172.21.15.139:0/3279174731 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:06.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5745200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5740146770 0x7f57400cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573fe00700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57400ac890 0x7f574015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 -- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57400ac890 msgr2=0x7f574015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57400ac890 0x7f574015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 -- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5740146770 msgr2=0x7f57400cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5740146770 0x7f57400cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 -- 172.21.15.139:0/3279174731 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300094b0 con 0x7f57400adc20 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f573f400700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 0x7f57400cb7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e9d0 tx=0x7f572c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c009720 con 0x7f57400adc20 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00ee70 con 0x7f57400adc20 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57400cc8d0 con 0x7f57400adc20 2024-09-13T17:25:06.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00ca50 con 0x7f57400adc20 2024-09-13T17:25:06.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400ccbb0 con 0x7f57400adc20 2024-09-13T17:25:06.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.827+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5740141650 con 0x7f57400adc20 2024-09-13T17:25:06.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.831+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f572c00cbb0 con 0x7f57400adc20 2024-09-13T17:25:06.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.831+0000 7f5737e00700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5720066730 0x7f5720068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:06.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.831+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f572c0845e0 con 0x7f57400adc20 2024-09-13T17:25:06.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.831+0000 7f573fe00700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5720066730 0x7f5720068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:06.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.831+0000 7f573fe00700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5720066730 0x7f5720068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5730000c00 tx=0x7f5730008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:06.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:06.839+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f572c0514f0 con 0x7f57400adc20 2024-09-13T17:25:07.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.015+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57400aee60 con 0x7f57400adc20 2024-09-13T17:25:07.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5737e00700 1 -- 172.21.15.139:0/3279174731 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f572c00ce60 con 0x7f57400adc20 2024-09-13T17:25:07.022 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5720066730 msgr2=0x7f5720068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5720066730 0x7f5720068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5730000c00 tx=0x7f5730008030 comp rx=0 tx=0).stop 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 msgr2=0x7f57400cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 0x7f57400cb7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e9d0 tx=0x7f572c00ece0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 shutdown_connections 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5720066730 0x7f5720068bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5740146770 0x7f57400cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57400adc20 0x7f57400cb7a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.019+0000 7f5747200700 1 --2- 172.21.15.139:0/3279174731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57400ac890 0x7f574015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.023+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 >> 172.21.15.139:0/3279174731 conn(0x7f574006b1e0 msgr2=0x7f574015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.023+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 shutdown_connections 2024-09-13T17:25:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.023+0000 7f5747200700 1 -- 172.21.15.139:0/3279174731 wait complete. 2024-09-13T17:25:07.045 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.211+0000 7f0489c00700 1 Processor -- start 2024-09-13T17:25:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489c00700 1 -- start start 2024-09-13T17:25:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f048415aff0 0x7f04840cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04840cdc00 0x7f04840711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0484070140 con 0x7f0484144300 2024-09-13T17:25:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04840ce0b0 con 0x7f048415aff0 2024-09-13T17:25:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0484070420 con 0x7f04840cdc00 2024-09-13T17:25:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04840cdc00 0x7f04840711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0483e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0484144300 0x7f048406d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:60884/0 (socket says 172.21.15.139:60884) 2024-09-13T17:25:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0483e00700 1 -- 172.21.15.139:0/2102073824 learned_addr learned my addr 172.21.15.139:0/2102073824 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f047b400700 1 --2- 172.21.15.139:0/2102073824 >> v2:172.21.15.139:3300/0 conn(0x7f048415aff0 0x7f04840cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489200700 1 -- 172.21.15.139:0/2102073824 >> v2:172.21.15.139:3300/0 conn(0x7f048415aff0 msgr2=0x7f04840cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489200700 1 --2- 172.21.15.139:0/2102073824 >> v2:172.21.15.139:3300/0 conn(0x7f048415aff0 0x7f04840cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489200700 1 -- 172.21.15.139:0/2102073824 >> v1:172.21.15.176:6789/0 conn(0x7f0484144300 legacy=0x7f048406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489200700 1 -- 172.21.15.139:0/2102073824 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484070700 con 0x7f04840cdc00 2024-09-13T17:25:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0483400700 1 -- 172.21.15.139:0/2102073824 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588844848 0 0) 0x7f0484070140 con 0x7f0484144300 2024-09-13T17:25:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.215+0000 7f0489200700 1 --2- 172.21.15.139:0/2102073824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f04840711e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f047c009850 tx=0x7f047c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973a67ca9a0106b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0483400700 1 -- 172.21.15.139:0/2102073824 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c011830 con 0x7f04840cdc00 2024-09-13T17:25:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0483400700 1 -- 172.21.15.139:0/2102073824 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c011990 con 0x7f04840cdc00 2024-09-13T17:25:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0483400700 1 -- 172.21.15.139:0/2102073824 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c011d20 con 0x7f04840cdc00 2024-09-13T17:25:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 -- 172.21.15.139:0/2102073824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 msgr2=0x7f04840711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 --2- 172.21.15.139:0/2102073824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f04840711e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f047c009850 tx=0x7f047c009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 -- 172.21.15.139:0/2102073824 shutdown_connections 2024-09-13T17:25:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 --2- 172.21.15.139:0/2102073824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f04840711e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 --2- 172.21.15.139:0/2102073824 >> v2:172.21.15.139:3300/0 conn(0x7f048415aff0 0x7f04840cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 -- 172.21.15.139:0/2102073824 >> 172.21.15.139:0/2102073824 conn(0x7f04840ce9d0 msgr2=0x7f04840cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 -- 172.21.15.139:0/2102073824 shutdown_connections 2024-09-13T17:25:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.219+0000 7f0489c00700 1 -- 172.21.15.139:0/2102073824 wait complete. 2024-09-13T17:25:07.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 Processor -- start 2024-09-13T17:25:07.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 -- start start 2024-09-13T17:25:07.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f0484159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 0x7f0484153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f048415aff0 0x7f04840aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048413f6a0 con 0x7f0484144300 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04841596f0 con 0x7f04840cdc00 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04840ae340 con 0x7f048415aff0 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f047b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 0x7f0484153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f047b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 0x7f0484153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51746/0 (socket says 172.21.15.139:51746) 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f047b400700 1 -- 172.21.15.139:0/3709103133 learned_addr learned my addr 172.21.15.139:0/3709103133 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0483e00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f0484159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.223+0000 7f0489200700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f048415aff0 0x7f04840aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f047b400700 1 -- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f048415aff0 msgr2=0x7f04840aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f047b400700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f048415aff0 0x7f04840aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f047b400700 1 -- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 msgr2=0x7f0484159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f047b400700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f0484159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f047b400700 1 -- 172.21.15.139:0/3709103133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c0094b0 con 0x7f0484144300 2024-09-13T17:25:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f047b400700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 0x7f0484153090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f047400efc0 tx=0x7f047400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400cd10 con 0x7f0484144300 2024-09-13T17:25:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400f040 con 0x7f0484144300 2024-09-13T17:25:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048413ed70 con 0x7f0484144300 2024-09-13T17:25:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740146a0 con 0x7f0484144300 2024-09-13T17:25:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.227+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048413f330 con 0x7f0484144300 2024-09-13T17:25:07.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.231+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04840cf2e0 con 0x7f0484144300 2024-09-13T17:25:07.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.231+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0474014800 con 0x7f0484144300 2024-09-13T17:25:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.231+0000 7f0480c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0460066760 0x7f0460068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.231+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0474084d40 con 0x7f0484144300 2024-09-13T17:25:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.231+0000 7f0483e00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0460066760 0x7f0460068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.235+0000 7f0483e00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0460066760 0x7f0460068c20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f046c000f60 tx=0x7f046c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:07.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.239+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0474051cf0 con 0x7f0484144300 2024-09-13T17:25:07.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.427+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04841446e0 con 0x7f0484144300 2024-09-13T17:25:07.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.427+0000 7f0480c00700 1 -- 172.21.15.139:0/3709103133 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7f0474055310 con 0x7f0484144300 2024-09-13T17:25:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:07.433 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:07.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0460066760 msgr2=0x7f0460068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0460066760 0x7f0460068c20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f046c000f60 tx=0x7f046c007e00 comp rx=0 tx=0).stop 2024-09-13T17:25:07.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 msgr2=0x7f0484153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 0x7f0484153090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f047400efc0 tx=0x7f047400c3a0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 shutdown_connections 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0460066760 0x7f0460068c20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f048415aff0 0x7f04840aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0484144300 0x7f0484153090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 --2- 172.21.15.139:0/3709103133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04840cdc00 0x7f0484159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 >> 172.21.15.139:0/3709103133 conn(0x7f04840ce9d0 msgr2=0x7f0484141050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:07.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 shutdown_connections 2024-09-13T17:25:07.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.435+0000 7f0489c00700 1 -- 172.21.15.139:0/3709103133 wait complete. 2024-09-13T17:25:07.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:07.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:07.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.631+0000 7fc9ad600700 1 Processor -- start 2024-09-13T17:25:07.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.631+0000 7fc9ad600700 1 -- start start 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc9a8159650 0x7fc9a80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc9a80b46d0 0x7fc9a80b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a806c670 con 0x7fc9a815e0a0 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a806cc00 con 0x7fc9a8159650 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80b50c0 con 0x7fc9a80b46d0 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc9a8159650 0x7fc9a80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc9a8159650 0x7fc9a80cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51762/0 (socket says 172.21.15.139:51762) 2024-09-13T17:25:07.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 -- 172.21.15.139:0/1065183929 learned_addr learned my addr 172.21.15.139:0/1065183929 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:07.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9acc00700 1 --2- 172.21.15.139:0/1065183929 >> v2:172.21.15.176:3300/0 conn(0x7fc9a80b46d0 0x7fc9a80b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 -- 172.21.15.139:0/1065183929 >> v2:172.21.15.176:3300/0 conn(0x7fc9a80b46d0 msgr2=0x7fc9a80b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:07.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 --2- 172.21.15.139:0/1065183929 >> v2:172.21.15.176:3300/0 conn(0x7fc9a80b46d0 0x7fc9a80b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 -- 172.21.15.139:0/1065183929 >> v1:172.21.15.176:6789/0 conn(0x7fc9a815e0a0 legacy=0x7fc9a806bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 -- 172.21.15.139:0/1065183929 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a806c920 con 0x7fc9a8159650 2024-09-13T17:25:07.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a7e00700 1 --2- 172.21.15.139:0/1065183929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80cd4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806d610 tx=0x7fc998009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b946085eaa84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:07.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a6a00700 1 -- 172.21.15.139:0/1065183929 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998011830 con 0x7fc9a8159650 2024-09-13T17:25:07.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a6a00700 1 -- 172.21.15.139:0/1065183929 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998011990 con 0x7fc9a8159650 2024-09-13T17:25:07.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9a6a00700 1 -- 172.21.15.139:0/1065183929 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998011d20 con 0x7fc9a8159650 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 -- 172.21.15.139:0/1065183929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 msgr2=0x7fc9a80cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.635+0000 7fc9ad600700 1 --2- 172.21.15.139:0/1065183929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80cd4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806d610 tx=0x7fc998009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- 172.21.15.139:0/1065183929 shutdown_connections 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 --2- 172.21.15.139:0/1065183929 >> v2:172.21.15.176:3300/0 conn(0x7fc9a80b46d0 0x7fc9a80b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 --2- 172.21.15.139:0/1065183929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80cd4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- 172.21.15.139:0/1065183929 >> 172.21.15.139:0/1065183929 conn(0x7fc9a8071f50 msgr2=0x7fc9a80b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- 172.21.15.139:0/1065183929 shutdown_connections 2024-09-13T17:25:07.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- 172.21.15.139:0/1065183929 wait complete. 2024-09-13T17:25:07.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 Processor -- start 2024-09-13T17:25:07.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- start start 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a80b46d0 0x7fc9a81571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a814df20 0x7fc9a80a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80a98e0 con 0x7fc9a8159650 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80a8cd0 con 0x7fc9a80b46d0 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9ad600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80a8fb0 con 0x7fc9a814df20 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9a7400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.639+0000 7fc9a7400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51772/0 (socket says 172.21.15.139:51772) 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 -- 172.21.15.139:0/2771417604 learned_addr learned my addr 172.21.15.139:0/2771417604 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7e00700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a80b46d0 0x7fc9a81571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9acc00700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a814df20 0x7fc9a80a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 -- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a814df20 msgr2=0x7fc9a80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a814df20 0x7fc9a80a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 -- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a80b46d0 msgr2=0x7fc9a81571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a80b46d0 0x7fc9a81571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 -- 172.21.15.139:0/2771417604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009570 con 0x7fc9a8159650 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7e00700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a80b46d0 0x7fc9a81571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9a7400700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80a8480 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c500 tx=0x7fc99400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940052d0 con 0x7fc9a8159650 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994005430 con 0x7fc9a8159650 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a80a9290 con 0x7fc9a8159650 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940055a0 con 0x7fc9a8159650 2024-09-13T17:25:07.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a80a89c0 con 0x7fc9a8159650 2024-09-13T17:25:07.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.643+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a80a9a50 con 0x7fc9a8159650 2024-09-13T17:25:07.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.647+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9940038e0 con 0x7fc9a8159650 2024-09-13T17:25:07.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.647+0000 7fc99fe00700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc988066760 0x7fc988068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:07.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.647+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc9940838c0 con 0x7fc9a8159650 2024-09-13T17:25:07.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.647+0000 7fc9a7e00700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc988066760 0x7fc988068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:07.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.647+0000 7fc9a7e00700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc988066760 0x7fc988068c20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc998000c00 tx=0x7fc998008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:07.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.655+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9940507d0 con 0x7fc9a8159650 2024-09-13T17:25:07.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.839+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9a806c370 con 0x7fc9a8159650 2024-09-13T17:25:07.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc99fe00700 1 -- 172.21.15.139:0/2771417604 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc994053df0 con 0x7fc9a8159650 2024-09-13T17:25:07.845 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:07.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc988066760 msgr2=0x7fc988068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc988066760 0x7fc988068c20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc998000c00 tx=0x7fc998008030 comp rx=0 tx=0).stop 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 msgr2=0x7fc9a80a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80a8480 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c500 tx=0x7fc99400c810 comp rx=0 tx=0).stop 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 shutdown_connections 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc988066760 0x7fc988068c20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a814df20 0x7fc9a80a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a8159650 0x7fc9a80a8480 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 --2- 172.21.15.139:0/2771417604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a80b46d0 0x7fc9a81571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 >> 172.21.15.139:0/2771417604 conn(0x7fc9a8071f50 msgr2=0x7fc9a815a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 shutdown_connections 2024-09-13T17:25:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:07.843+0000 7fc9ad600700 1 -- 172.21.15.139:0/2771417604 wait complete. 2024-09-13T17:25:07.870 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:08.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.043+0000 7fce63e00700 1 Processor -- start 2024-09-13T17:25:08.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.043+0000 7fce63e00700 1 -- start start 2024-09-13T17:25:08.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fce6414a6d0 0x7fce640cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640cd450 0x7fce64071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce64071ff0 con 0x7fce640b2b70 2024-09-13T17:25:08.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640cd890 con 0x7fce6414a6d0 2024-09-13T17:25:08.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6414aab0 con 0x7fce640cd450 2024-09-13T17:25:08.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fce6414a6d0 0x7fce640cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fce640b2b70 0x7fce6406fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58614/0 (socket says 172.21.15.139:58614) 2024-09-13T17:25:08.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce63400700 1 -- 172.21.15.139:0/2138676019 learned_addr learned my addr 172.21.15.139:0/2138676019 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:08.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62000700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640cd450 0x7fce64071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62a00700 1 -- 172.21.15.139:0/2138676019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640cd450 msgr2=0x7fce64071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:08.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62a00700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640cd450 0x7fce64071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62a00700 1 -- 172.21.15.139:0/2138676019 >> v1:172.21.15.139:6789/0 conn(0x7fce640b2b70 legacy=0x7fce6406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce61600700 1 -- 172.21.15.139:0/2138676019 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994376934 0 0) 0x7fce5c001490 con 0x7fce640b2b70 2024-09-13T17:25:08.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62a00700 1 -- 172.21.15.139:0/2138676019 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640cc3b0 con 0x7fce6414a6d0 2024-09-13T17:25:08.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62000700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640cd450 0x7fce64071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:08.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce62a00700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce6414a6d0 0x7fce640cbd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce54009850 tx=0x7fce54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2991340e519ce3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce61600700 1 -- 172.21.15.139:0/2138676019 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54011830 con 0x7fce6414a6d0 2024-09-13T17:25:08.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce61600700 1 -- 172.21.15.139:0/2138676019 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54011990 con 0x7fce6414a6d0 2024-09-13T17:25:08.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.047+0000 7fce61600700 1 -- 172.21.15.139:0/2138676019 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54011d40 con 0x7fce6414a6d0 2024-09-13T17:25:08.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 -- 172.21.15.139:0/2138676019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce6414a6d0 msgr2=0x7fce640cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce6414a6d0 0x7fce640cbd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce54009850 tx=0x7fce54009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:08.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 -- 172.21.15.139:0/2138676019 shutdown_connections 2024-09-13T17:25:08.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640cd450 0x7fce64071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 --2- 172.21.15.139:0/2138676019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce6414a6d0 0x7fce640cbd40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 -- 172.21.15.139:0/2138676019 >> 172.21.15.139:0/2138676019 conn(0x7fce640ce9d0 msgr2=0x7fce640cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:08.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 -- 172.21.15.139:0/2138676019 shutdown_connections 2024-09-13T17:25:08.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 -- 172.21.15.139:0/2138676019 wait complete. 2024-09-13T17:25:08.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 Processor -- start 2024-09-13T17:25:08.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.051+0000 7fce63e00700 1 -- start start 2024-09-13T17:25:08.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce640b2b70 0x7fce6413dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 0x7fce6406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce6414a6d0 0x7fce64145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6406d720 con 0x7fce640cd450 2024-09-13T17:25:08.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6406d290 con 0x7fce640b2b70 2024-09-13T17:25:08.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6406c680 con 0x7fce6414a6d0 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 0x7fce6406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 0x7fce6406bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51796/0 (socket says 172.21.15.139:51796) 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 -- 172.21.15.139:0/205358416 learned_addr learned my addr 172.21.15.139:0/205358416 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63400700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce6414a6d0 0x7fce64145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62a00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce640b2b70 0x7fce6413dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 -- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce6414a6d0 msgr2=0x7fce64145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce6414a6d0 0x7fce64145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 -- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce640b2b70 msgr2=0x7fce6413dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce640b2b70 0x7fce6413dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 -- 172.21.15.139:0/205358416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0094b0 con 0x7fce640cd450 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce62000700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 0x7fce6406bd10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00ec10 tx=0x7fce4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00c8e0 con 0x7fce640cd450 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00ca40 con 0x7fce640cd450 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00cdd0 con 0x7fce640cd450 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce540094b0 con 0x7fce640cd450 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.055+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6406cc40 con 0x7fce640cd450 2024-09-13T17:25:08.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.059+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6406d420 con 0x7fce640cd450 2024-09-13T17:25:08.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.059+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce4c013470 con 0x7fce640cd450 2024-09-13T17:25:08.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.059+0000 7fce5aa00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fce40066730 0x7fce40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.059+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce4c0846b0 con 0x7fce640cd450 2024-09-13T17:25:08.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.063+0000 7fce62a00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fce40066730 0x7fce40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.063+0000 7fce62a00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fce40066730 0x7fce40068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce540090b0 tx=0x7fce54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.067+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fce4c0515c0 con 0x7fce640cd450 2024-09-13T17:25:08.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.251+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce64071ab0 con 0x7fce640cd450 2024-09-13T17:25:08.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.251+0000 7fce5aa00700 1 -- 172.21.15.139:0/205358416 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce4c054be0 con 0x7fce640cd450 2024-09-13T17:25:08.255 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:08.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fce40066730 msgr2=0x7fce40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fce40066730 0x7fce40068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce540090b0 tx=0x7fce54008030 comp rx=0 tx=0).stop 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 msgr2=0x7fce6406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 0x7fce6406bd10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00ec10 tx=0x7fce4c009e30 comp rx=0 tx=0).stop 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 shutdown_connections 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fce40066730 0x7fce40068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce6414a6d0 0x7fce64145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce640cd450 0x7fce6406bd10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 --2- 172.21.15.139:0/205358416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce640b2b70 0x7fce6413dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 >> 172.21.15.139:0/205358416 conn(0x7fce640ce9d0 msgr2=0x7fce640cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 shutdown_connections 2024-09-13T17:25:08.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.255+0000 7fce63e00700 1 -- 172.21.15.139:0/205358416 wait complete. 2024-09-13T17:25:08.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:08.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.463+0000 7f26d6800700 1 Processor -- start 2024-09-13T17:25:08.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.463+0000 7f26d6800700 1 -- start start 2024-09-13T17:25:08.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d6800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f26d0071570 0x7f26d015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d6800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d013f810 0x7f26d013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d6800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d013f0c0 con 0x7f26d0071190 2024-09-13T17:25:08.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d6800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d015a720 con 0x7f26d0071570 2024-09-13T17:25:08.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d6800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d015aa00 con 0x7f26d013f810 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f26d0071570 0x7f26d015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f26d0071570 0x7f26d015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51806/0 (socket says 172.21.15.139:51806) 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 -- 172.21.15.139:0/11973021 learned_addr learned my addr 172.21.15.139:0/11973021 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d5400700 1 --1- 172.21.15.139:0/11973021 >> v1:172.21.15.139:6789/0 conn(0x7f26d0071190 0x7f26d0159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58620/0 (socket says 172.21.15.139:58620) 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d5e00700 1 --2- 172.21.15.139:0/11973021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d013f810 0x7f26d013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 -- 172.21.15.139:0/11973021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d013f810 msgr2=0x7f26d013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 --2- 172.21.15.139:0/11973021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d013f810 0x7f26d013fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 -- 172.21.15.139:0/11973021 >> v1:172.21.15.139:6789/0 conn(0x7f26d0071190 legacy=0x7f26d0159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 -- 172.21.15.139:0/11973021 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d015ace0 con 0x7f26d0071570 2024-09-13T17:25:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26d4a00700 1 --2- 172.21.15.139:0/11973021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071570 0x7f26d015dfd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009910 tx=0x7f26bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd91b20e9a3e991a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26cfe00700 1 -- 172.21.15.139:0/11973021 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc011830 con 0x7f26d0071570 2024-09-13T17:25:08.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26cfe00700 1 -- 172.21.15.139:0/11973021 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc011990 con 0x7f26d0071570 2024-09-13T17:25:08.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.467+0000 7f26cfe00700 1 -- 172.21.15.139:0/11973021 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc011d40 con 0x7f26d0071570 2024-09-13T17:25:08.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 -- 172.21.15.139:0/11973021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071570 msgr2=0x7f26d015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 --2- 172.21.15.139:0/11973021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071570 0x7f26d015dfd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009910 tx=0x7f26bc009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:08.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 -- 172.21.15.139:0/11973021 shutdown_connections 2024-09-13T17:25:08.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 --2- 172.21.15.139:0/11973021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d013f810 0x7f26d013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 --2- 172.21.15.139:0/11973021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071570 0x7f26d015dfd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 -- 172.21.15.139:0/11973021 >> 172.21.15.139:0/11973021 conn(0x7f26d00ce9d0 msgr2=0x7f26d00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:08.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 -- 172.21.15.139:0/11973021 shutdown_connections 2024-09-13T17:25:08.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 -- 172.21.15.139:0/11973021 wait complete. 2024-09-13T17:25:08.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 Processor -- start 2024-09-13T17:25:08.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.471+0000 7f26d6800700 1 -- start start 2024-09-13T17:25:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 0x7f26d01f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d0071570 0x7f26d0152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26d013f810 0x7f26d0152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d01530c0 con 0x7f26d0071190 2024-09-13T17:25:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d01533a0 con 0x7f26d013f810 2024-09-13T17:25:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d0153680 con 0x7f26d0071570 2024-09-13T17:25:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 0x7f26d01f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 0x7f26d01f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51808/0 (socket says 172.21.15.139:51808) 2024-09-13T17:25:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 -- 172.21.15.139:0/3510593699 learned_addr learned my addr 172.21.15.139:0/3510593699 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:08.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d4a00700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d0071570 0x7f26d0152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5e00700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26d013f810 0x7f26d0152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 -- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d0071570 msgr2=0x7f26d0152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d0071570 0x7f26d0152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 -- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26d013f810 msgr2=0x7f26d0152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26d013f810 0x7f26d0152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 -- 172.21.15.139:0/3510593699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc009570 con 0x7f26d0071190 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d5400700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 0x7f26d01f5960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26c400c700 tx=0x7f26c400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4005cd0 con 0x7f26d0071190 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c4005e30 con 0x7f26d0071190 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d0153960 con 0x7f26d0071190 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40072d0 con 0x7f26d0071190 2024-09-13T17:25:08.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d01522c0 con 0x7f26d0071190 2024-09-13T17:25:08.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.475+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d013e8c0 con 0x7f26d0071190 2024-09-13T17:25:08.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.479+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26c4007430 con 0x7f26d0071190 2024-09-13T17:25:08.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.479+0000 7f26cd600700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f26b0066730 0x7f26b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.479+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26c4083fb0 con 0x7f26d0071190 2024-09-13T17:25:08.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.479+0000 7f26d4a00700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f26b0066730 0x7f26b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.483+0000 7f26d4a00700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f26b0066730 0x7f26b0068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f26bc000c00 tx=0x7f26bc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.487+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26c4051180 con 0x7f26d0071190 2024-09-13T17:25:08.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.663+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26d006d920 con 0x7f26d0071190 2024-09-13T17:25:08.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.663+0000 7f26cd600700 1 -- 172.21.15.139:0/3510593699 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26c40210a0 con 0x7f26d0071190 2024-09-13T17:25:08.667 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:08.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f26b0066730 msgr2=0x7f26b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f26b0066730 0x7f26b0068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f26bc000c00 tx=0x7f26bc008030 comp rx=0 tx=0).stop 2024-09-13T17:25:08.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 msgr2=0x7f26d01f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 0x7f26d01f5960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26c400c700 tx=0x7f26c400ca10 comp rx=0 tx=0).stop 2024-09-13T17:25:08.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 shutdown_connections 2024-09-13T17:25:08.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f26b0066730 0x7f26b0068bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26d013f810 0x7f26d0152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26d0071570 0x7f26d0152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 --2- 172.21.15.139:0/3510593699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26d0071190 0x7f26d01f5960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 >> 172.21.15.139:0/3510593699 conn(0x7f26d00ce9d0 msgr2=0x7f26d00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:08.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 shutdown_connections 2024-09-13T17:25:08.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.667+0000 7f26d6800700 1 -- 172.21.15.139:0/3510593699 wait complete. 2024-09-13T17:25:08.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:08.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 Processor -- start 2024-09-13T17:25:08.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 -- start start 2024-09-13T17:25:08.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42c40cf100 0x7f42c40cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c406bc30 0x7f42c406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c406c5c0 con 0x7f42c415ad40 2024-09-13T17:25:08.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40cca60 con 0x7f42c40cf100 2024-09-13T17:25:08.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42cb600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40b1500 con 0x7f42c406bc30 2024-09-13T17:25:08.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.871+0000 7f42c3e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42c40cf100 0x7f42c40cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42c40cf100 0x7f42c40cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:55618/0 (socket says 172.21.15.139:55618) 2024-09-13T17:25:08.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 -- 172.21.15.139:0/3797208527 learned_addr learned my addr 172.21.15.139:0/3797208527 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:08.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c9600700 1 --2- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c406bc30 0x7f42c406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 -- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c406bc30 msgr2=0x7f42c406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:08.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 --2- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c406bc30 0x7f42c406c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 -- 172.21.15.139:0/3797208527 >> v1:172.21.15.176:6789/0 conn(0x7f42c415ad40 legacy=0x7f42c415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:08.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 -- 172.21.15.139:0/3797208527 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c406e620 con 0x7f42c40cf100 2024-09-13T17:25:08.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3e00700 1 --2- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c40cf100 0x7f42c40cc520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009910 tx=0x7f42b0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83179028f3c0c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3400700 1 -- 172.21.15.139:0/3797208527 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000ba60 con 0x7f42c40cf100 2024-09-13T17:25:08.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3400700 1 -- 172.21.15.139:0/3797208527 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b000bbc0 con 0x7f42c40cf100 2024-09-13T17:25:08.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42c3400700 1 -- 172.21.15.139:0/3797208527 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0009e60 con 0x7f42c40cf100 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 -- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c40cf100 msgr2=0x7f42c40cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 --2- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c40cf100 0x7f42c40cc520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009910 tx=0x7f42b0009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 -- 172.21.15.139:0/3797208527 shutdown_connections 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 --2- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c406bc30 0x7f42c406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 --2- 172.21.15.139:0/3797208527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c40cf100 0x7f42c40cc520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 -- 172.21.15.139:0/3797208527 >> 172.21.15.139:0/3797208527 conn(0x7f42c4070b70 msgr2=0x7f42c4070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.875+0000 7f42cb600700 1 -- 172.21.15.139:0/3797208527 shutdown_connections 2024-09-13T17:25:08.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.879+0000 7f42cb600700 1 -- 172.21.15.139:0/3797208527 wait complete. 2024-09-13T17:25:08.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.879+0000 7f42cb600700 1 Processor -- start 2024-09-13T17:25:08.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.879+0000 7f42cb600700 1 -- start start 2024-09-13T17:25:08.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 0x7f42c4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c415ad40 0x7f42c4156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c4148180 0x7f42c4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4156450 con 0x7f42c406bc30 2024-09-13T17:25:08.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41557d0 con 0x7f42c415ad40 2024-09-13T17:25:08.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4155ab0 con 0x7f42c4148180 2024-09-13T17:25:08.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 0x7f42c4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 0x7f42c4157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51818/0 (socket says 172.21.15.139:51818) 2024-09-13T17:25:08.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 -- 172.21.15.139:0/1030899543 learned_addr learned my addr 172.21.15.139:0/1030899543 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:08.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c3e00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c415ad40 0x7f42c4156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c9600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c4148180 0x7f42c4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 -- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c4148180 msgr2=0x7f42c4156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c4148180 0x7f42c4156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 -- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c415ad40 msgr2=0x7f42c4156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c415ad40 0x7f42c4156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 -- 172.21.15.139:0/1030899543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0009570 con 0x7f42c406bc30 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c8c00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 0x7f42c4157b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c500 tx=0x7f42b800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80052d0 con 0x7f42c406bc30 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8005430 con 0x7f42c406bc30 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4155d90 con 0x7f42c406bc30 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80055a0 con 0x7f42c406bc30 2024-09-13T17:25:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.883+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4158090 con 0x7f42c406bc30 2024-09-13T17:25:08.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.887+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4158700 con 0x7f42c406bc30 2024-09-13T17:25:08.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.887+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42b80038e0 con 0x7f42c406bc30 2024-09-13T17:25:08.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.891+0000 7f42c0c00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f42a4066730 0x7f42a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:08.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.891+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f42b8083800 con 0x7f42c406bc30 2024-09-13T17:25:08.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.891+0000 7f42c3e00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f42a4066730 0x7f42a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:08.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.891+0000 7f42c3e00700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f42a4066730 0x7f42a4068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f42b0000c00 tx=0x7f42b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:08.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:08.895+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42b8050710 con 0x7f42c406bc30 2024-09-13T17:25:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.071+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f42c406c5c0 con 0x7f42c406bc30 2024-09-13T17:25:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.075+0000 7f42c0c00700 1 -- 172.21.15.139:0/1030899543 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42c406c5c0 con 0x7f42c406bc30 2024-09-13T17:25:09.078 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:09.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f42a4066730 msgr2=0x7f42a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f42a4066730 0x7f42a4068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f42b0000c00 tx=0x7f42b0008030 comp rx=0 tx=0).stop 2024-09-13T17:25:09.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 msgr2=0x7f42c4157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 0x7f42c4157b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c500 tx=0x7f42b800c810 comp rx=0 tx=0).stop 2024-09-13T17:25:09.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 shutdown_connections 2024-09-13T17:25:09.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f42a4066730 0x7f42a4068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c4148180 0x7f42c4156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c415ad40 0x7f42c4156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 --2- 172.21.15.139:0/1030899543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42c406bc30 0x7f42c4157b50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 >> 172.21.15.139:0/1030899543 conn(0x7f42c4070b70 msgr2=0x7f42c40cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:09.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 shutdown_connections 2024-09-13T17:25:09.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.079+0000 7f42cb600700 1 -- 172.21.15.139:0/1030899543 wait complete. 2024-09-13T17:25:09.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:09.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.279+0000 7fa8e6200700 1 Processor -- start 2024-09-13T17:25:09.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.279+0000 7fa8e6200700 1 -- start start 2024-09-13T17:25:09.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8e6200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8e006aea0 0x7fa8e0159610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8e6200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e0159b50 con 0x7fa8e00717d0 2024-09-13T17:25:09.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8e6200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e006b520 con 0x7fa8e006c5c0 2024-09-13T17:25:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8e6200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e006b310 con 0x7fa8e006aea0 2024-09-13T17:25:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8e4e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa8e00717d0 0x7fa8e0158f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58624/0 (socket says 172.21.15.139:58624) 2024-09-13T17:25:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8e4e00700 1 -- 172.21.15.139:0/3684026262 learned_addr learned my addr 172.21.15.139:0/3684026262 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8dfe00700 1 --2- 172.21.15.139:0/3684026262 >> v2:172.21.15.176:3300/0 conn(0x7fa8e006aea0 0x7fa8e0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485657052 0 0) 0x7fa8e0159b50 con 0x7fa8e00717d0 2024-09-13T17:25:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c80057e0 con 0x7fa8e00717d0 2024-09-13T17:25:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183935654 0 0) 0x7fa8e006b520 con 0x7fa8e006c5c0 2024-09-13T17:25:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e0159b50 con 0x7fa8e006c5c0 2024-09-13T17:25:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8dfe00700 1 -- 172.21.15.139:0/3684026262 >> v1:172.21.15.176:6789/0 conn(0x7fa8e006c5c0 legacy=0x7fa8e006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8dfe00700 1 -- 172.21.15.139:0/3684026262 >> v1:172.21.15.139:6789/0 conn(0x7fa8e00717d0 legacy=0x7fa8e0158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.283+0000 7fa8dfe00700 1 -- 172.21.15.139:0/3684026262 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e006b800 con 0x7fa8e006aea0 2024-09-13T17:25:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8dfe00700 1 --2- 172.21.15.139:0/3684026262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0159610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009850 tx=0x7fa8cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2109965574d366 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc011830 con 0x7fa8e006aea0 2024-09-13T17:25:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc011990 con 0x7fa8e006aea0 2024-09-13T17:25:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8df400700 1 -- 172.21.15.139:0/3684026262 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc011d00 con 0x7fa8e006aea0 2024-09-13T17:25:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 -- 172.21.15.139:0/3684026262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 msgr2=0x7fa8e0159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 --2- 172.21.15.139:0/3684026262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0159610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009850 tx=0x7fa8cc009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 -- 172.21.15.139:0/3684026262 shutdown_connections 2024-09-13T17:25:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 --2- 172.21.15.139:0/3684026262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0159610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 -- 172.21.15.139:0/3684026262 >> 172.21.15.139:0/3684026262 conn(0x7fa8e00ce9d0 msgr2=0x7fa8e00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 -- 172.21.15.139:0/3684026262 shutdown_connections 2024-09-13T17:25:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.287+0000 7fa8e6200700 1 -- 172.21.15.139:0/3684026262 wait complete. 2024-09-13T17:25:09.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 Processor -- start 2024-09-13T17:25:09.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 -- start start 2024-09-13T17:25:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 0x7fa8e00ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8e00717d0 0x7fa8e00b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015bb60 con 0x7fa8e006c5c0 2024-09-13T17:25:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015af50 con 0x7fa8e006aea0 2024-09-13T17:25:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e6200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015b230 con 0x7fa8e00717d0 2024-09-13T17:25:09.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8dfe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 0x7fa8e00ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e4e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8dfe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 0x7fa8e00ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51824/0 (socket says 172.21.15.139:51824) 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8dfe00700 1 -- 172.21.15.139:0/2508500917 learned_addr learned my addr 172.21.15.139:0/2508500917 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.291+0000 7fa8e5800700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8e00717d0 0x7fa8e00b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dfe00700 1 -- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8e00717d0 msgr2=0x7fa8e00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dfe00700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8e00717d0 0x7fa8e00b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dfe00700 1 -- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 msgr2=0x7fa8e0149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dfe00700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dfe00700 1 -- 172.21.15.139:0/2508500917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0094b0 con 0x7fa8e006c5c0 2024-09-13T17:25:09.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dfe00700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 0x7fa8e00ada60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009ba0 tx=0x7fa8cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:09.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc004510 con 0x7fa8e006c5c0 2024-09-13T17:25:09.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc01e070 con 0x7fa8e006c5c0 2024-09-13T17:25:09.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e015b510 con 0x7fa8e006c5c0 2024-09-13T17:25:09.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc003900 con 0x7fa8e006c5c0 2024-09-13T17:25:09.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e015ab90 con 0x7fa8e006c5c0 2024-09-13T17:25:09.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.295+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e006ca10 con 0x7fa8e006c5c0 2024-09-13T17:25:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.299+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8cc003a60 con 0x7fa8e006c5c0 2024-09-13T17:25:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.299+0000 7fa8dcc00700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa8c0066760 0x7fa8c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.299+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8cc085190 con 0x7fa8e006c5c0 2024-09-13T17:25:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.299+0000 7fa8e4e00700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa8c0066760 0x7fa8c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.299+0000 7fa8e4e00700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa8c0066760 0x7fa8c0068c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4000f60 tx=0x7fa8d4007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:09.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.307+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8cc0521d0 con 0x7fa8e006c5c0 2024-09-13T17:25:09.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.495+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8e0157ed0 con 0x7fa8e006c5c0 2024-09-13T17:25:09.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.499+0000 7fa8dcc00700 1 -- 172.21.15.139:0/2508500917 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7fa8cc0557f0 con 0x7fa8e006c5c0 2024-09-13T17:25:09.502 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:09.503 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:09.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.499+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa8c0066760 msgr2=0x7fa8c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.499+0000 7fa8e6200700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa8c0066760 0x7fa8c0068c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4000f60 tx=0x7fa8d4007e20 comp rx=0 tx=0).stop 2024-09-13T17:25:09.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.499+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 msgr2=0x7fa8e00ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.499+0000 7fa8e6200700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 0x7fa8e00ada60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009ba0 tx=0x7fa8cc004770 comp rx=0 tx=0).stop 2024-09-13T17:25:09.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 shutdown_connections 2024-09-13T17:25:09.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa8c0066760 0x7fa8c0068c20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8e00717d0 0x7fa8e00b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e006c5c0 0x7fa8e00ada60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 --2- 172.21.15.139:0/2508500917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8e006aea0 0x7fa8e0149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 >> 172.21.15.139:0/2508500917 conn(0x7fa8e00ce9d0 msgr2=0x7fa8e00afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:09.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 shutdown_connections 2024-09-13T17:25:09.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.503+0000 7fa8e6200700 1 -- 172.21.15.139:0/2508500917 wait complete. 2024-09-13T17:25:09.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:09.527 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.691+0000 7fd7e8a00700 1 Processor -- start 2024-09-13T17:25:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.691+0000 7fd7e8a00700 1 -- start start 2024-09-13T17:25:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e8a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd7e415cc00 0x7fd7e40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e8a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e40adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e8a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40cd160 con 0x7fd7e40b2b70 2024-09-13T17:25:09.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e8a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40ae100 con 0x7fd7e415cc00 2024-09-13T17:25:09.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e8a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40aceb0 con 0x7fd7e406fe10 2024-09-13T17:25:09.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e2800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd7e415cc00 0x7fd7e40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e3200700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd7e40b2b70 0x7fd7e40cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58628/0 (socket says 172.21.15.139:58628) 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e3200700 1 -- 172.21.15.139:0/2030582173 learned_addr learned my addr 172.21.15.139:0/2030582173 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e2800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd7e415cc00 0x7fd7e40ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51838/0 (socket says 172.21.15.139:51838) 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e1e00700 1 --2- 172.21.15.139:0/2030582173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e40adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e2800700 1 -- 172.21.15.139:0/2030582173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 msgr2=0x7fd7e40adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e2800700 1 --2- 172.21.15.139:0/2030582173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e40adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e2800700 1 -- 172.21.15.139:0/2030582173 >> v1:172.21.15.139:6789/0 conn(0x7fd7e40b2b70 legacy=0x7fd7e40cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e1400700 1 -- 172.21.15.139:0/2030582173 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217201186 0 0) 0x7fd7e40cd160 con 0x7fd7e40b2b70 2024-09-13T17:25:09.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.695+0000 7fd7e2800700 1 -- 172.21.15.139:0/2030582173 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40ad190 con 0x7fd7e415cc00 2024-09-13T17:25:09.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e2800700 1 --2- 172.21.15.139:0/2030582173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e415cc00 0x7fd7e40ac890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009850 tx=0x7fd7d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c39881e996f46f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:09.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e1400700 1 -- 172.21.15.139:0/2030582173 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4011830 con 0x7fd7e415cc00 2024-09-13T17:25:09.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e1400700 1 -- 172.21.15.139:0/2030582173 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d4011990 con 0x7fd7e415cc00 2024-09-13T17:25:09.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e1400700 1 -- 172.21.15.139:0/2030582173 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4011d40 con 0x7fd7e415cc00 2024-09-13T17:25:09.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 -- 172.21.15.139:0/2030582173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e415cc00 msgr2=0x7fd7e40ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/2030582173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e415cc00 0x7fd7e40ac890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009850 tx=0x7fd7d4009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 -- 172.21.15.139:0/2030582173 shutdown_connections 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/2030582173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e40adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/2030582173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e415cc00 0x7fd7e40ac890 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 -- 172.21.15.139:0/2030582173 >> 172.21.15.139:0/2030582173 conn(0x7fd7e40ce9d0 msgr2=0x7fd7e40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 -- 172.21.15.139:0/2030582173 shutdown_connections 2024-09-13T17:25:09.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.699+0000 7fd7e8a00700 1 -- 172.21.15.139:0/2030582173 wait complete. 2024-09-13T17:25:09.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 Processor -- start 2024-09-13T17:25:09.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 -- start start 2024-09-13T17:25:09.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e4154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 0x7fd7e4156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7e415cc00 0x7fd7e415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40cba20 con 0x7fd7e40b2b70 2024-09-13T17:25:09.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41566f0 con 0x7fd7e415cc00 2024-09-13T17:25:09.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41569d0 con 0x7fd7e406fe10 2024-09-13T17:25:09.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 0x7fd7e4156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 0x7fd7e4156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51842/0 (socket says 172.21.15.139:51842) 2024-09-13T17:25:09.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 -- 172.21.15.139:0/4119386485 learned_addr learned my addr 172.21.15.139:0/4119386485 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:09.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e3200700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7e415cc00 0x7fd7e415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e2800700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e4154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 -- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 msgr2=0x7fd7e4154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e4154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 -- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7e415cc00 msgr2=0x7fd7e415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7e415cc00 0x7fd7e415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 -- 172.21.15.139:0/4119386485 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40094b0 con 0x7fd7e40b2b70 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e1e00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 0x7fd7e4156010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000e9a0 tx=0x7fd7d000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0009720 con 0x7fd7e40b2b70 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000c850 con 0x7fd7e40b2b70 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000cc00 con 0x7fd7e40b2b70 2024-09-13T17:25:09.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e4156cb0 con 0x7fd7e40b2b70 2024-09-13T17:25:09.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.703+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e415b5c0 con 0x7fd7e40b2b70 2024-09-13T17:25:09.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.707+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e40adbc0 con 0x7fd7e40b2b70 2024-09-13T17:25:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.707+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd7d0013470 con 0x7fd7e40b2b70 2024-09-13T17:25:09.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.711+0000 7fd7daa00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd7c4066730 0x7fd7c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:09.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.711+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7d0084690 con 0x7fd7e40b2b70 2024-09-13T17:25:09.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.711+0000 7fd7e2800700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd7c4066730 0x7fd7c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:09.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.711+0000 7fd7e2800700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd7c4066730 0x7fd7c4068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40090b0 tx=0x7fd7d401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.715+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7d00515a0 con 0x7fd7e40b2b70 2024-09-13T17:25:09.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.895+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7e4070f10 con 0x7fd7e40b2b70 2024-09-13T17:25:09.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.895+0000 7fd7daa00700 1 -- 172.21.15.139:0/4119386485 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7d0054bc0 con 0x7fd7e40b2b70 2024-09-13T17:25:09.901 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:09.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd7c4066730 msgr2=0x7fd7c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd7c4066730 0x7fd7c4068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40090b0 tx=0x7fd7d401c040 comp rx=0 tx=0).stop 2024-09-13T17:25:09.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 msgr2=0x7fd7e4156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:09.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 0x7fd7e4156010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000e9a0 tx=0x7fd7d000ed60 comp rx=0 tx=0).stop 2024-09-13T17:25:09.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 shutdown_connections 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd7c4066730 0x7fd7c4068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7e415cc00 0x7fd7e415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7e40b2b70 0x7fd7e4156010 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 --2- 172.21.15.139:0/4119386485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7e406fe10 0x7fd7e4154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 >> 172.21.15.139:0/4119386485 conn(0x7fd7e40ce9d0 msgr2=0x7fd7e415e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 shutdown_connections 2024-09-13T17:25:09.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:09.899+0000 7fd7e8a00700 1 -- 172.21.15.139:0/4119386485 wait complete. 2024-09-13T17:25:09.925 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:10.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 Processor -- start 2024-09-13T17:25:10.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 -- start start 2024-09-13T17:25:10.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f18a00cfa10 0x7f18a00d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a00d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00b0950 con 0x7f18a015bc50 2024-09-13T17:25:10.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00b17b0 con 0x7f18a00cfa10 2024-09-13T17:25:10.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00b4220 con 0x7f18a00cfe80 2024-09-13T17:25:10.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.111+0000 7f189f400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a00d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a00d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:56088/0 (socket says 172.21.15.139:56088) 2024-09-13T17:25:10.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 -- 172.21.15.139:0/2383880831 learned_addr learned my addr 172.21.15.139:0/2383880831 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:10.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189e000700 1 --2- 172.21.15.139:0/2383880831 >> v2:172.21.15.176:3300/0 conn(0x7f18a00cfa10 0x7f18a00d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189d600700 1 -- 172.21.15.139:0/2383880831 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603148815 0 0) 0x7f18a00b0950 con 0x7f18a015bc50 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189d600700 1 -- 172.21.15.139:0/2383880831 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18840035d0 con 0x7f18a015bc50 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 -- 172.21.15.139:0/2383880831 >> v2:172.21.15.176:3300/0 conn(0x7f18a00cfa10 msgr2=0x7f18a00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 --2- 172.21.15.139:0/2383880831 >> v2:172.21.15.176:3300/0 conn(0x7f18a00cfa10 0x7f18a00d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 -- 172.21.15.139:0/2383880831 >> v1:172.21.15.176:6789/0 conn(0x7f18a015bc50 legacy=0x7f18a00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 -- 172.21.15.139:0/2383880831 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00b0ba0 con 0x7f18a00cfe80 2024-09-13T17:25:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189f400700 1 --2- 172.21.15.139:0/2383880831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a00d0ff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e50 tx=0x7f189800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a250f09056a5d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189d600700 1 -- 172.21.15.139:0/2383880831 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800e070 con 0x7f18a00cfe80 2024-09-13T17:25:10.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189d600700 1 -- 172.21.15.139:0/2383880831 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800b910 con 0x7f18a00cfe80 2024-09-13T17:25:10.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189d600700 1 -- 172.21.15.139:0/2383880831 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800bcc0 con 0x7f18a00cfe80 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 -- 172.21.15.139:0/2383880831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 msgr2=0x7f18a00d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 --2- 172.21.15.139:0/2383880831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a00d0ff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e50 tx=0x7f189800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 -- 172.21.15.139:0/2383880831 shutdown_connections 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 --2- 172.21.15.139:0/2383880831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a00d0ff0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 --2- 172.21.15.139:0/2383880831 >> v2:172.21.15.176:3300/0 conn(0x7f18a00cfa10 0x7f18a00d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 -- 172.21.15.139:0/2383880831 >> 172.21.15.139:0/2383880831 conn(0x7f18a00721a0 msgr2=0x7f18a006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 -- 172.21.15.139:0/2383880831 shutdown_connections 2024-09-13T17:25:10.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.115+0000 7f189fe00700 1 -- 172.21.15.139:0/2383880831 wait complete. 2024-09-13T17:25:10.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 Processor -- start 2024-09-13T17:25:10.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 -- start start 2024-09-13T17:25:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 0x7f18a00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a0146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a015bc50 0x7f18a0147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0146690 con 0x7f18a00cfa10 2024-09-13T17:25:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01486e0 con 0x7f18a015bc50 2024-09-13T17:25:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0147850 con 0x7f18a00cfe80 2024-09-13T17:25:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 0x7f18a00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189f400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a015bc50 0x7f18a0147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 0x7f18a00ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51854/0 (socket says 172.21.15.139:51854) 2024-09-13T17:25:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189ea00700 1 -- 172.21.15.139:0/199890571 learned_addr learned my addr 172.21.15.139:0/199890571 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.119+0000 7f189e000700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a0146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189ea00700 1 -- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 msgr2=0x7f18a0146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189ea00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a0146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189ea00700 1 -- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a015bc50 msgr2=0x7f18a0147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189ea00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a015bc50 0x7f18a0147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189ea00700 1 -- 172.21.15.139:0/199890571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1898009b30 con 0x7f18a00cfa10 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189f400700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a015bc50 0x7f18a0147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189ea00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 0x7f18a00ca590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f189000c760 tx=0x7f189000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900052d0 con 0x7f18a00cfa10 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890005450 con 0x7f18a00cfa10 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900038e0 con 0x7f18a00cfa10 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0147ad0 con 0x7f18a00cfa10 2024-09-13T17:25:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a0148090 con 0x7f18a00cfa10 2024-09-13T17:25:10.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.123+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a015b460 con 0x7f18a00cfa10 2024-09-13T17:25:10.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.127+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1890003a40 con 0x7f18a00cfa10 2024-09-13T17:25:10.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.127+0000 7f1896a00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1880066730 0x7f1880068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.127+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18900839e0 con 0x7f18a00cfa10 2024-09-13T17:25:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.127+0000 7f189e000700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1880066730 0x7f1880068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.131+0000 7f189e000700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1880066730 0x7f1880068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18a01f9fb0 tx=0x7f188c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.131+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18900508f0 con 0x7f18a00cfa10 2024-09-13T17:25:10.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.311+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18a006abd0 con 0x7f18a00cfa10 2024-09-13T17:25:10.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.311+0000 7f1896a00700 1 -- 172.21.15.139:0/199890571 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1890053f10 con 0x7f18a00cfa10 2024-09-13T17:25:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.315+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1880066730 msgr2=0x7f1880068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.315+0000 7f189fe00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1880066730 0x7f1880068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18a01f9fb0 tx=0x7f188c009240 comp rx=0 tx=0).stop 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.315+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 msgr2=0x7f18a00ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.315+0000 7f189fe00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 0x7f18a00ca590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f189000c760 tx=0x7f189000ca70 comp rx=0 tx=0).stop 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 shutdown_connections 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1880066730 0x7f1880068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a015bc50 0x7f18a0147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cfe80 0x7f18a0146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 --2- 172.21.15.139:0/199890571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a00cfa10 0x7f18a00ca590 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 >> 172.21.15.139:0/199890571 conn(0x7f18a00721a0 msgr2=0x7f18a00b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:10.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 shutdown_connections 2024-09-13T17:25:10.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.319+0000 7f189fe00700 1 -- 172.21.15.139:0/199890571 wait complete. 2024-09-13T17:25:10.344 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:10.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.511+0000 7ff51b000700 1 Processor -- start 2024-09-13T17:25:10.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.511+0000 7ff51b000700 1 -- start start 2024-09-13T17:25:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff51b000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff514071190 0x7ff51415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff51b000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff514071570 0x7ff514159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff51b000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51413f0c0 con 0x7ff51413f810 2024-09-13T17:25:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff51b000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51415a4a0 con 0x7ff514071570 2024-09-13T17:25:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff51b000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51415a720 con 0x7ff514071190 2024-09-13T17:25:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff514071570 0x7ff514159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff514071570 0x7ff514159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51866/0 (socket says 172.21.15.139:51866) 2024-09-13T17:25:10.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 -- 172.21.15.139:0/2779957695 learned_addr learned my addr 172.21.15.139:0/2779957695 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:10.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519c00700 1 --2- 172.21.15.139:0/2779957695 >> v2:172.21.15.176:3300/0 conn(0x7ff514071190 0x7ff51415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 -- 172.21.15.139:0/2779957695 >> v2:172.21.15.176:3300/0 conn(0x7ff514071190 msgr2=0x7ff51415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 --2- 172.21.15.139:0/2779957695 >> v2:172.21.15.176:3300/0 conn(0x7ff514071190 0x7ff51415dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 -- 172.21.15.139:0/2779957695 >> v1:172.21.15.176:6789/0 conn(0x7ff51413f810 legacy=0x7ff51413d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 -- 172.21.15.139:0/2779957695 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51415aa00 con 0x7ff514071570 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.515+0000 7ff519200700 1 --2- 172.21.15.139:0/2779957695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514159f60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cf980 tx=0x7ff500009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16818289c73cb2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff513e00700 1 -- 172.21.15.139:0/2779957695 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000b8a0 con 0x7ff514071570 2024-09-13T17:25:10.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff513e00700 1 -- 172.21.15.139:0/2779957695 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50000ba00 con 0x7ff514071570 2024-09-13T17:25:10.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff513e00700 1 -- 172.21.15.139:0/2779957695 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000bd90 con 0x7ff514071570 2024-09-13T17:25:10.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 -- 172.21.15.139:0/2779957695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 msgr2=0x7ff514159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 --2- 172.21.15.139:0/2779957695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514159f60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cf980 tx=0x7ff500009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 -- 172.21.15.139:0/2779957695 shutdown_connections 2024-09-13T17:25:10.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 --2- 172.21.15.139:0/2779957695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514159f60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 --2- 172.21.15.139:0/2779957695 >> v2:172.21.15.176:3300/0 conn(0x7ff514071190 0x7ff51415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 -- 172.21.15.139:0/2779957695 >> 172.21.15.139:0/2779957695 conn(0x7ff5140ce9d0 msgr2=0x7ff5140cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:10.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 -- 172.21.15.139:0/2779957695 shutdown_connections 2024-09-13T17:25:10.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.519+0000 7ff51b000700 1 -- 172.21.15.139:0/2779957695 wait complete. 2024-09-13T17:25:10.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 Processor -- start 2024-09-13T17:25:10.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 -- start start 2024-09-13T17:25:10.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff514071190 0x7ff51413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51413f810 0x7ff51406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51413ca10 con 0x7ff514071570 2024-09-13T17:25:10.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514153fa0 con 0x7ff51413f810 2024-09-13T17:25:10.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51b000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514154280 con 0x7ff514071190 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51878/0 (socket says 172.21.15.139:51878) 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 -- 172.21.15.139:0/3858202672 learned_addr learned my addr 172.21.15.139:0/3858202672 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519c00700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff514071190 0x7ff51413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff51a600700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51413f810 0x7ff51406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 -- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff514071190 msgr2=0x7ff51413c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff514071190 0x7ff51413c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 -- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51413f810 msgr2=0x7ff51406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51413f810 0x7ff51406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 -- 172.21.15.139:0/3858202672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500009570 con 0x7ff514071570 2024-09-13T17:25:10.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519c00700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff514071190 0x7ff51413c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.523+0000 7ff519200700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514153630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cdc20 tx=0x7ff500004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.527+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000036c0 con 0x7ff514071570 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.527+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50001f070 con 0x7ff514071570 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.527+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500003a80 con 0x7ff514071570 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.527+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5141f2620 con 0x7ff514071570 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.527+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5141f2be0 con 0x7ff514071570 2024-09-13T17:25:10.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.527+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514159f60 con 0x7ff514071570 2024-09-13T17:25:10.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.531+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff500021030 con 0x7ff514071570 2024-09-13T17:25:10.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.531+0000 7ff511600700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff4f4066730 0x7ff4f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.531+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff500085b70 con 0x7ff514071570 2024-09-13T17:25:10.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.531+0000 7ff519c00700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff4f4066730 0x7ff4f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.531+0000 7ff519c00700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff4f4066730 0x7ff4f4068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5140b0730 tx=0x7ff508003aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.539+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff500052b30 con 0x7ff514071570 2024-09-13T17:25:10.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.719+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5141540e0 con 0x7ff514071570 2024-09-13T17:25:10.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.719+0000 7ff511600700 1 -- 172.21.15.139:0/3858202672 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5141540e0 con 0x7ff514071570 2024-09-13T17:25:10.722 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:10.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.719+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff4f4066730 msgr2=0x7ff4f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.719+0000 7ff51b000700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff4f4066730 0x7ff4f4068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5140b0730 tx=0x7ff508003aa0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.719+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 msgr2=0x7ff514153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.719+0000 7ff51b000700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514153630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cdc20 tx=0x7ff500004770 comp rx=0 tx=0).stop 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 shutdown_connections 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff4f4066730 0x7ff4f4068bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51413f810 0x7ff51406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff514071570 0x7ff514153630 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 --2- 172.21.15.139:0/3858202672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff514071190 0x7ff51413c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 >> 172.21.15.139:0/3858202672 conn(0x7ff5140ce9d0 msgr2=0x7ff5140cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 shutdown_connections 2024-09-13T17:25:10.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.723+0000 7ff51b000700 1 -- 172.21.15.139:0/3858202672 wait complete. 2024-09-13T17:25:10.752 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:10.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 Processor -- start 2024-09-13T17:25:10.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 -- start start 2024-09-13T17:25:10.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2510144770 0x7f25100ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f251006d9b0 0x7f251015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251015c160 con 0x7f251015b1c0 2024-09-13T17:25:10.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251015c540 con 0x7f2510144770 2024-09-13T17:25:10.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2517800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2510144b50 con 0x7f251006d9b0 2024-09-13T17:25:10.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f2514e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2510144770 0x7f25100ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f250fe00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f251015b1c0 0x7f251006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58644/0 (socket says 172.21.15.139:58644) 2024-09-13T17:25:10.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.927+0000 7f250fe00700 1 -- 172.21.15.139:0/1758017230 learned_addr learned my addr 172.21.15.139:0/1758017230 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2515800700 1 --2- 172.21.15.139:0/1758017230 >> v2:172.21.15.176:3300/0 conn(0x7f251006d9b0 0x7f251015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f250f400700 1 -- 172.21.15.139:0/1758017230 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282594046 0 0) 0x7f251015c160 con 0x7f251015b1c0 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f250f400700 1 -- 172.21.15.139:0/1758017230 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f80035d0 con 0x7f251015b1c0 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2514e00700 1 -- 172.21.15.139:0/1758017230 >> v2:172.21.15.176:3300/0 conn(0x7f251006d9b0 msgr2=0x7f251015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2514e00700 1 --2- 172.21.15.139:0/1758017230 >> v2:172.21.15.176:3300/0 conn(0x7f251006d9b0 0x7f251015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2514e00700 1 -- 172.21.15.139:0/1758017230 >> v1:172.21.15.139:6789/0 conn(0x7f251015b1c0 legacy=0x7f251006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2514e00700 1 -- 172.21.15.139:0/1758017230 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251015b620 con 0x7f2510144770 2024-09-13T17:25:10.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2514e00700 1 --2- 172.21.15.139:0/1758017230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f25100ce5f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f25100cbbd0 tx=0x7f2504009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985e93c6f0f7f45c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f250f400700 1 -- 172.21.15.139:0/1758017230 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504011830 con 0x7f2510144770 2024-09-13T17:25:10.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f250f400700 1 -- 172.21.15.139:0/1758017230 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504011990 con 0x7f2510144770 2024-09-13T17:25:10.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f250f400700 1 -- 172.21.15.139:0/1758017230 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504011d20 con 0x7f2510144770 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 -- 172.21.15.139:0/1758017230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 msgr2=0x7f25100ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 --2- 172.21.15.139:0/1758017230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f25100ce5f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f25100cbbd0 tx=0x7f2504009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 -- 172.21.15.139:0/1758017230 shutdown_connections 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 --2- 172.21.15.139:0/1758017230 >> v2:172.21.15.176:3300/0 conn(0x7f251006d9b0 0x7f251015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 --2- 172.21.15.139:0/1758017230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f25100ce5f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 -- 172.21.15.139:0/1758017230 >> 172.21.15.139:0/1758017230 conn(0x7f251006b1e0 msgr2=0x7f251006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 -- 172.21.15.139:0/1758017230 shutdown_connections 2024-09-13T17:25:10.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.931+0000 7f2517800700 1 -- 172.21.15.139:0/1758017230 wait complete. 2024-09-13T17:25:10.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 Processor -- start 2024-09-13T17:25:10.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 -- start start 2024-09-13T17:25:10.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f251006d9b0 0x7f25100c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f251015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f251015b1c0 0x7f25101f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251015ada0 con 0x7f2510144770 2024-09-13T17:25:10.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100c68b0 con 0x7f251006d9b0 2024-09-13T17:25:10.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2517800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25101f2eb0 con 0x7f251015b1c0 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f250fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f251015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f250fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f251015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51892/0 (socket says 172.21.15.139:51892) 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f250fe00700 1 -- 172.21.15.139:0/2120337719 learned_addr learned my addr 172.21.15.139:0/2120337719 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.935+0000 7f2514e00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f251006d9b0 0x7f25100c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f2515800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f251015b1c0 0x7f25101f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250fe00700 1 -- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f251015b1c0 msgr2=0x7f25101f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250fe00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f251015b1c0 0x7f25101f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250fe00700 1 -- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f251006d9b0 msgr2=0x7f25100c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250fe00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f251006d9b0 0x7f25100c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250fe00700 1 -- 172.21.15.139:0/2120337719 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040094b0 con 0x7f2510144770 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250fe00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f251015a860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c4d0 tx=0x7f24fc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc005d90 con 0x7f2510144770 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc0070d0 con 0x7f2510144770 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25100c8950 con 0x7f2510144770 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc007480 con 0x7f2510144770 2024-09-13T17:25:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25100c8f10 con 0x7f2510144770 2024-09-13T17:25:10.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.939+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25100ce5f0 con 0x7f2510144770 2024-09-13T17:25:10.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.943+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24fc0075e0 con 0x7f2510144770 2024-09-13T17:25:10.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.943+0000 7f250cc00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f24f0066730 0x7f24f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:10.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.943+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24fc083a30 con 0x7f2510144770 2024-09-13T17:25:10.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.943+0000 7f2514e00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f24f0066730 0x7f24f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.943+0000 7f2514e00700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f24f0066730 0x7f24f0068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2504000c00 tx=0x7f2504008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:10.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:10.951+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24fc050960 con 0x7f2510144770 2024-09-13T17:25:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.131+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f25100c69f0 con 0x7f2510144770 2024-09-13T17:25:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.131+0000 7f250cc00700 1 -- 172.21.15.139:0/2120337719 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24fc053f80 con 0x7f2510144770 2024-09-13T17:25:11.136 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f24f0066730 msgr2=0x7f24f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f24f0066730 0x7f24f0068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2504000c00 tx=0x7f2504008030 comp rx=0 tx=0).stop 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 msgr2=0x7f251015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f251015a860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c4d0 tx=0x7f24fc00c7e0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 shutdown_connections 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f24f0066730 0x7f24f0068bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f251015b1c0 0x7f25101f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2510144770 0x7f251015a860 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 --2- 172.21.15.139:0/2120337719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f251006d9b0 0x7f25100c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 >> 172.21.15.139:0/2120337719 conn(0x7f251006b1e0 msgr2=0x7f25100cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 shutdown_connections 2024-09-13T17:25:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.135+0000 7f2517800700 1 -- 172.21.15.139:0/2120337719 wait complete. 2024-09-13T17:25:11.196 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2024-09-13T17:25:11.196 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2024-09-13T17:25:11.197 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:11.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.359+0000 7f4a21400700 1 Processor -- start 2024-09-13T17:25:11.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.359+0000 7f4a21400700 1 -- start start 2024-09-13T17:25:11.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a21400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c0d1740 0x7f4a1c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a21400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4a1c15e030 0x7f4a1c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a21400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0b1740 con 0x7f4a1c146690 2024-09-13T17:25:11.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a21400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0d08c0 con 0x7f4a1c15e030 2024-09-13T17:25:11.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a21400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b1990 con 0x7f4a1c0d1740 2024-09-13T17:25:11.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1be00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f4a1c146690 0x7f4a1c0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58658/0 (socket says 172.21.15.139:58658) 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1be00700 1 -- 172.21.15.139:0/414842426 learned_addr learned my addr 172.21.15.139:0/414842426 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a20a00700 1 --2- 172.21.15.139:0/414842426 >> v2:172.21.15.139:3300/0 conn(0x7f4a1c15e030 0x7f4a1c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a13400700 1 --2- 172.21.15.139:0/414842426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c0d1740 0x7f4a1c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1b400700 1 -- 172.21.15.139:0/414842426 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292787943 0 0) 0x7f4a1c0b1740 con 0x7f4a1c146690 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1b400700 1 -- 172.21.15.139:0/414842426 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000035d0 con 0x7f4a1c146690 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a20a00700 1 -- 172.21.15.139:0/414842426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c0d1740 msgr2=0x7f4a1c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a20a00700 1 --2- 172.21.15.139:0/414842426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c0d1740 0x7f4a1c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a20a00700 1 -- 172.21.15.139:0/414842426 >> v1:172.21.15.139:6789/0 conn(0x7f4a1c146690 legacy=0x7f4a1c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a20a00700 1 -- 172.21.15.139:0/414842426 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0b1c70 con 0x7f4a1c15e030 2024-09-13T17:25:11.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a20a00700 1 --2- 172.21.15.139:0/414842426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c15e030 0x7f4a1c0b2750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009d90 tx=0x7f4a1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4d925faa56e33e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1b400700 1 -- 172.21.15.139:0/414842426 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400e070 con 0x7f4a1c15e030 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1b400700 1 -- 172.21.15.139:0/414842426 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400bb20 con 0x7f4a1c15e030 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.363+0000 7f4a1b400700 1 -- 172.21.15.139:0/414842426 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14012430 con 0x7f4a1c15e030 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 -- 172.21.15.139:0/414842426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c15e030 msgr2=0x7f4a1c0b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 --2- 172.21.15.139:0/414842426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c15e030 0x7f4a1c0b2750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009d90 tx=0x7f4a1400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 -- 172.21.15.139:0/414842426 shutdown_connections 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 --2- 172.21.15.139:0/414842426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c15e030 0x7f4a1c0b2750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 --2- 172.21.15.139:0/414842426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c0d1740 0x7f4a1c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 -- 172.21.15.139:0/414842426 >> 172.21.15.139:0/414842426 conn(0x7f4a1c071fa0 msgr2=0x7f4a1c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:11.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 -- 172.21.15.139:0/414842426 shutdown_connections 2024-09-13T17:25:11.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 -- 172.21.15.139:0/414842426 wait complete. 2024-09-13T17:25:11.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 Processor -- start 2024-09-13T17:25:11.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.367+0000 7f4a21400700 1 -- start start 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 0x7f4a1c13f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1c146690 0x7f4a1c141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c15e030 0x7f4a1c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0ca050 con 0x7f4a1c0d1740 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c13fd80 con 0x7f4a1c146690 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c1f61c0 con 0x7f4a1c15e030 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 0x7f4a1c13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 0x7f4a1c13f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51912/0 (socket says 172.21.15.139:51912) 2024-09-13T17:25:11.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 -- 172.21.15.139:0/862957735 learned_addr learned my addr 172.21.15.139:0/862957735 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a13400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1c146690 0x7f4a1c141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a20a00700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c15e030 0x7f4a1c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 -- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c15e030 msgr2=0x7f4a1c06ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c15e030 0x7f4a1c06ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 -- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1c146690 msgr2=0x7f4a1c141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1c146690 0x7f4a1c141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 -- 172.21.15.139:0/862957735 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14009a70 con 0x7f4a1c0d1740 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a1be00700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 0x7f4a1c13f840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c700 tx=0x7f4a0c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c005d90 con 0x7f4a1c0d1740 2024-09-13T17:25:11.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0070d0 con 0x7f4a1c0d1740 2024-09-13T17:25:11.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c007480 con 0x7f4a1c0d1740 2024-09-13T17:25:11.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c1f64a0 con 0x7f4a1c0d1740 2024-09-13T17:25:11.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.371+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c1f6a60 con 0x7f4a1c0d1740 2024-09-13T17:25:11.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.375+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c0677e0 con 0x7f4a1c0d1740 2024-09-13T17:25:11.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.375+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a0c0075e0 con 0x7f4a1c0d1740 2024-09-13T17:25:11.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.375+0000 7f4a18c00700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066730 0x7f49f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.375+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a0c0839d0 con 0x7f4a1c0d1740 2024-09-13T17:25:11.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.375+0000 7f4a13400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066730 0x7f49f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.379+0000 7f4a13400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066730 0x7f49f8068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c15da90 tx=0x7f4a04009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:11.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.383+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a0c050a10 con 0x7f4a1c0d1740 2024-09-13T17:25:11.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.575+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a1c146a70 con 0x7f4a1c0d1740 2024-09-13T17:25:11.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.579+0000 7f4a18c00700 1 -- 172.21.15.139:0/862957735 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7f4a0c054030 con 0x7f4a1c0d1740 2024-09-13T17:25:11.582 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:11.582 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066730 msgr2=0x7f49f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066730 0x7f49f8068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c15da90 tx=0x7f4a04009240 comp rx=0 tx=0).stop 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 msgr2=0x7f4a1c13f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 0x7f4a1c13f840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c700 tx=0x7f4a0c00ca10 comp rx=0 tx=0).stop 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 shutdown_connections 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f49f8066730 0x7f49f8068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1c15e030 0x7f4a1c06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a1c146690 0x7f4a1c141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 --2- 172.21.15.139:0/862957735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1c0d1740 0x7f4a1c13f840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 >> 172.21.15.139:0/862957735 conn(0x7f4a1c071fa0 msgr2=0x7f4a1c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 shutdown_connections 2024-09-13T17:25:11.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.583+0000 7f4a21400700 1 -- 172.21.15.139:0/862957735 wait complete. 2024-09-13T17:25:11.608 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:11.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:11.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.779+0000 7f44e6e00700 1 Processor -- start 2024-09-13T17:25:11.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.779+0000 7f44e6e00700 1 -- start start 2024-09-13T17:25:11.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e6e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f44e00c8ed0 0x7f44e00c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e6e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e006cd90 con 0x7f44e0146b40 2024-09-13T17:25:11.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e6e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e00c9820 con 0x7f44e006b140 2024-09-13T17:25:11.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e6e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e006c260 con 0x7f44e00c8ed0 2024-09-13T17:25:11.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44dfe00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f44e0146b40 0x7f44e0161570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58660/0 (socket says 172.21.15.139:58660) 2024-09-13T17:25:11.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44dfe00700 1 -- 172.21.15.139:0/3974833919 learned_addr learned my addr 172.21.15.139:0/3974833919 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:11.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e4e00700 1 --2- 172.21.15.139:0/3974833919 >> v2:172.21.15.176:3300/0 conn(0x7f44e00c8ed0 0x7f44e00c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44dea00700 1 -- 172.21.15.139:0/3974833919 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078757029 0 0) 0x7f44e006cd90 con 0x7f44e0146b40 2024-09-13T17:25:11.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44dea00700 1 -- 172.21.15.139:0/3974833919 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c40035d0 con 0x7f44e0146b40 2024-09-13T17:25:11.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e4e00700 1 -- 172.21.15.139:0/3974833919 >> v1:172.21.15.176:6789/0 conn(0x7f44e006b140 legacy=0x7f44e006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e4e00700 1 -- 172.21.15.139:0/3974833919 >> v1:172.21.15.139:6789/0 conn(0x7f44e0146b40 legacy=0x7f44e0161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.783+0000 7f44e4e00700 1 -- 172.21.15.139:0/3974833919 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e006b5e0 con 0x7f44e00c8ed0 2024-09-13T17:25:11.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.787+0000 7f44e4e00700 1 --2- 172.21.15.139:0/3974833919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00c92e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009d90 tx=0x7f44d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a435a0d0ec0137 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:11.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.787+0000 7f44dea00700 1 -- 172.21.15.139:0/3974833919 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800e070 con 0x7f44e00c8ed0 2024-09-13T17:25:11.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44dea00700 1 -- 172.21.15.139:0/3974833919 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800bb20 con 0x7f44e00c8ed0 2024-09-13T17:25:11.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44dea00700 1 -- 172.21.15.139:0/3974833919 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800be90 con 0x7f44e00c8ed0 2024-09-13T17:25:11.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 -- 172.21.15.139:0/3974833919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 msgr2=0x7f44e00c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3974833919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00c92e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009d90 tx=0x7f44d800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:11.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 -- 172.21.15.139:0/3974833919 shutdown_connections 2024-09-13T17:25:11.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3974833919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00c92e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 -- 172.21.15.139:0/3974833919 >> 172.21.15.139:0/3974833919 conn(0x7f44e00cfa80 msgr2=0x7f44e00cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:11.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 -- 172.21.15.139:0/3974833919 shutdown_connections 2024-09-13T17:25:11.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.791+0000 7f44e6e00700 1 -- 172.21.15.139:0/3974833919 wait complete. 2024-09-13T17:25:11.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 Processor -- start 2024-09-13T17:25:11.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 -- start start 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44e006b140 0x7f44e00a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 0x7f44e00ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0151c70 con 0x7f44e0146b40 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0150ff0 con 0x7f44e00c8ed0 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.795+0000 7f44e6e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01512d0 con 0x7f44e006b140 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 0x7f44e00ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44dfe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44e006b140 0x7f44e00a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 0x7f44e00ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51918/0 (socket says 172.21.15.139:51918) 2024-09-13T17:25:11.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 -- 172.21.15.139:0/3658585810 learned_addr learned my addr 172.21.15.139:0/3658585810 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:11.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44df400700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 -- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44e006b140 msgr2=0x7f44e00a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44e006b140 0x7f44e00a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 -- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 msgr2=0x7f44e00ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 -- 172.21.15.139:0/3658585810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d8009a70 con 0x7f44e0146b40 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44dfe00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44e006b140 0x7f44e00a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e4e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 0x7f44e00ac9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f44e00c99d0 tx=0x7f44d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:11.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8012630 con 0x7f44e0146b40 2024-09-13T17:25:11.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d8004980 con 0x7f44e0146b40 2024-09-13T17:25:11.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d80129d0 con 0x7f44e0146b40 2024-09-13T17:25:11.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e01515b0 con 0x7f44e0146b40 2024-09-13T17:25:11.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e0150c10 con 0x7f44e0146b40 2024-09-13T17:25:11.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.799+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e0150da0 con 0x7f44e0146b40 2024-09-13T17:25:11.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.803+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44d8012b30 con 0x7f44e0146b40 2024-09-13T17:25:11.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.803+0000 7f44d7e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f44c0066760 0x7f44c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:11.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.803+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44d8086250 con 0x7f44e0146b40 2024-09-13T17:25:11.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.803+0000 7f44dfe00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f44c0066760 0x7f44c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:11.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.807+0000 7f44dfe00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f44c0066760 0x7f44c0068c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44d0007fd0 tx=0x7f44d0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:11.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.811+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44d8053460 con 0x7f44e0146b40 2024-09-13T17:25:11.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.987+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44e00d22d0 con 0x7f44e0146b40 2024-09-13T17:25:11.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.991+0000 7f44d7e00700 1 -- 172.21.15.139:0/3658585810 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44d8056a80 con 0x7f44e0146b40 2024-09-13T17:25:11.993 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:11.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f44c0066760 msgr2=0x7f44c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f44c0066760 0x7f44c0068c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44d0007fd0 tx=0x7f44d0007de0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 msgr2=0x7f44e00ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:11.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 0x7f44e00ac9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f44e00c99d0 tx=0x7f44d8004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 shutdown_connections 2024-09-13T17:25:11.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f44c0066760 0x7f44c0068c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0146b40 0x7f44e00ac9f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44e00c8ed0 0x7f44e00ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 --2- 172.21.15.139:0/3658585810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44e006b140 0x7f44e00a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:11.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 >> 172.21.15.139:0/3658585810 conn(0x7f44e00cfa80 msgr2=0x7f44e00cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:11.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 shutdown_connections 2024-09-13T17:25:11.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:11.995+0000 7f44e6e00700 1 -- 172.21.15.139:0/3658585810 wait complete. 2024-09-13T17:25:12.020 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:12.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.195+0000 7f0196600700 1 Processor -- start 2024-09-13T17:25:12.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.195+0000 7f0196600700 1 -- start start 2024-09-13T17:25:12.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f0196600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f01901554d0 0x7f019006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f0196600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019006ad70 con 0x7f019015b2b0 2024-09-13T17:25:12.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f0196600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019015bb70 con 0x7f01900cf300 2024-09-13T17:25:12.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f0196600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900af210 con 0x7f01901554d0 2024-09-13T17:25:12.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018ea00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f019015b2b0 0x7f01900cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58668/0 (socket says 172.21.15.139:58668) 2024-09-13T17:25:12.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018ea00700 1 -- 172.21.15.139:0/1906713369 learned_addr learned my addr 172.21.15.139:0/1906713369 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:12.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018f400700 1 --2- 172.21.15.139:0/1906713369 >> v2:172.21.15.176:3300/0 conn(0x7f01901554d0 0x7f019006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566085511 0 0) 0x7f019006ad70 con 0x7f019015b2b0 2024-09-13T17:25:12.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01740035d0 con 0x7f019015b2b0 2024-09-13T17:25:12.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2198896725 0 0) 0x7f01740035d0 con 0x7f019015b2b0 2024-09-13T17:25:12.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 >> v2:172.21.15.176:3300/0 conn(0x7f01901554d0 msgr2=0x7f019006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:12.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 --2- 172.21.15.139:0/1906713369 >> v2:172.21.15.176:3300/0 conn(0x7f01901554d0 0x7f019006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 >> v1:172.21.15.176:6789/0 conn(0x7f01900cf300 legacy=0x7f019006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019015be50 con 0x7f019015b2b0 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f017c001670 con 0x7f019015b2b0 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 >> v1:172.21.15.139:6789/0 conn(0x7f019015b2b0 legacy=0x7f01900cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0174003a20 0x7f0174003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174004870 0x7f0174004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0174005230 0x7f017400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900af210 con 0x7f0174003a20 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017400c0d0 con 0x7f0174004870 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017400c290 con 0x7f0174005230 2024-09-13T17:25:12.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018f400700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0174003a20 0x7f0174003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.199+0000 7f018ea00700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174004870 0x7f0174004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018fe00700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0174005230 0x7f017400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018f400700 1 -- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0174005230 msgr2=0x7f017400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018f400700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0174005230 0x7f017400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018f400700 1 -- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174004870 msgr2=0x7f0174004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018f400700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174004870 0x7f0174004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018f400700 1 -- 172.21.15.139:0/1906713369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740035d0 con 0x7f0174003a20 2024-09-13T17:25:12.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018fe00700 1 -- 172.21.15.139:0/1906713369 reap_dead start 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018f400700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0174003a20 0x7f0174003e40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0180009b70 tx=0x7f01740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3ebce3f8cbf8a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000e6c0 con 0x7f0174003a20 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018000e820 con 0x7f0174003a20 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f018e000700 1 -- 172.21.15.139:0/1906713369 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000eb90 con 0x7f0174003a20 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 -- 172.21.15.139:0/1906713369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0174003a20 msgr2=0x7f0174003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0174003a20 0x7f0174003e40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0180009b70 tx=0x7f01740058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 -- 172.21.15.139:0/1906713369 shutdown_connections 2024-09-13T17:25:12.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 --2- 172.21.15.139:0/1906713369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0174003a20 0x7f0174003e40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 -- 172.21.15.139:0/1906713369 >> 172.21.15.139:0/1906713369 conn(0x7f0190071170 msgr2=0x7f0190071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:12.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 -- 172.21.15.139:0/1906713369 shutdown_connections 2024-09-13T17:25:12.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.203+0000 7f0196600700 1 -- 172.21.15.139:0/1906713369 wait complete. 2024-09-13T17:25:12.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 Processor -- start 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 -- start start 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174003a20 0x7f0190155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01901e7af0 0x7f01901e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 0x7f01900cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901e84b0 con 0x7f01900ccc10 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019013d6c0 con 0x7f0174003a20 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f0196600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900cd940 con 0x7f01901e7af0 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 0x7f01900cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 0x7f01900cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51926/0 (socket says 172.21.15.139:51926) 2024-09-13T17:25:12.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 -- 172.21.15.139:0/3685885925 learned_addr learned my addr 172.21.15.139:0/3685885925 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:12.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018ea00700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01901e7af0 0x7f01901e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018f400700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174003a20 0x7f0190155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 -- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01901e7af0 msgr2=0x7f01901e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01901e7af0 0x7f01901e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 -- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174003a20 msgr2=0x7f0190155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174003a20 0x7f0190155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018fe00700 1 -- 172.21.15.139:0/3685885925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900cdc20 con 0x7f01900ccc10 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.207+0000 7f018f400700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174003a20 0x7f0190155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f018fe00700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 0x7f01900cd0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f019015b690 tx=0x7f018800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188003c30 con 0x7f01900ccc10 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188003d90 con 0x7f01900ccc10 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188005310 con 0x7f01900ccc10 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01900cdf00 con 0x7f01900ccc10 2024-09-13T17:25:12.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01900ce4c0 con 0x7f01900ccc10 2024-09-13T17:25:12.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019006dd80 con 0x7f01900ccc10 2024-09-13T17:25:12.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.211+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0188005470 con 0x7f01900ccc10 2024-09-13T17:25:12.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.215+0000 7f0187400700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0170066730 0x7f0170068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.215+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0188084510 con 0x7f01900ccc10 2024-09-13T17:25:12.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.215+0000 7f018f400700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0170066730 0x7f0170068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.215+0000 7f018f400700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0170066730 0x7f0170068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f01800090b0 tx=0x7f0180008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:12.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.223+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0188051420 con 0x7f01900ccc10 2024-09-13T17:25:12.383 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:12.389 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:12.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.395+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01900b53d0 con 0x7f01900ccc10 2024-09-13T17:25:12.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.395+0000 7f0187400700 1 -- 172.21.15.139:0/3685885925 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0188054a40 con 0x7f01900ccc10 2024-09-13T17:25:12.399 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0170066730 msgr2=0x7f0170068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0170066730 0x7f0170068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f01800090b0 tx=0x7f0180008030 comp rx=0 tx=0).stop 2024-09-13T17:25:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 msgr2=0x7f01900cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 0x7f01900cd0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f019015b690 tx=0x7f018800edd0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 shutdown_connections 2024-09-13T17:25:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f0170066730 0x7f0170068bf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01900ccc10 0x7f01900cd0c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01901e7af0 0x7f01901e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 --2- 172.21.15.139:0/3685885925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0174003a20 0x7f0190155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 >> 172.21.15.139:0/3685885925 conn(0x7f0190071170 msgr2=0x7f01900ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 shutdown_connections 2024-09-13T17:25:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.399+0000 7f0196600700 1 -- 172.21.15.139:0/3685885925 wait complete. 2024-09-13T17:25:12.423 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:12.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.631+0000 7fd050a00700 1 Processor -- start 2024-09-13T17:25:12.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.631+0000 7fd050a00700 1 -- start start 2024-09-13T17:25:12.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd050a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd04c15aff0 0x7fd04c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd050a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd04c0cdc00 0x7fd04c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd050a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c070140 con 0x7fd04c144300 2024-09-13T17:25:12.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd050a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0ce0b0 con 0x7fd04c15aff0 2024-09-13T17:25:12.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd050a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c070420 con 0x7fd04c0cdc00 2024-09-13T17:25:12.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd04c15aff0 0x7fd04c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd04c15aff0 0x7fd04c0cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51940/0 (socket says 172.21.15.139:51940) 2024-09-13T17:25:12.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 -- 172.21.15.139:0/1544515119 learned_addr learned my addr 172.21.15.139:0/1544515119 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 -- 172.21.15.139:0/1544515119 >> v2:172.21.15.176:3300/0 conn(0x7fd04c0cdc00 msgr2=0x7fd04c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd04be00700 1 --2- 172.21.15.139:0/1544515119 >> v2:172.21.15.176:3300/0 conn(0x7fd04c0cdc00 0x7fd04c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 --2- 172.21.15.139:0/1544515119 >> v2:172.21.15.176:3300/0 conn(0x7fd04c0cdc00 0x7fd04c0711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 -- 172.21.15.139:0/1544515119 >> v1:172.21.15.176:6789/0 conn(0x7fd04c144300 legacy=0x7fd04c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 -- 172.21.15.139:0/1544515119 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c070700 con 0x7fd04c15aff0 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd04be00700 1 --2- 172.21.15.139:0/1544515119 >> v2:172.21.15.176:3300/0 conn(0x7fd04c0cdc00 0x7fd04c0711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.635+0000 7fd042a00700 1 --2- 172.21.15.139:0/1544515119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c15aff0 0x7fd04c0cd6c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd034009910 tx=0x7fd034009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c24896dd51b081 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd04aa00700 1 -- 172.21.15.139:0/1544515119 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400ba20 con 0x7fd04c15aff0 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd04aa00700 1 -- 172.21.15.139:0/1544515119 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400bb80 con 0x7fd04c15aff0 2024-09-13T17:25:12.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd04aa00700 1 -- 172.21.15.139:0/1544515119 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034009e60 con 0x7fd04c15aff0 2024-09-13T17:25:12.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 -- 172.21.15.139:0/1544515119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c15aff0 msgr2=0x7fd04c0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 --2- 172.21.15.139:0/1544515119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c15aff0 0x7fd04c0cd6c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd034009910 tx=0x7fd034009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:12.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 -- 172.21.15.139:0/1544515119 shutdown_connections 2024-09-13T17:25:12.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 --2- 172.21.15.139:0/1544515119 >> v2:172.21.15.176:3300/0 conn(0x7fd04c0cdc00 0x7fd04c0711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 --2- 172.21.15.139:0/1544515119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c15aff0 0x7fd04c0cd6c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 -- 172.21.15.139:0/1544515119 >> 172.21.15.139:0/1544515119 conn(0x7fd04c0ce9d0 msgr2=0x7fd04c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:12.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 -- 172.21.15.139:0/1544515119 shutdown_connections 2024-09-13T17:25:12.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.639+0000 7fd050a00700 1 -- 172.21.15.139:0/1544515119 wait complete. 2024-09-13T17:25:12.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.643+0000 7fd050a00700 1 Processor -- start 2024-09-13T17:25:12.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.643+0000 7fd050a00700 1 -- start start 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.643+0000 7fd050a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd04c0cdc00 0x7fd04c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 0x7fd04c13fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd04c15aff0 0x7fd04c158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c13b970 con 0x7fd04c144300 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c140650 con 0x7fd04c0cdc00 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0cb5d0 con 0x7fd04c15aff0 2024-09-13T17:25:12.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 0x7fd04c13fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd04b400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd04c0cdc00 0x7fd04c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd04b400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd04c0cdc00 0x7fd04c13b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:55776/0 (socket says 172.21.15.139:55776) 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd04b400700 1 -- 172.21.15.139:0/1847435343 learned_addr learned my addr 172.21.15.139:0/1847435343 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 0x7fd04c13fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51956/0 (socket says 172.21.15.139:51956) 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd04be00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd04c15aff0 0x7fd04c158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 -- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd04c15aff0 msgr2=0x7fd04c158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd04c15aff0 0x7fd04c158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 -- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd04c0cdc00 msgr2=0x7fd04c13b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd04c0cdc00 0x7fd04c13b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 -- 172.21.15.139:0/1847435343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009570 con 0x7fd04c144300 2024-09-13T17:25:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd042a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 0x7fd04c13fc70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd034016000 tx=0x7fd034004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:12.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004310 con 0x7fd04c144300 2024-09-13T17:25:12.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03401f070 con 0x7fd04c144300 2024-09-13T17:25:12.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340036c0 con 0x7fd04c144300 2024-09-13T17:25:12.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c0cb8b0 con 0x7fd04c144300 2024-09-13T17:25:12.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.647+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c0cbe70 con 0x7fd04c144300 2024-09-13T17:25:12.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.651+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c1446e0 con 0x7fd04c144300 2024-09-13T17:25:12.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.651+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd034021030 con 0x7fd04c144300 2024-09-13T17:25:12.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.655+0000 7fd043e00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd028066730 0x7fd028068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:12.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.655+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd034085ff0 con 0x7fd04c144300 2024-09-13T17:25:12.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.655+0000 7fd04b400700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd028066730 0x7fd028068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:12.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.655+0000 7fd04b400700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd028066730 0x7fd028068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00f370 tx=0x7fd03c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:12.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.655+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd034053190 con 0x7fd04c144300 2024-09-13T17:25:12.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.835+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd04c06d6a0 con 0x7fd04c144300 2024-09-13T17:25:12.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.835+0000 7fd043e00700 1 -- 172.21.15.139:0/1847435343 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0340567b0 con 0x7fd04c144300 2024-09-13T17:25:12.839 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd028066730 msgr2=0x7fd028068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd028066730 0x7fd028068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00f370 tx=0x7fd03c009040 comp rx=0 tx=0).stop 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 msgr2=0x7fd04c13fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 0x7fd04c13fc70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd034016000 tx=0x7fd034004770 comp rx=0 tx=0).stop 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 shutdown_connections 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd028066730 0x7fd028068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd04c15aff0 0x7fd04c158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd04c144300 0x7fd04c13fc70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 --2- 172.21.15.139:0/1847435343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd04c0cdc00 0x7fd04c13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:12.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 >> 172.21.15.139:0/1847435343 conn(0x7fd04c0ce9d0 msgr2=0x7fd04c0b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:12.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 shutdown_connections 2024-09-13T17:25:12.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:12.839+0000 7fd050a00700 1 -- 172.21.15.139:0/1847435343 wait complete. 2024-09-13T17:25:12.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:13.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.031+0000 7f8973e00700 1 Processor -- start 2024-09-13T17:25:13.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.031+0000 7f8973e00700 1 -- start start 2024-09-13T17:25:13.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8973e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f897415aff0 0x7f89740cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8973e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8974070140 con 0x7f8974144300 2024-09-13T17:25:13.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8973e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8974070420 con 0x7f89740cdc00 2024-09-13T17:25:13.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8973e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89740ce0b0 con 0x7f897415aff0 2024-09-13T17:25:13.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8974144300 0x7f897406d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58674/0 (socket says 172.21.15.139:58674) 2024-09-13T17:25:13.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 -- 172.21.15.139:0/3112354392 learned_addr learned my addr 172.21.15.139:0/3112354392 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:13.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972000700 1 --2- 172.21.15.139:0/3112354392 >> v2:172.21.15.139:3300/0 conn(0x7f897415aff0 0x7f89740cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569572194 0 0) 0x7f8974070140 con 0x7f8974144300 2024-09-13T17:25:13.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89580035d0 con 0x7f8974144300 2024-09-13T17:25:13.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640664713 0 0) 0x7f89580035d0 con 0x7f8974144300 2024-09-13T17:25:13.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 >> v2:172.21.15.139:3300/0 conn(0x7f897415aff0 msgr2=0x7f89740cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:13.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 --2- 172.21.15.139:0/3112354392 >> v2:172.21.15.139:3300/0 conn(0x7f897415aff0 0x7f89740cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 >> v1:172.21.15.176:6789/0 conn(0x7f89740cdc00 legacy=0x7f89740711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974070700 con 0x7f8974144300 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f8964001670 con 0x7f8974144300 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 >> v1:172.21.15.139:6789/0 conn(0x7f8974144300 legacy=0x7f897406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8958003a50 0x7f8958003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958004870 0x7f8958004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8958005280 0x7f895800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740ce0b0 con 0x7f8958003a50 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895800c1b0 con 0x7f8958005280 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895800c370 con 0x7f8958004870 2024-09-13T17:25:13.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972000700 1 --2- 172.21.15.139:0/3112354392 >> v2:172.21.15.139:3300/0 conn(0x7f897415aff0 0x7f89740cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:13.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8958003a50 0x7f8958003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8973400700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8958005280 0x7f895800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972000700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958004870 0x7f8958004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 -- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958004870 msgr2=0x7f8958004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958004870 0x7f8958004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 -- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8958005280 msgr2=0x7f895800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8958005280 0x7f895800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8972a00700 1 -- 172.21.15.139:0/3112354392 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580035d0 con 0x7f8958003a50 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.035+0000 7f8973400700 1 -- 172.21.15.139:0/3112354392 reap_dead start 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8972a00700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8958003a50 0x7f8958003e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8964001eb0 tx=0x7f89580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0f8d9dc7f72715 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400ce00 con 0x7f8958003a50 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964005980 con 0x7f8958003a50 2024-09-13T17:25:13.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8971600700 1 -- 172.21.15.139:0/3112354392 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964005d30 con 0x7f8958003a50 2024-09-13T17:25:13.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 -- 172.21.15.139:0/3112354392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8958003a50 msgr2=0x7f8958003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8958003a50 0x7f8958003e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8964001eb0 tx=0x7f89580058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 -- 172.21.15.139:0/3112354392 shutdown_connections 2024-09-13T17:25:13.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 --2- 172.21.15.139:0/3112354392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8958003a50 0x7f8958003e30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 -- 172.21.15.139:0/3112354392 >> 172.21.15.139:0/3112354392 conn(0x7f89740ce9d0 msgr2=0x7f89740cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:13.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 -- 172.21.15.139:0/3112354392 shutdown_connections 2024-09-13T17:25:13.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.039+0000 7f8973e00700 1 -- 172.21.15.139:0/3112354392 wait complete. 2024-09-13T17:25:13.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 Processor -- start 2024-09-13T17:25:13.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 -- start start 2024-09-13T17:25:13.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958003a50 0x7f89741f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740a8480 0x7f89740a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 0x7f89741e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740a8e40 con 0x7f89741e0180 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89741e0eb0 con 0x7f89740a8480 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89741e1190 con 0x7f8958003a50 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 0x7f89741e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 0x7f89741e0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51972/0 (socket says 172.21.15.139:51972) 2024-09-13T17:25:13.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 -- 172.21.15.139:0/1853384677 learned_addr learned my addr 172.21.15.139:0/1853384677 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:13.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 -- 172.21.15.139:0/1853384677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958003a50 msgr2=0x7f89741f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958003a50 0x7f89741f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 -- 172.21.15.139:0/1853384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740a8480 msgr2=0x7f89740a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740a8480 0x7f89740a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 -- 172.21.15.139:0/1853384677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89741e1470 con 0x7f89741e0180 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f8973400700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 0x7f89741e0600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f897406b870 tx=0x7f896c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.043+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c003c30 con 0x7f89741e0180 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c003d90 con 0x7f89741e0180 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89741e1750 con 0x7f89741e0180 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c00dbb0 con 0x7f89741e0180 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89741e0b40 con 0x7f89741e0180 2024-09-13T17:25:13.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8974144a70 con 0x7f89741e0180 2024-09-13T17:25:13.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f896c00dd10 con 0x7f89741e0180 2024-09-13T17:25:13.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f896aa00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8954066730 0x7f8954068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.047+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f896c0848e0 con 0x7f89741e0180 2024-09-13T17:25:13.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.051+0000 7f8972a00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8954066730 0x7f8954068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.051+0000 7f8972a00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8954066730 0x7f8954068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8964001930 tx=0x7f896400a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:13.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.055+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8974144a70 con 0x7f89741e0180 2024-09-13T17:25:13.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.239+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8974144a70 con 0x7f89741e0180 2024-09-13T17:25:13.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.239+0000 7f896aa00700 1 -- 172.21.15.139:0/1853384677 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8974144a70 con 0x7f89741e0180 2024-09-13T17:25:13.243 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:13.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8954066730 msgr2=0x7f8954068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8954066730 0x7f8954068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8964001930 tx=0x7f896400a000 comp rx=0 tx=0).stop 2024-09-13T17:25:13.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 msgr2=0x7f89741e0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 0x7f89741e0600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f897406b870 tx=0x7f896c00d430 comp rx=0 tx=0).stop 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 shutdown_connections 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8954066730 0x7f8954068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89741e0180 0x7f89741e0600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740a8480 0x7f89740a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 --2- 172.21.15.139:0/1853384677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8958003a50 0x7f89741f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 >> 172.21.15.139:0/1853384677 conn(0x7f89740ce9d0 msgr2=0x7f897406d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 shutdown_connections 2024-09-13T17:25:13.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.243+0000 7f8973e00700 1 -- 172.21.15.139:0/1853384677 wait complete. 2024-09-13T17:25:13.270 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2024-09-13T17:25:13.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.447+0000 7f7002000700 1 Processor -- start 2024-09-13T17:25:13.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.447+0000 7f7002000700 1 -- start start 2024-09-13T17:25:13.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7002000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ffc15f5c0 0x7f6ffc143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7002000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ffc15ef90 0x7f6ffc0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7002000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc0b41a0 con 0x7f6ffc15ebb0 2024-09-13T17:25:13.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7002000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc0b6370 con 0x7f6ffc15ef90 2024-09-13T17:25:13.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7002000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc0b6650 con 0x7f6ffc15f5c0 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7000c00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6ffc15ebb0 0x7f6ffc1434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58682/0 (socket says 172.21.15.139:58682) 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7000c00700 1 -- 172.21.15.139:0/564661876 learned_addr learned my addr 172.21.15.139:0/564661876 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7001600700 1 --2- 172.21.15.139:0/564661876 >> v2:172.21.15.139:3300/0 conn(0x7f6ffc15ef90 0x7f6ffc0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffbe00700 1 --2- 172.21.15.139:0/564661876 >> v2:172.21.15.176:3300/0 conn(0x7f6ffc15f5c0 0x7f6ffc143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffb400700 1 -- 172.21.15.139:0/564661876 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192438629 0 0) 0x7f6ff0001110 con 0x7f6ffc15ebb0 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffb400700 1 -- 172.21.15.139:0/564661876 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe40035d0 con 0x7f6ffc15ebb0 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffbe00700 1 -- 172.21.15.139:0/564661876 >> v2:172.21.15.139:3300/0 conn(0x7f6ffc15ef90 msgr2=0x7f6ffc0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffbe00700 1 --2- 172.21.15.139:0/564661876 >> v2:172.21.15.139:3300/0 conn(0x7f6ffc15ef90 0x7f6ffc0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffbe00700 1 -- 172.21.15.139:0/564661876 >> v1:172.21.15.139:6789/0 conn(0x7f6ffc15ebb0 legacy=0x7f6ffc1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffbe00700 1 -- 172.21.15.139:0/564661876 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc0b6930 con 0x7f6ffc15f5c0 2024-09-13T17:25:13.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f7001600700 1 --2- 172.21.15.139:0/564661876 >> v2:172.21.15.139:3300/0 conn(0x7f6ffc15ef90 0x7f6ffc0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:13.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffbe00700 1 --2- 172.21.15.139:0/564661876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15f5c0 0x7f6ffc143be0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0ceb10 tx=0x7f6fe8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f009c15a624077 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:13.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffb400700 1 -- 172.21.15.139:0/564661876 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8011830 con 0x7f6ffc15f5c0 2024-09-13T17:25:13.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffb400700 1 -- 172.21.15.139:0/564661876 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8011990 con 0x7f6ffc15f5c0 2024-09-13T17:25:13.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.451+0000 7f6ffb400700 1 -- 172.21.15.139:0/564661876 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8011d00 con 0x7f6ffc15f5c0 2024-09-13T17:25:13.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 -- 172.21.15.139:0/564661876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15f5c0 msgr2=0x7f6ffc143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 --2- 172.21.15.139:0/564661876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15f5c0 0x7f6ffc143be0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0ceb10 tx=0x7f6fe8009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:13.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 -- 172.21.15.139:0/564661876 shutdown_connections 2024-09-13T17:25:13.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 --2- 172.21.15.139:0/564661876 >> v2:172.21.15.139:3300/0 conn(0x7f6ffc15ef90 0x7f6ffc0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 --2- 172.21.15.139:0/564661876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15f5c0 0x7f6ffc143be0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 -- 172.21.15.139:0/564661876 >> 172.21.15.139:0/564661876 conn(0x7f6ffc071fa0 msgr2=0x7f6ffc072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:13.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 -- 172.21.15.139:0/564661876 shutdown_connections 2024-09-13T17:25:13.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 -- 172.21.15.139:0/564661876 wait complete. 2024-09-13T17:25:13.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 Processor -- start 2024-09-13T17:25:13.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.455+0000 7f7002000700 1 -- start start 2024-09-13T17:25:13.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15ebb0 0x7f6ffc06d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 0x7f6ffc1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ffc15f5c0 0x7f6ffc13e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc15c9f0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc15d1d0 con 0x7f6ffc15ebb0 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc139930 con 0x7f6ffc15f5c0 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 0x7f6ffc1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 0x7f6ffc1f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51984/0 (socket says 172.21.15.139:51984) 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7000c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15ebb0 0x7f6ffc06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 -- 172.21.15.139:0/2652187952 learned_addr learned my addr 172.21.15.139:0/2652187952 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:13.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7001600700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ffc15f5c0 0x7f6ffc13e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 -- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ffc15f5c0 msgr2=0x7f6ffc13e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ffc15f5c0 0x7f6ffc13e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 -- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15ebb0 msgr2=0x7f6ffc06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15ebb0 0x7f6ffc06d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 -- 172.21.15.139:0/2652187952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4009a70 con 0x7f6ffc15ef90 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ffbe00700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 0x7f6ffc1f5f30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80090b0 tx=0x7f6fe8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8004450 con 0x7f6ffc15ef90 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe80094b0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe801e070 con 0x7f6ffc15ef90 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80038c0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.459+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc159a90 con 0x7f6ffc15ef90 2024-09-13T17:25:13.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.463+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc0677e0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.463+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fe8003a20 con 0x7f6ffc15ef90 2024-09-13T17:25:13.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.463+0000 7f6ff8c00700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fdc066730 0x7f6fdc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:13.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.463+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fe80852b0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.467+0000 7f7000c00700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fdc066730 0x7f6fdc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:13.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.467+0000 7f7000c00700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fdc066730 0x7f6fdc068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005930 tx=0x7f6ff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:13.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.471+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fe80521d0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.727+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f6ffc0b3c60 con 0x7f6ffc15ef90 2024-09-13T17:25:13.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.803+0000 7f6ff8c00700 1 -- 172.21.15.139:0/2652187952 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v76) v1 ==== 158+0+0 (secure 0 0 0) 0x7f6fe80557f0 con 0x7f6ffc15ef90 2024-09-13T17:25:13.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fdc066730 msgr2=0x7f6fdc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fdc066730 0x7f6fdc068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005930 tx=0x7f6ff0009040 comp rx=0 tx=0).stop 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 msgr2=0x7f6ffc1f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 0x7f6ffc1f5f30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80090b0 tx=0x7f6fe8004770 comp rx=0 tx=0).stop 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 shutdown_connections 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fdc066730 0x7f6fdc068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ffc15f5c0 0x7f6ffc13e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ffc15ef90 0x7f6ffc1f5f30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 --2- 172.21.15.139:0/2652187952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ffc15ebb0 0x7f6ffc06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 >> 172.21.15.139:0/2652187952 conn(0x7f6ffc071fa0 msgr2=0x7f6ffc06e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.807+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 shutdown_connections 2024-09-13T17:25:13.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:13.811+0000 7f7002000700 1 -- 172.21.15.139:0/2652187952 wait complete. 2024-09-13T17:25:13.836 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:25:14.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.003+0000 7ff67a200700 1 Processor -- start 2024-09-13T17:25:14.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.003+0000 7ff67a200700 1 -- start start 2024-09-13T17:25:14.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff67a200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff67415ce70 0x7ff6740cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff67a200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6740cff70 con 0x7ff6740d1390 2024-09-13T17:25:14.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff67a200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6740b42e0 con 0x7ff6740b3de0 2024-09-13T17:25:14.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff67a200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740b45c0 con 0x7ff67415ce70 2024-09-13T17:25:14.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff673400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff67415ce70 0x7ff6740cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff673e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff6740d1390 0x7ff6740cadf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58690/0 (socket says 172.21.15.139:58690) 2024-09-13T17:25:14.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff673e00700 1 -- 172.21.15.139:0/2891892358 learned_addr learned my addr 172.21.15.139:0/2891892358 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:14.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff673400700 1 -- 172.21.15.139:0/2891892358 >> v1:172.21.15.176:6789/0 conn(0x7ff6740b3de0 legacy=0x7ff6740d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff673400700 1 -- 172.21.15.139:0/2891892358 >> v1:172.21.15.139:6789/0 conn(0x7ff6740d1390 legacy=0x7ff6740cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff673400700 1 -- 172.21.15.139:0/2891892358 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740b48a0 con 0x7ff67415ce70 2024-09-13T17:25:14.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.007+0000 7ff672000700 1 -- 172.21.15.139:0/2891892358 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473180564 0 0) 0x7ff6740cff70 con 0x7ff6740d1390 2024-09-13T17:25:14.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff673400700 1 --2- 172.21.15.139:0/2891892358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff67415ce70 0x7ff6740cfa30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff664009850 tx=0x7ff664009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72bd45e4857bdf7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:14.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff672000700 1 -- 172.21.15.139:0/2891892358 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011830 con 0x7ff67415ce70 2024-09-13T17:25:14.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff672000700 1 -- 172.21.15.139:0/2891892358 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff664011990 con 0x7ff67415ce70 2024-09-13T17:25:14.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff672000700 1 -- 172.21.15.139:0/2891892358 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011d20 con 0x7ff67415ce70 2024-09-13T17:25:14.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 -- 172.21.15.139:0/2891892358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff67415ce70 msgr2=0x7ff6740cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 --2- 172.21.15.139:0/2891892358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff67415ce70 0x7ff6740cfa30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff664009850 tx=0x7ff664009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:14.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 -- 172.21.15.139:0/2891892358 shutdown_connections 2024-09-13T17:25:14.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 --2- 172.21.15.139:0/2891892358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff67415ce70 0x7ff6740cfa30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 -- 172.21.15.139:0/2891892358 >> 172.21.15.139:0/2891892358 conn(0x7ff67406a390 msgr2=0x7ff67406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:14.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 -- 172.21.15.139:0/2891892358 shutdown_connections 2024-09-13T17:25:14.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.011+0000 7ff67a200700 1 -- 172.21.15.139:0/2891892358 wait complete. 2024-09-13T17:25:14.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 Processor -- start 2024-09-13T17:25:14.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 -- start start 2024-09-13T17:25:14.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6740b3de0 0x7ff6741468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6740d1390 0x7ff67406e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 0x7ff67415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67406f080 con 0x7ff67415ce70 2024-09-13T17:25:14.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67406f360 con 0x7ff6740d1390 2024-09-13T17:25:14.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67406f640 con 0x7ff6740b3de0 2024-09-13T17:25:14.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 0x7ff67415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 0x7ff67415b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51992/0 (socket says 172.21.15.139:51992) 2024-09-13T17:25:14.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 -- 172.21.15.139:0/877749009 learned_addr learned my addr 172.21.15.139:0/877749009 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:14.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff672a00700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6740d1390 0x7ff67406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673400700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6740b3de0 0x7ff6741468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 -- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6740b3de0 msgr2=0x7ff6741468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6740b3de0 0x7ff6741468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 -- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6740d1390 msgr2=0x7ff67406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6740d1390 0x7ff67406e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 -- 172.21.15.139:0/877749009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6640094b0 con 0x7ff67415ce70 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff672a00700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6740d1390 0x7ff67406e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff673e00700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 0x7ff67415b250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00cc70 tx=0x7ff66c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00ad80 con 0x7ff67415ce70 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c00ce70 con 0x7ff67415ce70 2024-09-13T17:25:14.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0072f0 con 0x7ff67415ce70 2024-09-13T17:25:14.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67406f920 con 0x7ff67415ce70 2024-09-13T17:25:14.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.015+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff674146e20 con 0x7ff67415ce70 2024-09-13T17:25:14.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.019+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67414fc40 con 0x7ff67415ce70 2024-09-13T17:25:14.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.019+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff66c007450 con 0x7ff67415ce70 2024-09-13T17:25:14.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.019+0000 7ff66b400700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff654066730 0x7ff654068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.019+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff66c084000 con 0x7ff67415ce70 2024-09-13T17:25:14.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.023+0000 7ff673400700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff654066730 0x7ff654068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.023+0000 7ff673400700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff654066730 0x7ff654068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff664009fd0 tx=0x7ff66401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:14.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.027+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff67414fc40 con 0x7ff67415ce70 2024-09-13T17:25:14.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.211+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff67414fc40 con 0x7ff67415ce70 2024-09-13T17:25:14.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.219+0000 7ff66b400700 1 -- 172.21.15.139:0/877749009 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff67414fc40 con 0x7ff67415ce70 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff654066730 msgr2=0x7ff654068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff654066730 0x7ff654068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff664009fd0 tx=0x7ff66401c040 comp rx=0 tx=0).stop 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 msgr2=0x7ff67415b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 0x7ff67415b250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00cc70 tx=0x7ff66c00a340 comp rx=0 tx=0).stop 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 shutdown_connections 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff654066730 0x7ff654068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff67415ce70 0x7ff67415b250 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6740d1390 0x7ff67406e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 --2- 172.21.15.139:0/877749009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6740b3de0 0x7ff6741468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 >> 172.21.15.139:0/877749009 conn(0x7ff67406a390 msgr2=0x7ff6740d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:14.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 shutdown_connections 2024-09-13T17:25:14.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.223+0000 7ff67a200700 1 -- 172.21.15.139:0/877749009 wait complete. 2024-09-13T17:25:14.246 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:25:14.246 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:25:14.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:25:14.326 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:25:14.327 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:14.327 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:14.346 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:14.346 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:14.407 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:14.407 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:14.467 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:14.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.679+0000 7fa402600700 1 Processor -- start 2024-09-13T17:25:14.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.679+0000 7fa402600700 1 -- start start 2024-09-13T17:25:14.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa402600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 0x7fa3fc165680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa402600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc070140 con 0x7fa3fc144300 2024-09-13T17:25:14.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa402600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc070420 con 0x7fa3fc15aff0 2024-09-13T17:25:14.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa402600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc070700 con 0x7fa3fc0cddd0 2024-09-13T17:25:14.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa401200700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa3fc144300 0x7fa3fc06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53580/0 (socket says 172.21.15.139:53580) 2024-09-13T17:25:14.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa401200700 1 -- 172.21.15.139:0/973516847 learned_addr learned my addr 172.21.15.139:0/973516847 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:14.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa401c00700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 0x7fa3fc165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218564894 0 0) 0x7fa3fc070140 con 0x7fa3fc144300 2024-09-13T17:25:14.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e40035d0 con 0x7fa3fc144300 2024-09-13T17:25:14.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104655105 0 0) 0x7fa3fc070420 con 0x7fa3fc15aff0 2024-09-13T17:25:14.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3fc070140 con 0x7fa3fc15aff0 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679520415 0 0) 0x7fa3e40035d0 con 0x7fa3fc144300 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 msgr2=0x7fa3fc165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 0x7fa3fc165680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 >> v1:172.21.15.176:6789/0 conn(0x7fa3fc15aff0 legacy=0x7fa3fc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc0709e0 con 0x7fa3fc144300 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7fa3f0001670 con 0x7fa3fc144300 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 >> v1:172.21.15.139:6789/0 conn(0x7fa3fc144300 legacy=0x7fa3fc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4003be0 0x7fa3e4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 0x7fa3e4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4004db0 0x7fa3e4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc070700 con 0x7fa3e4003be0 2024-09-13T17:25:14.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e400bbc0 con 0x7fa3e4004db0 2024-09-13T17:25:14.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.683+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e400bd50 con 0x7fa3fc0cddd0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4003be0 0x7fa3e4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa3fbe00700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 0x7fa3e4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401c00700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4004db0 0x7fa3e4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 -- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 msgr2=0x7fa3e4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc0cddd0 0x7fa3e4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 -- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4004db0 msgr2=0x7fa3e4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4004db0 0x7fa3e4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 -- 172.21.15.139:0/973516847 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40035d0 con 0x7fa3e4003be0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401200700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4003be0 0x7fa3e4003fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007fd0 tx=0x7fa3e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40e3e06b5defd71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f000cd80 con 0x7fa3e4003be0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0001af0 con 0x7fa3e4003be0 2024-09-13T17:25:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa3fb400700 1 -- 172.21.15.139:0/973516847 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0005bc0 con 0x7fa3e4003be0 2024-09-13T17:25:14.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa402600700 1 -- 172.21.15.139:0/973516847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4003be0 msgr2=0x7fa3e4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa402600700 1 --2- 172.21.15.139:0/973516847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4003be0 0x7fa3e4003fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007fd0 tx=0x7fa3e40058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa401c00700 1 -- 172.21.15.139:0/973516847 reap_dead start 2024-09-13T17:25:14.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa402600700 1 -- 172.21.15.139:0/973516847 shutdown_connections 2024-09-13T17:25:14.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa402600700 1 -- 172.21.15.139:0/973516847 >> 172.21.15.139:0/973516847 conn(0x7fa3fc0ce9d0 msgr2=0x7fa3fc0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:14.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa402600700 1 -- 172.21.15.139:0/973516847 shutdown_connections 2024-09-13T17:25:14.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.687+0000 7fa402600700 1 -- 172.21.15.139:0/973516847 wait complete. 2024-09-13T17:25:14.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 Processor -- start 2024-09-13T17:25:14.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 -- start start 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4003be0 0x7fa3fc155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc1387d0 0x7fa3fc156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 0x7fa3fc0aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc0aac50 con 0x7fa3fc0aa260 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc139020 con 0x7fa3e4003be0 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa402600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc138d40 con 0x7fa3fc1387d0 2024-09-13T17:25:14.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa401c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 0x7fa3fc0aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa401c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 0x7fa3fc0aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37020/0 (socket says 172.21.15.139:37020) 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa401c00700 1 -- 172.21.15.139:0/2852969012 learned_addr learned my addr 172.21.15.139:0/2852969012 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa401200700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4003be0 0x7fa3fc155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.691+0000 7fa3fbe00700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc1387d0 0x7fa3fc156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa401c00700 1 -- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc1387d0 msgr2=0x7fa3fc156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa401c00700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc1387d0 0x7fa3fc156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa401c00700 1 -- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4003be0 msgr2=0x7fa3fc155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa401c00700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4003be0 0x7fa3fc155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa401c00700 1 -- 172.21.15.139:0/2852969012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc06deb0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa3fbe00700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc1387d0 0x7fa3fc156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa401c00700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 0x7fa3fc0aa710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc06b870 tx=0x7fa3f40114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400e070 con 0x7fa3fc0aa260 2024-09-13T17:25:14.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f4003c50 con 0x7fa3fc0aa260 2024-09-13T17:25:14.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc135dd0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4003e40 con 0x7fa3fc0aa260 2024-09-13T17:25:14.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc136390 con 0x7fa3fc0aa260 2024-09-13T17:25:14.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3fc1365b0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.695+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3f4011a10 con 0x7fa3fc0aa260 2024-09-13T17:25:14.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.699+0000 7fa3f8c00700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa3dc066760 0x7fa3dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:14.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.699+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3f4084ba0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.699+0000 7fa401200700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa3dc066760 0x7fa3dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:14.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.699+0000 7fa401200700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa3dc066760 0x7fa3dc068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0000c00 tx=0x7fa3f000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:14.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.703+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3f4051ac0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.891+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3fc1446e0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.895+0000 7fa3f8c00700 1 -- 172.21.15.139:0/2852969012 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7fa3f40550e0 con 0x7fa3fc0aa260 2024-09-13T17:25:14.899 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:14.899 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa3dc066760 msgr2=0x7fa3dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa3dc066760 0x7fa3dc068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0000c00 tx=0x7fa3f000a000 comp rx=0 tx=0).stop 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 msgr2=0x7fa3fc0aa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 0x7fa3fc0aa710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc06b870 tx=0x7fa3f40114b0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 shutdown_connections 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa3dc066760 0x7fa3dc068c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3fc0aa260 0x7fa3fc0aa710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3fc1387d0 0x7fa3fc156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 --2- 172.21.15.139:0/2852969012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e4003be0 0x7fa3fc155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:14.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 >> 172.21.15.139:0/2852969012 conn(0x7fa3fc0ce9d0 msgr2=0x7fa3fc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:14.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 shutdown_connections 2024-09-13T17:25:14.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:14.899+0000 7fa402600700 1 -- 172.21.15.139:0/2852969012 wait complete. 2024-09-13T17:25:14.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:14.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:15.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.099+0000 7f1b76600700 1 Processor -- start 2024-09-13T17:25:15.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.099+0000 7f1b76600700 1 -- start start 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b76600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1b7015f5c0 0x7f1b70143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b76600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1b7015ef90 0x7f1b700b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b76600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b700b41a0 con 0x7f1b7015ebb0 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b76600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b700b6370 con 0x7f1b7015f5c0 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b76600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b700b6650 con 0x7f1b7015ef90 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1b7015f5c0 0x7f1b70143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1b7015f5c0 0x7f1b70143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37032/0 (socket says 172.21.15.139:37032) 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 -- 172.21.15.139:0/1758048774 learned_addr learned my addr 172.21.15.139:0/1758048774 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b75200700 1 --1- 172.21.15.139:0/1758048774 >> v1:172.21.15.139:6789/0 conn(0x7f1b7015ebb0 0x7f1b701434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53590/0 (socket says 172.21.15.139:53590) 2024-09-13T17:25:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b75c00700 1 --2- 172.21.15.139:0/1758048774 >> v2:172.21.15.176:3300/0 conn(0x7f1b7015ef90 0x7f1b700b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 -- 172.21.15.139:0/1758048774 >> v2:172.21.15.176:3300/0 conn(0x7f1b7015ef90 msgr2=0x7f1b700b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 --2- 172.21.15.139:0/1758048774 >> v2:172.21.15.176:3300/0 conn(0x7f1b7015ef90 0x7f1b700b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 -- 172.21.15.139:0/1758048774 >> v1:172.21.15.139:6789/0 conn(0x7f1b7015ebb0 legacy=0x7f1b701434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 -- 172.21.15.139:0/1758048774 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700b6930 con 0x7f1b7015f5c0 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6f400700 1 -- 172.21.15.139:0/1758048774 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672288008 0 0) 0x7f1b64001110 con 0x7f1b7015ebb0 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6fe00700 1 --2- 172.21.15.139:0/1758048774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015f5c0 0x7f1b70143be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b700b43d0 tx=0x7f1b5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b88048f6fa8140e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6f400700 1 -- 172.21.15.139:0/1758048774 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011830 con 0x7f1b7015f5c0 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6f400700 1 -- 172.21.15.139:0/1758048774 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c011990 con 0x7f1b7015f5c0 2024-09-13T17:25:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.103+0000 7f1b6f400700 1 -- 172.21.15.139:0/1758048774 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011d20 con 0x7f1b7015f5c0 2024-09-13T17:25:15.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 -- 172.21.15.139:0/1758048774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015f5c0 msgr2=0x7f1b70143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 --2- 172.21.15.139:0/1758048774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015f5c0 0x7f1b70143be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b700b43d0 tx=0x7f1b5c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 -- 172.21.15.139:0/1758048774 shutdown_connections 2024-09-13T17:25:15.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 --2- 172.21.15.139:0/1758048774 >> v2:172.21.15.176:3300/0 conn(0x7f1b7015ef90 0x7f1b700b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 --2- 172.21.15.139:0/1758048774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015f5c0 0x7f1b70143be0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 -- 172.21.15.139:0/1758048774 >> 172.21.15.139:0/1758048774 conn(0x7f1b70071fa0 msgr2=0x7f1b70072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:15.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 -- 172.21.15.139:0/1758048774 shutdown_connections 2024-09-13T17:25:15.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 -- 172.21.15.139:0/1758048774 wait complete. 2024-09-13T17:25:15.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 Processor -- start 2024-09-13T17:25:15.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.107+0000 7f1b76600700 1 -- start start 2024-09-13T17:25:15.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 0x7f1b700ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b7015ef90 0x7f1b701f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b7015f5c0 0x7f1b7006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700cb520 con 0x7f1b7015ebb0 2024-09-13T17:25:15.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b701f2d40 con 0x7f1b7015f5c0 2024-09-13T17:25:15.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700caf60 con 0x7f1b7015ef90 2024-09-13T17:25:15.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 0x7f1b700ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 0x7f1b700ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37046/0 (socket says 172.21.15.139:37046) 2024-09-13T17:25:15.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 -- 172.21.15.139:0/1052232555 learned_addr learned my addr 172.21.15.139:0/1052232555 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:15.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75c00700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b7015f5c0 0x7f1b7006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b6fe00700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b7015ef90 0x7f1b701f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 -- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b7015ef90 msgr2=0x7f1b701f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b7015ef90 0x7f1b701f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 -- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b7015f5c0 msgr2=0x7f1b7006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b7015f5c0 0x7f1b7006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 -- 172.21.15.139:0/1052232555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009570 con 0x7f1b7015ebb0 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b75200700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 0x7f1b700ca8d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c750 tx=0x7f1b6400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64004ca0 con 0x7f1b7015ebb0 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64004e20 con 0x7f1b7015ebb0 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64007310 con 0x7f1b7015ebb0 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b700cb240 con 0x7f1b7015ebb0 2024-09-13T17:25:15.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.111+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b701f32e0 con 0x7f1b7015ebb0 2024-09-13T17:25:15.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.115+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b700677e0 con 0x7f1b7015ebb0 2024-09-13T17:25:15.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.115+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b64007470 con 0x7f1b7015ebb0 2024-09-13T17:25:15.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.119+0000 7f1b6cc00700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1b50066730 0x7f1b50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.119+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b64083460 con 0x7f1b7015ebb0 2024-09-13T17:25:15.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.119+0000 7f1b6fe00700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1b50066730 0x7f1b50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.119+0000 7f1b6fe00700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1b50066730 0x7f1b50068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000c00 tx=0x7f1b5c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.123+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b64050400 con 0x7f1b7015ebb0 2024-09-13T17:25:15.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.311+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b700b41a0 con 0x7f1b7015ebb0 2024-09-13T17:25:15.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.311+0000 7f1b6cc00700 1 -- 172.21.15.139:0/1052232555 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b700b41a0 con 0x7f1b7015ebb0 2024-09-13T17:25:15.314 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:15.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.311+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1b50066730 msgr2=0x7f1b50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.311+0000 7f1b76600700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1b50066730 0x7f1b50068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000c00 tx=0x7f1b5c008030 comp rx=0 tx=0).stop 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.311+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 msgr2=0x7f1b700ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.311+0000 7f1b76600700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 0x7f1b700ca8d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c750 tx=0x7f1b6400cb10 comp rx=0 tx=0).stop 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 shutdown_connections 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1b50066730 0x7f1b50068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b7015f5c0 0x7f1b7006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b7015ef90 0x7f1b701f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 --2- 172.21.15.139:0/1052232555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b7015ebb0 0x7f1b700ca8d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 >> 172.21.15.139:0/1052232555 conn(0x7f1b70071fa0 msgr2=0x7f1b70159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 shutdown_connections 2024-09-13T17:25:15.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.315+0000 7f1b76600700 1 -- 172.21.15.139:0/1052232555 wait complete. 2024-09-13T17:25:15.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.511+0000 7fb057200700 1 Processor -- start 2024-09-13T17:25:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.511+0000 7fb057200700 1 -- start start 2024-09-13T17:25:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb050158480 0x7fb050070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0500aea90 con 0x7fb0500ce8a0 2024-09-13T17:25:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05015bf50 con 0x7fb0500b4310 2024-09-13T17:25:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05015b2d0 con 0x7fb050158480 2024-09-13T17:25:15.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb050158480 0x7fb050070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb050158480 0x7fb050070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37050/0 (socket says 172.21.15.139:37050) 2024-09-13T17:25:15.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 -- 172.21.15.139:0/1836392414 learned_addr learned my addr 172.21.15.139:0/1836392414 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:15.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055400700 1 --1- 172.21.15.139:0/1836392414 >> v1:172.21.15.139:6789/0 conn(0x7fb0500ce8a0 0x7fb0500b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53596/0 (socket says 172.21.15.139:53596) 2024-09-13T17:25:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 -- 172.21.15.139:0/1836392414 >> v1:172.21.15.176:6789/0 conn(0x7fb0500b4310 legacy=0x7fb05006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 -- 172.21.15.139:0/1836392414 >> v1:172.21.15.139:6789/0 conn(0x7fb0500ce8a0 legacy=0x7fb0500b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 -- 172.21.15.139:0/1836392414 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05015b5b0 con 0x7fb050158480 2024-09-13T17:25:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb055e00700 1 --2- 172.21.15.139:0/1836392414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb050070b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb044009910 tx=0x7fb044009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364d0cb49fc6c4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb054a00700 1 -- 172.21.15.139:0/1836392414 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400ba60 con 0x7fb050158480 2024-09-13T17:25:15.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb054a00700 1 -- 172.21.15.139:0/1836392414 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04400bbc0 con 0x7fb050158480 2024-09-13T17:25:15.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb054a00700 1 -- 172.21.15.139:0/1836392414 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044009e60 con 0x7fb050158480 2024-09-13T17:25:15.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- 172.21.15.139:0/1836392414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 msgr2=0x7fb050070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 --2- 172.21.15.139:0/1836392414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb050070b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb044009910 tx=0x7fb044009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:15.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- 172.21.15.139:0/1836392414 shutdown_connections 2024-09-13T17:25:15.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 --2- 172.21.15.139:0/1836392414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb050070b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- 172.21.15.139:0/1836392414 >> 172.21.15.139:0/1836392414 conn(0x7fb05006ed30 msgr2=0x7fb0500b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:15.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.515+0000 7fb057200700 1 -- 172.21.15.139:0/1836392414 shutdown_connections 2024-09-13T17:25:15.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.519+0000 7fb057200700 1 -- 172.21.15.139:0/1836392414 wait complete. 2024-09-13T17:25:15.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.519+0000 7fb057200700 1 Processor -- start 2024-09-13T17:25:15.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.519+0000 7fb057200700 1 -- start start 2024-09-13T17:25:15.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0500b4310 0x7fb0500cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0500ce8a0 0x7fb0500ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb0500ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05006bfc0 con 0x7fb050158480 2024-09-13T17:25:15.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050149470 con 0x7fb0500b4310 2024-09-13T17:25:15.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500cd3b0 con 0x7fb0500ce8a0 2024-09-13T17:25:15.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb0500ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb0500ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37058/0 (socket says 172.21.15.139:37058) 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 -- 172.21.15.139:0/168599668 learned_addr learned my addr 172.21.15.139:0/168599668 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb055e00700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0500b4310 0x7fb0500cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb055400700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0500ce8a0 0x7fb0500ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 -- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0500ce8a0 msgr2=0x7fb0500ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0500ce8a0 0x7fb0500ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 -- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0500b4310 msgr2=0x7fb0500cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0500b4310 0x7fb0500cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 -- 172.21.15.139:0/168599668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044009570 con 0x7fb050158480 2024-09-13T17:25:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb056800700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb0500ac940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00cc80 tx=0x7fb04c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003c20 con 0x7fb050158480 2024-09-13T17:25:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c003d80 con 0x7fb050158480 2024-09-13T17:25:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb050148b40 con 0x7fb050158480 2024-09-13T17:25:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00aaa0 con 0x7fb050158480 2024-09-13T17:25:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.523+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb050149100 con 0x7fb050158480 2024-09-13T17:25:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.527+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050149600 con 0x7fb050158480 2024-09-13T17:25:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.527+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb04c00ac00 con 0x7fb050158480 2024-09-13T17:25:15.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.527+0000 7fb04a000700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb034066760 0x7fb034068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.527+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb04c084290 con 0x7fb050158480 2024-09-13T17:25:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.527+0000 7fb055e00700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb034066760 0x7fb034068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.531+0000 7fb055e00700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb034066760 0x7fb034068c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb044006f80 tx=0x7fb044008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.535+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb04c0512d0 con 0x7fb050158480 2024-09-13T17:25:15.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.711+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb05015bf50 con 0x7fb050158480 2024-09-13T17:25:15.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.711+0000 7fb04a000700 1 -- 172.21.15.139:0/168599668 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb05015bf50 con 0x7fb050158480 2024-09-13T17:25:15.715 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:15.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb034066760 msgr2=0x7fb034068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb034066760 0x7fb034068c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb044006f80 tx=0x7fb044008030 comp rx=0 tx=0).stop 2024-09-13T17:25:15.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 msgr2=0x7fb0500ac940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb0500ac940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00cc80 tx=0x7fb04c00cf90 comp rx=0 tx=0).stop 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 shutdown_connections 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb034066760 0x7fb034068c20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb050158480 0x7fb0500ac940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0500ce8a0 0x7fb0500ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 --2- 172.21.15.139:0/168599668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0500b4310 0x7fb0500cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 >> 172.21.15.139:0/168599668 conn(0x7fb05006ed30 msgr2=0x7fb0500b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 shutdown_connections 2024-09-13T17:25:15.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.715+0000 7fb057200700 1 -- 172.21.15.139:0/168599668 wait complete. 2024-09-13T17:25:15.739 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:15.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.911+0000 7f021be00700 1 Processor -- start 2024-09-13T17:25:15.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.911+0000 7f021be00700 1 -- start start 2024-09-13T17:25:15.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c162030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021be00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f021c164ba0 0x7f021c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021be00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c162af0 con 0x7f021c0b4140 2024-09-13T17:25:15.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021be00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0b45d0 con 0x7f021c164ba0 2024-09-13T17:25:15.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c162570 con 0x7f021c161c50 2024-09-13T17:25:15.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f021c164ba0 0x7f021c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f021c164ba0 0x7f021c0b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37068/0 (socket says 172.21.15.139:37068) 2024-09-13T17:25:15.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 -- 172.21.15.139:0/2849489620 learned_addr learned my addr 172.21.15.139:0/2849489620 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:15.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021aa00700 1 --2- 172.21.15.139:0/2849489620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 -- 172.21.15.139:0/2849489620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 msgr2=0x7f021c162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:15.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 --2- 172.21.15.139:0/2849489620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c162030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 -- 172.21.15.139:0/2849489620 >> v1:172.21.15.176:6789/0 conn(0x7f021c0b4140 legacy=0x7f021c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.915+0000 7f021a000700 1 -- 172.21.15.139:0/2849489620 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c1653d0 con 0x7f021c164ba0 2024-09-13T17:25:15.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021a000700 1 --2- 172.21.15.139:0/2849489620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c0b3c00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0208009910 tx=0x7f0208009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd471fdcbbfb5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f0219600700 1 -- 172.21.15.139:0/2849489620 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800ba60 con 0x7f021c164ba0 2024-09-13T17:25:15.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f0219600700 1 -- 172.21.15.139:0/2849489620 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020800bbc0 con 0x7f021c164ba0 2024-09-13T17:25:15.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f0219600700 1 -- 172.21.15.139:0/2849489620 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208009e60 con 0x7f021c164ba0 2024-09-13T17:25:15.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 -- 172.21.15.139:0/2849489620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 msgr2=0x7f021c0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 --2- 172.21.15.139:0/2849489620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c0b3c00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0208009910 tx=0x7f0208009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:15.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 -- 172.21.15.139:0/2849489620 shutdown_connections 2024-09-13T17:25:15.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 --2- 172.21.15.139:0/2849489620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c0b3c00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 --2- 172.21.15.139:0/2849489620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c162030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 -- 172.21.15.139:0/2849489620 >> 172.21.15.139:0/2849489620 conn(0x7f021c06ed30 msgr2=0x7f021c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:15.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 -- 172.21.15.139:0/2849489620 shutdown_connections 2024-09-13T17:25:15.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 -- 172.21.15.139:0/2849489620 wait complete. 2024-09-13T17:25:15.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 Processor -- start 2024-09-13T17:25:15.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.919+0000 7f021be00700 1 -- start start 2024-09-13T17:25:15.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021c0b4140 0x7f021c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c15ce30 con 0x7f021c164ba0 2024-09-13T17:25:15.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0a8b40 con 0x7f021c0b4140 2024-09-13T17:25:15.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0a8e20 con 0x7f021c161c50 2024-09-13T17:25:15.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37070/0 (socket says 172.21.15.139:37070) 2024-09-13T17:25:15.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 -- 172.21.15.139:0/1837063983 learned_addr learned my addr 172.21.15.139:0/1837063983 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:15.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021aa00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021c0b4140 0x7f021c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021a000700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 -- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 msgr2=0x7f021c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 -- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021c0b4140 msgr2=0x7f021c0aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021c0b4140 0x7f021c0aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 -- 172.21.15.139:0/1837063983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009570 con 0x7f021c164ba0 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021b400700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c152230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f021400cc50 tx=0x7f021400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214003c20 con 0x7f021c164ba0 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214003d80 con 0x7f021c164ba0 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0a9100 con 0x7f021c164ba0 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400aab0 con 0x7f021c164ba0 2024-09-13T17:25:15.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.923+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0a96c0 con 0x7f021c164ba0 2024-09-13T17:25:15.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.927+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0a98b0 con 0x7f021c164ba0 2024-09-13T17:25:15.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.927+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f021400ac10 con 0x7f021c164ba0 2024-09-13T17:25:15.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.927+0000 7f0212a00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f01fc066730 0x7f01fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:15.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.927+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02140845a0 con 0x7f021c164ba0 2024-09-13T17:25:15.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.931+0000 7f021aa00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f01fc066730 0x7f01fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:15.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.931+0000 7f021aa00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f01fc066730 0x7f01fc068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f020c009a00 tx=0x7f020c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:15.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:15.935+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02140514b0 con 0x7f021c164ba0 2024-09-13T17:25:16.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.115+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f021c162030 con 0x7f021c164ba0 2024-09-13T17:25:16.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.115+0000 7f0212a00700 1 -- 172.21.15.139:0/1837063983 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0214054ad0 con 0x7f021c164ba0 2024-09-13T17:25:16.120 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:16.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f01fc066730 msgr2=0x7f01fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f01fc066730 0x7f01fc068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f020c009a00 tx=0x7f020c008040 comp rx=0 tx=0).stop 2024-09-13T17:25:16.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 msgr2=0x7f021c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c152230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f021400cc50 tx=0x7f021400cf60 comp rx=0 tx=0).stop 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 shutdown_connections 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f01fc066730 0x7f01fc068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c164ba0 0x7f021c152230 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f021c161c50 0x7f021c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 --2- 172.21.15.139:0/1837063983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021c0b4140 0x7f021c0aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 >> 172.21.15.139:0/1837063983 conn(0x7f021c06ed30 msgr2=0x7f021c0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 shutdown_connections 2024-09-13T17:25:16.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.119+0000 7f021be00700 1 -- 172.21.15.139:0/1837063983 wait complete. 2024-09-13T17:25:16.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:16.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.319+0000 7f6ff9800700 1 Processor -- start 2024-09-13T17:25:16.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.319+0000 7f6ff9800700 1 -- start start 2024-09-13T17:25:16.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff9800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff414a6d0 0x7f6ff40cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff9800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40cd890 con 0x7f6ff40cd450 2024-09-13T17:25:16.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff9800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff414aab0 con 0x7f6ff40b3280 2024-09-13T17:25:16.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff9800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40cc3b0 con 0x7f6ff414a6d0 2024-09-13T17:25:16.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6feb400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6ff40cd450 0x7f6ff40b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53600/0 (socket says 172.21.15.139:53600) 2024-09-13T17:25:16.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6feb400700 1 -- 172.21.15.139:0/1900124836 learned_addr learned my addr 172.21.15.139:0/1900124836 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:16.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3e00700 1 --2- 172.21.15.139:0/1900124836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff414a6d0 0x7f6ff40cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779080130 0 0) 0x7f6ff40cd890 con 0x7f6ff40cd450 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80035d0 con 0x7f6ff40cd450 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297070069 0 0) 0x7f6ff414aab0 con 0x7f6ff40b3280 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff40cd890 con 0x7f6ff40b3280 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3e00700 1 -- 172.21.15.139:0/1900124836 >> v1:172.21.15.176:6789/0 conn(0x7f6ff40b3280 legacy=0x7f6ff4161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3e00700 1 -- 172.21.15.139:0/1900124836 >> v1:172.21.15.139:6789/0 conn(0x7f6ff40cd450 legacy=0x7f6ff40b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.323+0000 7f6ff3e00700 1 -- 172.21.15.139:0/1900124836 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40cc690 con 0x7f6ff414a6d0 2024-09-13T17:25:16.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff3e00700 1 --2- 172.21.15.139:0/1900124836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff414a6d0 0x7f6ff40cbd40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009880 tx=0x7f6fe4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91649fdd04e6ad90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:16.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011830 con 0x7f6ff414a6d0 2024-09-13T17:25:16.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4011990 con 0x7f6ff414a6d0 2024-09-13T17:25:16.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff3400700 1 -- 172.21.15.139:0/1900124836 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011d20 con 0x7f6ff414a6d0 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 -- 172.21.15.139:0/1900124836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff414a6d0 msgr2=0x7f6ff40cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 --2- 172.21.15.139:0/1900124836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff414a6d0 0x7f6ff40cbd40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009880 tx=0x7f6fe4009b90 comp rx=0 tx=0).stop 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 -- 172.21.15.139:0/1900124836 shutdown_connections 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 --2- 172.21.15.139:0/1900124836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff414a6d0 0x7f6ff40cbd40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 -- 172.21.15.139:0/1900124836 >> 172.21.15.139:0/1900124836 conn(0x7f6ff40ce9d0 msgr2=0x7f6ff40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 -- 172.21.15.139:0/1900124836 shutdown_connections 2024-09-13T17:25:16.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.327+0000 7f6ff9800700 1 -- 172.21.15.139:0/1900124836 wait complete. 2024-09-13T17:25:16.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 Processor -- start 2024-09-13T17:25:16.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 -- start start 2024-09-13T17:25:16.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40b3280 0x7f6ff40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 0x7f6ff415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff414a6d0 0x7f6ff4143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4142690 con 0x7f6ff40cd450 2024-09-13T17:25:16.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4142970 con 0x7f6ff414a6d0 2024-09-13T17:25:16.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6ff9800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4142c50 con 0x7f6ff40b3280 2024-09-13T17:25:16.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6feb400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 0x7f6ff415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6feb400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 0x7f6ff415ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37084/0 (socket says 172.21.15.139:37084) 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.331+0000 7f6feb400700 1 -- 172.21.15.139:0/3398360314 learned_addr learned my addr 172.21.15.139:0/3398360314 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff3e00700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40b3280 0x7f6ff40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff8e00700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff414a6d0 0x7f6ff4143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6feb400700 1 -- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40b3280 msgr2=0x7f6ff40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6feb400700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40b3280 0x7f6ff40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6feb400700 1 -- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff414a6d0 msgr2=0x7f6ff4143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6feb400700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff414a6d0 0x7f6ff4143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6feb400700 1 -- 172.21.15.139:0/3398360314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40094b0 con 0x7f6ff40cd450 2024-09-13T17:25:16.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6feb400700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 0x7f6ff415ef00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c530 tx=0x7f6fdc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:16.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc005d90 con 0x7f6ff40cd450 2024-09-13T17:25:16.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0070d0 con 0x7f6ff40cd450 2024-09-13T17:25:16.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007460 con 0x7f6ff40cd450 2024-09-13T17:25:16.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff4142f30 con 0x7f6ff40cd450 2024-09-13T17:25:16.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff40ca770 con 0x7f6ff40cd450 2024-09-13T17:25:16.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.335+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff406a6e0 con 0x7f6ff40cd450 2024-09-13T17:25:16.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.339+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fdc0075c0 con 0x7f6ff40cd450 2024-09-13T17:25:16.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.339+0000 7f6ff0c00700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fd0066730 0x7f6fd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.339+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fdc083960 con 0x7f6ff40cd450 2024-09-13T17:25:16.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.339+0000 7f6ff3e00700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fd0066730 0x7f6fd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.343+0000 7f6ff3e00700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fd0066730 0x7f6fd0068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40090b0 tx=0x7f6fe4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:16.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.347+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ff406a6e0 con 0x7f6ff40cd450 2024-09-13T17:25:16.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.523+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ff406a6e0 con 0x7f6ff40cd450 2024-09-13T17:25:16.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff0c00700 1 -- 172.21.15.139:0/3398360314 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6ff406a6e0 con 0x7f6ff40cd450 2024-09-13T17:25:16.530 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:16.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fd0066730 msgr2=0x7f6fd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fd0066730 0x7f6fd0068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40090b0 tx=0x7f6fe4010000 comp rx=0 tx=0).stop 2024-09-13T17:25:16.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 msgr2=0x7f6ff415ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 0x7f6ff415ef00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c530 tx=0x7f6fdc00c840 comp rx=0 tx=0).stop 2024-09-13T17:25:16.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 shutdown_connections 2024-09-13T17:25:16.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6fd0066730 0x7f6fd0068bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff414a6d0 0x7f6ff4143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ff40cd450 0x7f6ff415ef00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 --2- 172.21.15.139:0/3398360314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40b3280 0x7f6ff40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.527+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 >> 172.21.15.139:0/3398360314 conn(0x7f6ff40ce9d0 msgr2=0x7f6ff40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:16.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.531+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 shutdown_connections 2024-09-13T17:25:16.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.531+0000 7f6ff9800700 1 -- 172.21.15.139:0/3398360314 wait complete. 2024-09-13T17:25:16.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:25:16.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.723+0000 7f1e6b200700 1 Processor -- start 2024-09-13T17:25:16.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.723+0000 7f1e6b200700 1 -- start start 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.723+0000 7f1e6b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c0ada90 0x7f1e6c0ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.723+0000 7f1e6b200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1e6c15bb60 0x7f1e6c0cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0cd330 con 0x7f1e6c0b3c00 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0ade70 con 0x7f1e6c15bb60 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0ccd80 con 0x7f1e6c0ada90 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1e6c15bb60 0x7f1e6c0cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1e6c15bb60 0x7f1e6c0cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37094/0 (socket says 172.21.15.139:37094) 2024-09-13T17:25:16.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 -- 172.21.15.139:0/946631772 learned_addr learned my addr 172.21.15.139:0/946631772 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69e00700 1 --2- 172.21.15.139:0/946631772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c0ada90 0x7f1e6c0ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 -- 172.21.15.139:0/946631772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c0ada90 msgr2=0x7f1e6c0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 --2- 172.21.15.139:0/946631772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c0ada90 0x7f1e6c0ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 -- 172.21.15.139:0/946631772 >> v1:172.21.15.139:6789/0 conn(0x7f1e6c0b3c00 legacy=0x7f1e6c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 -- 172.21.15.139:0/946631772 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0cd050 con 0x7f1e6c15bb60 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e69400700 1 --2- 172.21.15.139:0/946631772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c15bb60 0x7f1e6c0cc840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009910 tx=0x7f1e58009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4926cf2201720f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e68a00700 1 -- 172.21.15.139:0/946631772 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5800ba60 con 0x7f1e6c15bb60 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e68a00700 1 -- 172.21.15.139:0/946631772 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5800bbc0 con 0x7f1e6c15bb60 2024-09-13T17:25:16.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e68a00700 1 -- 172.21.15.139:0/946631772 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58009e60 con 0x7f1e6c15bb60 2024-09-13T17:25:16.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- 172.21.15.139:0/946631772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c15bb60 msgr2=0x7f1e6c0cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 --2- 172.21.15.139:0/946631772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c15bb60 0x7f1e6c0cc840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009910 tx=0x7f1e58009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:16.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- 172.21.15.139:0/946631772 shutdown_connections 2024-09-13T17:25:16.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 --2- 172.21.15.139:0/946631772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c15bb60 0x7f1e6c0cc840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 --2- 172.21.15.139:0/946631772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c0ada90 0x7f1e6c0ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- 172.21.15.139:0/946631772 >> 172.21.15.139:0/946631772 conn(0x7f1e6c06ece0 msgr2=0x7f1e6c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:16.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- 172.21.15.139:0/946631772 shutdown_connections 2024-09-13T17:25:16.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.727+0000 7f1e6b200700 1 -- 172.21.15.139:0/946631772 wait complete. 2024-09-13T17:25:16.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.731+0000 7f1e6b200700 1 Processor -- start 2024-09-13T17:25:16.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.731+0000 7f1e6b200700 1 -- start start 2024-09-13T17:25:16.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 0x7f1e6c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c0b3c00 0x7f1e6c1e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c15bb60 0x7f1e6c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1e5900 con 0x7f1e6c0ada90 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1e5be0 con 0x7f1e6c0b3c00 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1e5ec0 con 0x7f1e6c15bb60 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 0x7f1e6c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 0x7f1e6c157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37096/0 (socket says 172.21.15.139:37096) 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 -- 172.21.15.139:0/2752359647 learned_addr learned my addr 172.21.15.139:0/2752359647 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69400700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c0b3c00 0x7f1e6c1e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6a800700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c15bb60 0x7f1e6c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 -- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c15bb60 msgr2=0x7f1e6c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c15bb60 0x7f1e6c0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 -- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c0b3c00 msgr2=0x7f1e6c1e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c0b3c00 0x7f1e6c1e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 -- 172.21.15.139:0/2752359647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58009570 con 0x7f1e6c0ada90 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e69e00700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 0x7f1e6c157e00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00e760 tx=0x7f1e5c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c013610 con 0x7f1e6c0ada90 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c013770 con 0x7f1e6c0ada90 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c013ae0 con 0x7f1e6c0ada90 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c1e61a0 con 0x7f1e6c0ada90 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.735+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c158340 con 0x7f1e6c0ada90 2024-09-13T17:25:16.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.739+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c0ced80 con 0x7f1e6c0ada90 2024-09-13T17:25:16.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.739+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e5c013c40 con 0x7f1e6c0ada90 2024-09-13T17:25:16.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.739+0000 7f1e62000700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e4c066730 0x7f1e4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:16.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.739+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e5c084260 con 0x7f1e6c0ada90 2024-09-13T17:25:16.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.743+0000 7f1e69400700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e4c066730 0x7f1e4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:16.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.743+0000 7f1e69400700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e4c066730 0x7f1e4c068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000c00 tx=0x7f1e58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:16.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.747+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e5c051210 con 0x7f1e6c0ada90 2024-09-13T17:25:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.943+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e6c0afe90 con 0x7f1e6c0ada90 2024-09-13T17:25:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.943+0000 7f1e62000700 1 -- 172.21.15.139:0/2752359647 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e5c054830 con 0x7f1e6c0ada90 2024-09-13T17:25:16.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e4c066730 msgr2=0x7f1e4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e4c066730 0x7f1e4c068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000c00 tx=0x7f1e58008030 comp rx=0 tx=0).stop 2024-09-13T17:25:16.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 msgr2=0x7f1e6c157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:16.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 0x7f1e6c157e00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00e760 tx=0x7f1e5c00eb20 comp rx=0 tx=0).stop 2024-09-13T17:25:16.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 shutdown_connections 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e4c066730 0x7f1e4c068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c15bb60 0x7f1e6c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c0b3c00 0x7f1e6c1e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 --2- 172.21.15.139:0/2752359647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6c0ada90 0x7f1e6c157e00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 >> 172.21.15.139:0/2752359647 conn(0x7f1e6c06ece0 msgr2=0x7f1e6c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 shutdown_connections 2024-09-13T17:25:16.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:16.947+0000 7f1e6b200700 1 -- 172.21.15.139:0/2752359647 wait complete. 2024-09-13T17:25:16.954 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-09-13T17:25:16.974 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:25:16.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:16.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T17:25:17.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:25:17.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:17.034 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:25:17.046 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:17.046 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:17.061 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:17.061 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:17.123 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:17.124 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:17.183 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:17.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.351+0000 7f91e1200700 1 Processor -- start 2024-09-13T17:25:17.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.351+0000 7f91e1200700 1 -- start start 2024-09-13T17:25:17.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91e1200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f91dc144770 0x7f91dc0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91e1200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91e1200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc15c160 con 0x7f91dc15b1c0 2024-09-13T17:25:17.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91e1200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc15c540 con 0x7f91dc144770 2024-09-13T17:25:17.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91e1200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc144b50 con 0x7f91dc06d9b0 2024-09-13T17:25:17.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d9e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f91dc144770 0x7f91dc0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d3e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f91dc15b1c0 0x7f91dc06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:50904/0 (socket says 172.21.15.139:50904) 2024-09-13T17:25:17.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d9e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f91dc144770 0x7f91dc0ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37106/0 (socket says 172.21.15.139:37106) 2024-09-13T17:25:17.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d3e00700 1 -- 172.21.15.139:0/3287225404 learned_addr learned my addr 172.21.15.139:0/3287225404 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:17.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91da800700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d9400700 1 -- 172.21.15.139:0/3287225404 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497183554 0 0) 0x7f91dc15c160 con 0x7f91dc15b1c0 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d9400700 1 -- 172.21.15.139:0/3287225404 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c00035d0 con 0x7f91dc15b1c0 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.355+0000 7f91d9e00700 1 -- 172.21.15.139:0/3287225404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 msgr2=0x7f91dc15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9e00700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9e00700 1 -- 172.21.15.139:0/3287225404 >> v1:172.21.15.176:6789/0 conn(0x7f91dc15b1c0 legacy=0x7f91dc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9e00700 1 -- 172.21.15.139:0/3287225404 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc15b620 con 0x7f91dc144770 2024-09-13T17:25:17.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91da800700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:17.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9e00700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc144770 0x7f91dc0ce5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009850 tx=0x7f91cc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f33c20781425b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:17.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9400700 1 -- 172.21.15.139:0/3287225404 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc011830 con 0x7f91dc144770 2024-09-13T17:25:17.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9400700 1 -- 172.21.15.139:0/3287225404 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc011990 con 0x7f91dc144770 2024-09-13T17:25:17.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91d9400700 1 -- 172.21.15.139:0/3287225404 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc011d00 con 0x7f91dc144770 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 -- 172.21.15.139:0/3287225404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc144770 msgr2=0x7f91dc0ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc144770 0x7f91dc0ce5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009850 tx=0x7f91cc009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 -- 172.21.15.139:0/3287225404 shutdown_connections 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 --2- 172.21.15.139:0/3287225404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc144770 0x7f91dc0ce5f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 -- 172.21.15.139:0/3287225404 >> 172.21.15.139:0/3287225404 conn(0x7f91dc06b1e0 msgr2=0x7f91dc06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 -- 172.21.15.139:0/3287225404 shutdown_connections 2024-09-13T17:25:17.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.359+0000 7f91e1200700 1 -- 172.21.15.139:0/3287225404 wait complete. 2024-09-13T17:25:17.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.363+0000 7f91e1200700 1 Processor -- start 2024-09-13T17:25:17.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.363+0000 7f91e1200700 1 -- start start 2024-09-13T17:25:17.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.363+0000 7f91e1200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.363+0000 7f91e1200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91dc144770 0x7f91dc0a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.363+0000 7f91e1200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 0x7f91dc133d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91e1200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc140ce0 con 0x7f91dc15b1c0 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91e1200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0a8ae0 con 0x7f91dc144770 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91e1200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0a9360 con 0x7f91dc06d9b0 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 0x7f91dc133d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 0x7f91dc133d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37120/0 (socket says 172.21.15.139:37120) 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 -- 172.21.15.139:0/2063871471 learned_addr learned my addr 172.21.15.139:0/2063871471 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91d3e00700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91dc144770 0x7f91dc0a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91d9e00700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 -- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 msgr2=0x7f91dc15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 -- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91dc144770 msgr2=0x7f91dc0a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91dc144770 0x7f91dc0a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 -- 172.21.15.139:0/2063871471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4009a70 con 0x7f91dc15b1c0 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91d9e00700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91da800700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 0x7f91dc133d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91d400efc0 tx=0x7f91d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400cb40 con 0x7f91dc15b1c0 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d400f040 con 0x7f91dc15b1c0 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc0094b0 con 0x7f91dc15b1c0 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4003a40 con 0x7f91dc15b1c0 2024-09-13T17:25:17.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc0a9920 con 0x7f91dc15b1c0 2024-09-13T17:25:17.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.367+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc0ce5f0 con 0x7f91dc15b1c0 2024-09-13T17:25:17.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.371+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91d4014480 con 0x7f91dc15b1c0 2024-09-13T17:25:17.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.375+0000 7f91d2000700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91b8066760 0x7f91b8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.375+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91d4084e30 con 0x7f91dc15b1c0 2024-09-13T17:25:17.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.375+0000 7f91d9e00700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91b8066760 0x7f91b8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.375+0000 7f91d9e00700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91b8066760 0x7f91b8068c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0090b0 tx=0x7f91cc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:17.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.379+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91d4051d40 con 0x7f91dc15b1c0 2024-09-13T17:25:17.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.567+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91dc0ae290 con 0x7f91dc15b1c0 2024-09-13T17:25:17.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.567+0000 7f91d2000700 1 -- 172.21.15.139:0/2063871471 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7f91d4018090 con 0x7f91dc15b1c0 2024-09-13T17:25:17.573 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:17.573 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91b8066760 msgr2=0x7f91b8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91b8066760 0x7f91b8068c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0090b0 tx=0x7f91cc008030 comp rx=0 tx=0).stop 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 msgr2=0x7f91dc133d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 0x7f91dc133d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91d400efc0 tx=0x7f91d400c3a0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 shutdown_connections 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91b8066760 0x7f91b8068c20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91dc15b1c0 0x7f91dc133d60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91dc144770 0x7f91dc0a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 --2- 172.21.15.139:0/2063871471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91dc06d9b0 0x7f91dc15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 >> 172.21.15.139:0/2063871471 conn(0x7f91dc06b1e0 msgr2=0x7f91dc15c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:17.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 shutdown_connections 2024-09-13T17:25:17.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.571+0000 7f91e1200700 1 -- 172.21.15.139:0/2063871471 wait complete. 2024-09-13T17:25:17.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:17.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:17.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.783+0000 7f59e2e00700 1 Processor -- start 2024-09-13T17:25:17.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.783+0000 7f59e2e00700 1 -- start start 2024-09-13T17:25:17.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.783+0000 7f59e2e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f59dc0cd650 0x7f59dc06e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.783+0000 7f59e2e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0cde30 con 0x7f59dc15abb0 2024-09-13T17:25:17.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.783+0000 7f59e2e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0ce110 con 0x7f59dc06ac20 2024-09-13T17:25:17.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.783+0000 7f59e2e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc15b6a0 con 0x7f59dc0cd650 2024-09-13T17:25:17.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e1a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f59dc15abb0 0x7f59dc15af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53618/0 (socket says 172.21.15.139:53618) 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e1a00700 1 -- 172.21.15.139:0/2962911369 learned_addr learned my addr 172.21.15.139:0/2962911369 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e1000700 1 --2- 172.21.15.139:0/2962911369 >> v2:172.21.15.176:3300/0 conn(0x7f59dc0cd650 0x7f59dc06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097670530 0 0) 0x7f59dc0cde30 con 0x7f59dc15abb0 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c40035d0 con 0x7f59dc15abb0 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976867422 0 0) 0x7f59c40035d0 con 0x7f59dc15abb0 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 >> v2:172.21.15.176:3300/0 conn(0x7f59dc0cd650 msgr2=0x7f59dc06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 --2- 172.21.15.139:0/2962911369 >> v2:172.21.15.176:3300/0 conn(0x7f59dc0cd650 0x7f59dc06e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 >> v1:172.21.15.176:6789/0 conn(0x7f59dc06ac20 legacy=0x7f59dc0ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0ce3f0 con 0x7f59dc15abb0 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f59d0001670 con 0x7f59dc15abb0 2024-09-13T17:25:17.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 >> v1:172.21.15.139:6789/0 conn(0x7f59dc15abb0 legacy=0x7f59dc15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4003a20 0x7f59c4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59c4004870 0x7f59c4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59c4005230 0x7f59c400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc15b6a0 con 0x7f59c4005230 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c400c0d0 con 0x7f59c4004870 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c400c290 con 0x7f59c4003a20 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e1000700 1 --2- 172.21.15.139:0/2962911369 >> v2:172.21.15.176:3300/0 conn(0x7f59dc0cd650 0x7f59dc06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59c4005230 0x7f59c400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e1a00700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4003a20 0x7f59c4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 -- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4003a20 msgr2=0x7f59c4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:17.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4003a20 0x7f59c4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 -- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59c4004870 msgr2=0x7f59c4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:17.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59c4004870 0x7f59c4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 -- 172.21.15.139:0/2962911369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40035d0 con 0x7f59c4005230 2024-09-13T17:25:17.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 -- 172.21.15.139:0/2962911369 reap_dead start 2024-09-13T17:25:17.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59e2400700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59c4005230 0x7f59c400ba30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c190 tx=0x7f59c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d198e833d513e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:17.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4001db0 con 0x7f59c4005230 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d400ccf0 con 0x7f59c4005230 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.787+0000 7f59dbe00700 1 -- 172.21.15.139:0/2962911369 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4003c60 con 0x7f59c4005230 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 -- 172.21.15.139:0/2962911369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59c4005230 msgr2=0x7f59c400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59c4005230 0x7f59c400ba30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c190 tx=0x7f59c40058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 -- 172.21.15.139:0/2962911369 shutdown_connections 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 --2- 172.21.15.139:0/2962911369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59c4005230 0x7f59c400ba30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 -- 172.21.15.139:0/2962911369 >> 172.21.15.139:0/2962911369 conn(0x7f59dc0cc890 msgr2=0x7f59dc0ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:17.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 -- 172.21.15.139:0/2962911369 shutdown_connections 2024-09-13T17:25:17.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 -- 172.21.15.139:0/2962911369 wait complete. 2024-09-13T17:25:17.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 Processor -- start 2024-09-13T17:25:17.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.791+0000 7f59e2e00700 1 -- start start 2024-09-13T17:25:17.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4005230 0x7f59dc1f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 0x7f59dc1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc158ef0 0x7f59dc15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06e740 con 0x7f59dc1f37c0 2024-09-13T17:25:17.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1533f0 con 0x7f59dc158ef0 2024-09-13T17:25:17.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc159370 con 0x7f59c4005230 2024-09-13T17:25:17.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 0x7f59dc1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 0x7f59dc1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37148/0 (socket says 172.21.15.139:37148) 2024-09-13T17:25:17.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 -- 172.21.15.139:0/3309933984 learned_addr learned my addr 172.21.15.139:0/3309933984 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1a00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4005230 0x7f59dc1f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2400700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc158ef0 0x7f59dc15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 -- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4005230 msgr2=0x7f59dc1f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4005230 0x7f59dc1f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 -- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc158ef0 msgr2=0x7f59dc15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc158ef0 0x7f59dc15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 -- 172.21.15.139:0/3309933984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc1527b0 con 0x7f59dc1f37c0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e1000700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 0x7f59dc1589b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f59c800ebc0 tx=0x7f59c800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8005a40 con 0x7f59dc1f37c0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8005bc0 con 0x7f59dc1f37c0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc152a50 con 0x7f59dc1f37c0 2024-09-13T17:25:17.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8004030 con 0x7f59dc1f37c0 2024-09-13T17:25:17.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.795+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc153010 con 0x7f59dc1f37c0 2024-09-13T17:25:17.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.799+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc0677e0 con 0x7f59dc1f37c0 2024-09-13T17:25:17.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.799+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59c8004190 con 0x7f59dc1f37c0 2024-09-13T17:25:17.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.803+0000 7f59d9600700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f59bc066760 0x7f59bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:17.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.803+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59c8084b30 con 0x7f59dc1f37c0 2024-09-13T17:25:17.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.803+0000 7f59e1a00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f59bc066760 0x7f59bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:17.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.803+0000 7f59e1a00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f59bc066760 0x7f59bc068c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59d0001200 tx=0x7f59d0007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:17.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.807+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59c8051ad0 con 0x7f59dc1f37c0 2024-09-13T17:25:17.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.991+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59dc153530 con 0x7f59dc1f37c0 2024-09-13T17:25:17.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.991+0000 7f59d9600700 1 -- 172.21.15.139:0/3309933984 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59dc153530 con 0x7f59dc1f37c0 2024-09-13T17:25:17.996 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:17.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.991+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f59bc066760 msgr2=0x7f59bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.991+0000 7f59e2e00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f59bc066760 0x7f59bc068c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59d0001200 tx=0x7f59d0007040 comp rx=0 tx=0).stop 2024-09-13T17:25:17.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.991+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 msgr2=0x7f59dc1589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:17.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.991+0000 7f59e2e00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 0x7f59dc1589b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f59c800ebc0 tx=0x7f59c800eed0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 shutdown_connections 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f59bc066760 0x7f59bc068c20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc158ef0 0x7f59dc15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59dc1f37c0 0x7f59dc1589b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 --2- 172.21.15.139:0/3309933984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59c4005230 0x7f59dc1f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 >> 172.21.15.139:0/3309933984 conn(0x7f59dc0cc890 msgr2=0x7f59dc071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 shutdown_connections 2024-09-13T17:25:17.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:17.995+0000 7f59e2e00700 1 -- 172.21.15.139:0/3309933984 wait complete. 2024-09-13T17:25:18.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:18.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 Processor -- start 2024-09-13T17:25:18.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 -- start start 2024-09-13T17:25:18.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbde015aff0 0x7fbde00cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbde006db60 0x7fbde00cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde0070140 con 0x7fbde006db60 2024-09-13T17:25:18.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde0070420 con 0x7fbde015aff0 2024-09-13T17:25:18.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.191+0000 7fbde5200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde0070700 con 0x7fbde0144300 2024-09-13T17:25:18.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbde006db60 0x7fbde00cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddf400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddea00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbde015aff0 0x7fbde00cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddf400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde006d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:59310/0 (socket says 172.21.15.139:59310) 2024-09-13T17:25:18.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddf400700 1 -- 172.21.15.139:0/2071915182 learned_addr learned my addr 172.21.15.139:0/2071915182 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:18.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 -- 172.21.15.139:0/2071915182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 msgr2=0x7fbde006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:18.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 --2- 172.21.15.139:0/2071915182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 -- 172.21.15.139:0/2071915182 >> v2:172.21.15.176:3300/0 conn(0x7fbde015aff0 msgr2=0x7fbde00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:18.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 --2- 172.21.15.139:0/2071915182 >> v2:172.21.15.176:3300/0 conn(0x7fbde015aff0 0x7fbde00cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 -- 172.21.15.139:0/2071915182 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00709e0 con 0x7fbde006db60 2024-09-13T17:25:18.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbddfe00700 1 --2- 172.21.15.139:0/2071915182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde00cdc00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbde00b3cc0 tx=0x7fbdd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841c07ad080a1210 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbdde000700 1 -- 172.21.15.139:0/2071915182 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800e070 con 0x7fbde006db60 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbdde000700 1 -- 172.21.15.139:0/2071915182 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd800bb20 con 0x7fbde006db60 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbdde000700 1 -- 172.21.15.139:0/2071915182 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8012430 con 0x7fbde006db60 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbde5200700 1 -- 172.21.15.139:0/2071915182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 msgr2=0x7fbde00cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.195+0000 7fbde5200700 1 --2- 172.21.15.139:0/2071915182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde00cdc00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbde00b3cc0 tx=0x7fbdd800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 -- 172.21.15.139:0/2071915182 shutdown_connections 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 --2- 172.21.15.139:0/2071915182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde00cdc00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 --2- 172.21.15.139:0/2071915182 >> v2:172.21.15.176:3300/0 conn(0x7fbde015aff0 0x7fbde00cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 --2- 172.21.15.139:0/2071915182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 -- 172.21.15.139:0/2071915182 >> 172.21.15.139:0/2071915182 conn(0x7fbde00ce9d0 msgr2=0x7fbde00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 -- 172.21.15.139:0/2071915182 shutdown_connections 2024-09-13T17:25:18.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 -- 172.21.15.139:0/2071915182 wait complete. 2024-09-13T17:25:18.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.199+0000 7fbde5200700 1 Processor -- start 2024-09-13T17:25:18.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 -- start start 2024-09-13T17:25:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde013b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde0159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde015aff0 0x7fbde0154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde013c5d0 con 0x7fbde006db60 2024-09-13T17:25:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde013c8b0 con 0x7fbde015aff0 2024-09-13T17:25:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde013cb90 con 0x7fbde0144300 2024-09-13T17:25:18.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde013b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde013b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37154/0 (socket says 172.21.15.139:37154) 2024-09-13T17:25:18.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 -- 172.21.15.139:0/262549163 learned_addr learned my addr 172.21.15.139:0/262549163 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:18.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddfe00700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde015aff0 0x7fbde0154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddea00700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde0159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 -- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 msgr2=0x7fbde0159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde0159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 -- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde015aff0 msgr2=0x7fbde0154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde015aff0 0x7fbde0154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 -- 172.21.15.139:0/262549163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8009a70 con 0x7fbde006db60 2024-09-13T17:25:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddea00700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde0159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbddf400700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde013b450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000e840 tx=0x7fbdd000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0013680 con 0x7fbde006db60 2024-09-13T17:25:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd00137e0 con 0x7fbde006db60 2024-09-13T17:25:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde013ce70 con 0x7fbde006db60 2024-09-13T17:25:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0013b70 con 0x7fbde006db60 2024-09-13T17:25:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.203+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde013c1f0 con 0x7fbde006db60 2024-09-13T17:25:18.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.207+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde00ac890 con 0x7fbde006db60 2024-09-13T17:25:18.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.207+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdd0013cd0 con 0x7fbde006db60 2024-09-13T17:25:18.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.211+0000 7fbdd7400700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbdc0066730 0x7fbdc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.211+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbdd00845c0 con 0x7fbde006db60 2024-09-13T17:25:18.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.211+0000 7fbddea00700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbdc0066730 0x7fbdc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.211+0000 7fbddea00700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbdc0066730 0x7fbdc0068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbde00cc490 tx=0x7fbdcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:18.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.219+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbdd0051440 con 0x7fbde006db60 2024-09-13T17:25:18.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.399+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbde006d620 con 0x7fbde006db60 2024-09-13T17:25:18.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.399+0000 7fbdd7400700 1 -- 172.21.15.139:0/262549163 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbdd0054a60 con 0x7fbde006db60 2024-09-13T17:25:18.405 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:18.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbdc0066730 msgr2=0x7fbdc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbdc0066730 0x7fbdc0068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbde00cc490 tx=0x7fbdcc008040 comp rx=0 tx=0).stop 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 msgr2=0x7fbde013b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde013b450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000e840 tx=0x7fbdd000eb50 comp rx=0 tx=0).stop 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 shutdown_connections 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbdc0066730 0x7fbdc0068bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde015aff0 0x7fbde0154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbde0144300 0x7fbde0159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 --2- 172.21.15.139:0/262549163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde006db60 0x7fbde013b450 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 >> 172.21.15.139:0/262549163 conn(0x7fbde00ce9d0 msgr2=0x7fbde01432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:18.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 shutdown_connections 2024-09-13T17:25:18.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.403+0000 7fbde5200700 1 -- 172.21.15.139:0/262549163 wait complete. 2024-09-13T17:25:18.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:18.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.611+0000 7f7042600700 1 Processor -- start 2024-09-13T17:25:18.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.611+0000 7f7042600700 1 -- start start 2024-09-13T17:25:18.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f7042600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f703c1592a0 0x7f703c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f7042600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0cd570 con 0x7f703c0719c0 2024-09-13T17:25:18.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f7042600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0b41c0 con 0x7f703c0ce410 2024-09-13T17:25:18.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f7042600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c15a8a0 con 0x7f703c1592a0 2024-09-13T17:25:18.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f703c1592a0 0x7f703c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f703c1592a0 0x7f703c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37158/0 (socket says 172.21.15.139:37158) 2024-09-13T17:25:18.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 -- 172.21.15.139:0/3543511035 learned_addr learned my addr 172.21.15.139:0/3543511035 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:18.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 -- 172.21.15.139:0/3543511035 >> v1:172.21.15.176:6789/0 conn(0x7f703c0ce410 legacy=0x7f703c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703a000700 1 -- 172.21.15.139:0/3543511035 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123530572 0 0) 0x7f703c0b41c0 con 0x7f703c0ce410 2024-09-13T17:25:18.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 -- 172.21.15.139:0/3543511035 >> v1:172.21.15.139:6789/0 conn(0x7f703c0719c0 legacy=0x7f703c070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 -- 172.21.15.139:0/3543511035 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0ce960 con 0x7f703c1592a0 2024-09-13T17:25:18.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703b400700 1 --2- 172.21.15.139:0/3543511035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c1592a0 0x7f703c15a360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f702c00bbc0 tx=0x7f702c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e926f25ed34c2c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:18.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703a000700 1 -- 172.21.15.139:0/3543511035 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00dd90 con 0x7f703c1592a0 2024-09-13T17:25:18.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703a000700 1 -- 172.21.15.139:0/3543511035 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c004030 con 0x7f703c1592a0 2024-09-13T17:25:18.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.615+0000 7f703a000700 1 -- 172.21.15.139:0/3543511035 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0043e0 con 0x7f703c1592a0 2024-09-13T17:25:18.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 -- 172.21.15.139:0/3543511035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c1592a0 msgr2=0x7f703c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 --2- 172.21.15.139:0/3543511035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c1592a0 0x7f703c15a360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f702c00bbc0 tx=0x7f702c00bed0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 -- 172.21.15.139:0/3543511035 shutdown_connections 2024-09-13T17:25:18.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 --2- 172.21.15.139:0/3543511035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c1592a0 0x7f703c15a360 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 -- 172.21.15.139:0/3543511035 >> 172.21.15.139:0/3543511035 conn(0x7f703c06b1e0 msgr2=0x7f703c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:18.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 -- 172.21.15.139:0/3543511035 shutdown_connections 2024-09-13T17:25:18.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 -- 172.21.15.139:0/3543511035 wait complete. 2024-09-13T17:25:18.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 Processor -- start 2024-09-13T17:25:18.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.619+0000 7f7042600700 1 -- start start 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f703c0719c0 0x7f703c1dfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 0x7f703c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f703c1592a0 0x7f703c13ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c1e0440 con 0x7f703c0ce410 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c1e0720 con 0x7f703c0719c0 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c1e0a00 con 0x7f703c1592a0 2024-09-13T17:25:18.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 0x7f703c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 0x7f703c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37172/0 (socket says 172.21.15.139:37172) 2024-09-13T17:25:18.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 -- 172.21.15.139:0/1555543005 learned_addr learned my addr 172.21.15.139:0/1555543005 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:18.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703b400700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f703c0719c0 0x7f703c1dfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703be00700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f703c1592a0 0x7f703c13ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 -- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f703c1592a0 msgr2=0x7f703c13ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f703c1592a0 0x7f703c13ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 -- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f703c0719c0 msgr2=0x7f703c1dfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f703c0719c0 0x7f703c1dfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 -- 172.21.15.139:0/1555543005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c00b820 con 0x7f703c0ce410 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f703aa00700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 0x7f703c1555a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f702800c520 tx=0x7f702800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280054e0 con 0x7f703c0ce410 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70280036a0 con 0x7f703c0ce410 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c1e0ce0 con 0x7f703c0ce410 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028003a30 con 0x7f703c0ce410 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.623+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c1e14e0 con 0x7f703c0ce410 2024-09-13T17:25:18.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.627+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c15a360 con 0x7f703c0ce410 2024-09-13T17:25:18.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.627+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7028003b90 con 0x7f703c0ce410 2024-09-13T17:25:18.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.627+0000 7f7033400700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f701c066730 0x7f701c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:18.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.627+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7028083b80 con 0x7f703c0ce410 2024-09-13T17:25:18.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.627+0000 7f703b400700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f701c066730 0x7f701c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:18.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.631+0000 7f703b400700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f701c066730 0x7f701c068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f702c006fd0 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.635+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7028050a00 con 0x7f703c0ce410 2024-09-13T17:25:18.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.819+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f703c06dc70 con 0x7f703c0ce410 2024-09-13T17:25:18.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.819+0000 7f7033400700 1 -- 172.21.15.139:0/1555543005 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7028083e60 con 0x7f703c0ce410 2024-09-13T17:25:18.825 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:18.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f701c066730 msgr2=0x7f701c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f701c066730 0x7f701c068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f702c006fd0 tx=0x7f702c008040 comp rx=0 tx=0).stop 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 msgr2=0x7f703c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 0x7f703c1555a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f702800c520 tx=0x7f702800c830 comp rx=0 tx=0).stop 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 shutdown_connections 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f701c066730 0x7f701c068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f703c1592a0 0x7f703c13ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f703c0ce410 0x7f703c1555a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 --2- 172.21.15.139:0/1555543005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f703c0719c0 0x7f703c1dfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 >> 172.21.15.139:0/1555543005 conn(0x7f703c06b1e0 msgr2=0x7f703c0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:18.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 shutdown_connections 2024-09-13T17:25:18.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:18.823+0000 7f7042600700 1 -- 172.21.15.139:0/1555543005 wait complete. 2024-09-13T17:25:18.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:19.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.011+0000 7f2072000700 1 Processor -- start 2024-09-13T17:25:19.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.011+0000 7f2072000700 1 -- start start 2024-09-13T17:25:19.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2072000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f206c0717d0 0x7f206c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2072000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c159340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2072000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c06b520 con 0x7f206c159880 2024-09-13T17:25:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2072000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c06b800 con 0x7f206c0717d0 2024-09-13T17:25:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2072000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06bae0 con 0x7f206c158f00 2024-09-13T17:25:19.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2071600700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f206c159880 0x7f206c06c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53636/0 (socket says 172.21.15.139:53636) 2024-09-13T17:25:19.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2071600700 1 -- 172.21.15.139:0/170958351 learned_addr learned my addr 172.21.15.139:0/170958351 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:19.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2070c00700 1 --2- 172.21.15.139:0/170958351 >> v2:172.21.15.176:3300/0 conn(0x7f206c0717d0 0x7f206c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f206be00700 1 --2- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f206b400700 1 -- 172.21.15.139:0/170958351 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573480140 0 0) 0x7f206c06b520 con 0x7f206c159880 2024-09-13T17:25:19.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f206b400700 1 -- 172.21.15.139:0/170958351 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20540035d0 con 0x7f206c159880 2024-09-13T17:25:19.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2070c00700 1 -- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 msgr2=0x7f206c159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:19.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2070c00700 1 --2- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2070c00700 1 -- 172.21.15.139:0/170958351 >> v1:172.21.15.139:6789/0 conn(0x7f206c159880 legacy=0x7f206c06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2070c00700 1 -- 172.21.15.139:0/170958351 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c06bdc0 con 0x7f206c0717d0 2024-09-13T17:25:19.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f2070c00700 1 --2- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c0717d0 0x7f206c06aea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2060009850 tx=0x7f2060009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c062aa9e19f0a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:19.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.015+0000 7f206b400700 1 -- 172.21.15.139:0/170958351 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060011830 con 0x7f206c0717d0 2024-09-13T17:25:19.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f206b400700 1 -- 172.21.15.139:0/170958351 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060011990 con 0x7f206c0717d0 2024-09-13T17:25:19.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f206b400700 1 -- 172.21.15.139:0/170958351 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060011d40 con 0x7f206c0717d0 2024-09-13T17:25:19.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 -- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c0717d0 msgr2=0x7f206c06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 --2- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c0717d0 0x7f206c06aea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2060009850 tx=0x7f2060009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 -- 172.21.15.139:0/170958351 shutdown_connections 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 --2- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 --2- 172.21.15.139:0/170958351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c0717d0 0x7f206c06aea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 -- 172.21.15.139:0/170958351 >> 172.21.15.139:0/170958351 conn(0x7f206c0ce9d0 msgr2=0x7f206c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 -- 172.21.15.139:0/170958351 shutdown_connections 2024-09-13T17:25:19.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 -- 172.21.15.139:0/170958351 wait complete. 2024-09-13T17:25:19.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 Processor -- start 2024-09-13T17:25:19.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.019+0000 7f2072000700 1 -- start start 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 0x7f206c14d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c0b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c159880 0x7f206c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15adc0 con 0x7f206c0717d0 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15bdf0 con 0x7f206c159880 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15b840 con 0x7f206c158f00 2024-09-13T17:25:19.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 0x7f206c14d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 0x7f206c14d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37182/0 (socket says 172.21.15.139:37182) 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 -- 172.21.15.139:0/2863096846 learned_addr learned my addr 172.21.15.139:0/2863096846 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2071600700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c159880 0x7f206c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f206be00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c0b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 -- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 msgr2=0x7f206c0b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c0b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 -- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c159880 msgr2=0x7f206c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c159880 0x7f206c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 -- 172.21.15.139:0/2863096846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600094b0 con 0x7f206c0717d0 2024-09-13T17:25:19.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2070c00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 0x7f206c14d040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20600090b0 tx=0x7f2060004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:19.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060004480 con 0x7f206c0717d0 2024-09-13T17:25:19.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206001f070 con 0x7f206c0717d0 2024-09-13T17:25:19.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c15c090 con 0x7f206c0717d0 2024-09-13T17:25:19.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060003900 con 0x7f206c0717d0 2024-09-13T17:25:19.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.023+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c15b320 con 0x7f206c0717d0 2024-09-13T17:25:19.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.027+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c06aea0 con 0x7f206c0717d0 2024-09-13T17:25:19.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.027+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2060021030 con 0x7f206c0717d0 2024-09-13T17:25:19.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.027+0000 7f2068c00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f204c066760 0x7f204c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.027+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20600858b0 con 0x7f206c0717d0 2024-09-13T17:25:19.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.027+0000 7f206be00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f204c066760 0x7f204c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.031+0000 7f206be00700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f204c066760 0x7f204c068c20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f206c0b20f0 tx=0x7f2058008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:19.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.035+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2060052970 con 0x7f206c0717d0 2024-09-13T17:25:19.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.211+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f206c1577f0 con 0x7f206c0717d0 2024-09-13T17:25:19.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.211+0000 7f2068c00700 1 -- 172.21.15.139:0/2863096846 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2060006ce0 con 0x7f206c0717d0 2024-09-13T17:25:19.215 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f204c066760 msgr2=0x7f204c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f204c066760 0x7f204c068c20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f206c0b20f0 tx=0x7f2058008040 comp rx=0 tx=0).stop 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 msgr2=0x7f206c14d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 0x7f206c14d040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20600090b0 tx=0x7f2060004770 comp rx=0 tx=0).stop 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 shutdown_connections 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f204c066760 0x7f204c068c20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c159880 0x7f206c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c158f00 0x7f206c0b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 --2- 172.21.15.139:0/2863096846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f206c0717d0 0x7f206c14d040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 >> 172.21.15.139:0/2863096846 conn(0x7f206c0ce9d0 msgr2=0x7f206c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:19.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 shutdown_connections 2024-09-13T17:25:19.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.215+0000 7f2072000700 1 -- 172.21.15.139:0/2863096846 wait complete. 2024-09-13T17:25:19.239 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:25:19.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.403+0000 7fa427200700 1 Processor -- start 2024-09-13T17:25:19.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.403+0000 7fa427200700 1 -- start start 2024-09-13T17:25:19.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa427200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa428071570 0x7fa42815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa427200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa42813f810 0x7fa42813fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa427200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42813f0c0 con 0x7fa428071190 2024-09-13T17:25:19.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa427200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42815a720 con 0x7fa42813f810 2024-09-13T17:25:19.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa427200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42815aa00 con 0x7fa428071570 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa426800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa42813f810 0x7fa42813fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa425e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa428071190 0x7fa428159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53648/0 (socket says 172.21.15.139:53648) 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa425e00700 1 -- 172.21.15.139:0/3833134878 learned_addr learned my addr 172.21.15.139:0/3833134878 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa425400700 1 --2- 172.21.15.139:0/3833134878 >> v2:172.21.15.176:3300/0 conn(0x7fa428071570 0x7fa42815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa426800700 1 -- 172.21.15.139:0/3833134878 >> v2:172.21.15.176:3300/0 conn(0x7fa428071570 msgr2=0x7fa42815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa426800700 1 --2- 172.21.15.139:0/3833134878 >> v2:172.21.15.176:3300/0 conn(0x7fa428071570 0x7fa42815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa426800700 1 -- 172.21.15.139:0/3833134878 >> v1:172.21.15.139:6789/0 conn(0x7fa428071190 legacy=0x7fa428159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa426800700 1 -- 172.21.15.139:0/3833134878 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42815ace0 con 0x7fa42813f810 2024-09-13T17:25:19.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa424a00700 1 -- 172.21.15.139:0/3833134878 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032400431 0 0) 0x7fa42813f0c0 con 0x7fa428071190 2024-09-13T17:25:19.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa426800700 1 --2- 172.21.15.139:0/3833134878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa42813fbf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa42806a420 tx=0x7fa42000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962eb157ce41b108 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:19.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa424a00700 1 -- 172.21.15.139:0/3833134878 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000e070 con 0x7fa42813f810 2024-09-13T17:25:19.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa424a00700 1 -- 172.21.15.139:0/3833134878 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000bb20 con 0x7fa42813f810 2024-09-13T17:25:19.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.407+0000 7fa424a00700 1 -- 172.21.15.139:0/3833134878 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420012430 con 0x7fa42813f810 2024-09-13T17:25:19.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 -- 172.21.15.139:0/3833134878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 msgr2=0x7fa42813fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 --2- 172.21.15.139:0/3833134878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa42813fbf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa42806a420 tx=0x7fa42000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:19.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 -- 172.21.15.139:0/3833134878 shutdown_connections 2024-09-13T17:25:19.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 --2- 172.21.15.139:0/3833134878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa42813fbf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 --2- 172.21.15.139:0/3833134878 >> v2:172.21.15.176:3300/0 conn(0x7fa428071570 0x7fa42815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 -- 172.21.15.139:0/3833134878 >> 172.21.15.139:0/3833134878 conn(0x7fa4280ce9d0 msgr2=0x7fa4280cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:19.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 -- 172.21.15.139:0/3833134878 shutdown_connections 2024-09-13T17:25:19.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.411+0000 7fa427200700 1 -- 172.21.15.139:0/3833134878 wait complete. 2024-09-13T17:25:19.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 Processor -- start 2024-09-13T17:25:19.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 -- start start 2024-09-13T17:25:19.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa428071190 0x7fa4281f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa428071570 0x7fa4280c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa428153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281f13d0 con 0x7fa42813f810 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428158140 con 0x7fa428071570 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa428158420 con 0x7fa428071190 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa428153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa428153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37188/0 (socket says 172.21.15.139:37188) 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 -- 172.21.15.139:0/995072649 learned_addr learned my addr 172.21.15.139:0/995072649 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa425e00700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa428071190 0x7fa4281f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa425400700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa428071570 0x7fa4280c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 -- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa428071190 msgr2=0x7fa4281f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa428071190 0x7fa4281f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 -- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa428071570 msgr2=0x7fa4280c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa428071570 0x7fa4280c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 -- 172.21.15.139:0/995072649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009a70 con 0x7fa42813f810 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa426800700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa428153980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4280cdc20 tx=0x7fa420004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:19.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420012430 con 0x7fa42813f810 2024-09-13T17:25:19.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420020070 con 0x7fa42813f810 2024-09-13T17:25:19.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa428158700 con 0x7fa42813f810 2024-09-13T17:25:19.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420004280 con 0x7fa42813f810 2024-09-13T17:25:19.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.415+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa428158cc0 con 0x7fa42813f810 2024-09-13T17:25:19.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.419+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42813d6f0 con 0x7fa42813f810 2024-09-13T17:25:19.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.419+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4200043e0 con 0x7fa42813f810 2024-09-13T17:25:19.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.423+0000 7fa41e000700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa408066730 0x7fa408068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:19.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.423+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa420022070 con 0x7fa42813f810 2024-09-13T17:25:19.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.423+0000 7fa425e00700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa408066730 0x7fa408068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:19.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.423+0000 7fa425e00700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa408066730 0x7fa408068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa418007fd0 tx=0x7fa418007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:19.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.431+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa420053650 con 0x7fa42813f810 2024-09-13T17:25:19.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.627+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa428072030 con 0x7fa42813f810 2024-09-13T17:25:19.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa41e000700 1 -- 172.21.15.139:0/995072649 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa42001ae60 con 0x7fa42813f810 2024-09-13T17:25:19.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa408066730 msgr2=0x7fa408068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa408066730 0x7fa408068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa418007fd0 tx=0x7fa418007c20 comp rx=0 tx=0).stop 2024-09-13T17:25:19.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 msgr2=0x7fa428153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:19.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa428153980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4280cdc20 tx=0x7fa420004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 shutdown_connections 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa408066730 0x7fa408068bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42813f810 0x7fa428153980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa428071570 0x7fa4280c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 --2- 172.21.15.139:0/995072649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa428071190 0x7fa4281f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 >> 172.21.15.139:0/995072649 conn(0x7fa4280ce9d0 msgr2=0x7fa42813e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 shutdown_connections 2024-09-13T17:25:19.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:19.631+0000 7fa427200700 1 -- 172.21.15.139:0/995072649 wait complete. 2024-09-13T17:25:19.638 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-09-13T17:25:19.661 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T17:25:19.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:19.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T17:25:19.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:25:19.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:19.716 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:25:19.745 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:19.745 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:19.765 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:19.765 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:19.825 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:19.826 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:19.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:20.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.111+0000 7f8b33e00700 1 Processor -- start 2024-09-13T17:25:20.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.111+0000 7f8b33e00700 1 -- start start 2024-09-13T17:25:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b33e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8b34144300 0x7f8b3406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b33e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b33e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b34070140 con 0x7f8b3406db60 2024-09-13T17:25:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b33e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b34070420 con 0x7f8b34144300 2024-09-13T17:25:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b33e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34070700 con 0x7f8b3415aff0 2024-09-13T17:25:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8b34144300 0x7f8b3406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8b34144300 0x7f8b3406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37200/0 (socket says 172.21.15.139:37200) 2024-09-13T17:25:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 -- 172.21.15.139:0/2114730478 learned_addr learned my addr 172.21.15.139:0/2114730478 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32000700 1 --2- 172.21.15.139:0/2114730478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 -- 172.21.15.139:0/2114730478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 msgr2=0x7f8b340cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 --2- 172.21.15.139:0/2114730478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b31600700 1 -- 172.21.15.139:0/2114730478 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737256027 0 0) 0x7f8b34070140 con 0x7f8b3406db60 2024-09-13T17:25:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 -- 172.21.15.139:0/2114730478 >> v1:172.21.15.176:6789/0 conn(0x7f8b3406db60 legacy=0x7f8b340b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.115+0000 7f8b32a00700 1 -- 172.21.15.139:0/2114730478 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340709e0 con 0x7f8b34144300 2024-09-13T17:25:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b32a00700 1 --2- 172.21.15.139:0/2114730478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b34144300 0x7f8b3406d620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009910 tx=0x7f8b24009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45ab21a0b5e964c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b31600700 1 -- 172.21.15.139:0/2114730478 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011830 con 0x7f8b34144300 2024-09-13T17:25:20.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b31600700 1 -- 172.21.15.139:0/2114730478 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24011990 con 0x7f8b34144300 2024-09-13T17:25:20.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b31600700 1 -- 172.21.15.139:0/2114730478 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011d40 con 0x7f8b34144300 2024-09-13T17:25:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 -- 172.21.15.139:0/2114730478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b34144300 msgr2=0x7f8b3406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 --2- 172.21.15.139:0/2114730478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b34144300 0x7f8b3406d620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009910 tx=0x7f8b24009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 -- 172.21.15.139:0/2114730478 shutdown_connections 2024-09-13T17:25:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 --2- 172.21.15.139:0/2114730478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 --2- 172.21.15.139:0/2114730478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b34144300 0x7f8b3406d620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 -- 172.21.15.139:0/2114730478 >> 172.21.15.139:0/2114730478 conn(0x7f8b340ce9d0 msgr2=0x7f8b340cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 -- 172.21.15.139:0/2114730478 shutdown_connections 2024-09-13T17:25:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.119+0000 7f8b33e00700 1 -- 172.21.15.139:0/2114730478 wait complete. 2024-09-13T17:25:20.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 Processor -- start 2024-09-13T17:25:20.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 -- start start 2024-09-13T17:25:20.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 0x7f8b3413b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b34144300 0x7f8b3413ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3413f8b0 con 0x7f8b3406db60 2024-09-13T17:25:20.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3413fb90 con 0x7f8b34144300 2024-09-13T17:25:20.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.123+0000 7f8b33e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3413fe70 con 0x7f8b3415aff0 2024-09-13T17:25:20.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 0x7f8b3413b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 0x7f8b3413b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37208/0 (socket says 172.21.15.139:37208) 2024-09-13T17:25:20.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 -- 172.21.15.139:0/1446622264 learned_addr learned my addr 172.21.15.139:0/1446622264 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:20.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32000700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b34144300 0x7f8b3413ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b33400700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 -- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 msgr2=0x7f8b340ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 -- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b34144300 msgr2=0x7f8b3413ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b34144300 0x7f8b3413ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 -- 172.21.15.139:0/1446622264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009570 con 0x7f8b3406db60 2024-09-13T17:25:20.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b32a00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 0x7f8b3413b6e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b340660e0 tx=0x7f8b24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24004300 con 0x7f8b3406db60 2024-09-13T17:25:20.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2401f070 con 0x7f8b3406db60 2024-09-13T17:25:20.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240036c0 con 0x7f8b3406db60 2024-09-13T17:25:20.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b34140150 con 0x7f8b3406db60 2024-09-13T17:25:20.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.127+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b340abd30 con 0x7f8b3406db60 2024-09-13T17:25:20.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.131+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b340abec0 con 0x7f8b3406db60 2024-09-13T17:25:20.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.131+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b24021030 con 0x7f8b3406db60 2024-09-13T17:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.135+0000 7f8b2aa00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8b14066730 0x7f8b14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.135+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b240859c0 con 0x7f8b3406db60 2024-09-13T17:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.135+0000 7f8b32000700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8b14066730 0x7f8b14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.135+0000 7f8b32000700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8b14066730 0x7f8b14068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b340b04a0 tx=0x7f8b20009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.139+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b24052960 con 0x7f8b3406db60 2024-09-13T17:25:20.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.335+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b3406d620 con 0x7f8b3406db60 2024-09-13T17:25:20.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.339+0000 7f8b2aa00700 1 -- 172.21.15.139:0/1446622264 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7f8b24055f80 con 0x7f8b3406db60 2024-09-13T17:25:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:20.344 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:20.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8b14066730 msgr2=0x7f8b14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8b14066730 0x7f8b14068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b340b04a0 tx=0x7f8b20009240 comp rx=0 tx=0).stop 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 msgr2=0x7f8b3413b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 0x7f8b3413b6e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b340660e0 tx=0x7f8b24004770 comp rx=0 tx=0).stop 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 shutdown_connections 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8b14066730 0x7f8b14068bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3415aff0 0x7f8b340ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b34144300 0x7f8b3413ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 --2- 172.21.15.139:0/1446622264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b3406db60 0x7f8b3413b6e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 >> 172.21.15.139:0/1446622264 conn(0x7f8b340ce9d0 msgr2=0x7f8b340cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 shutdown_connections 2024-09-13T17:25:20.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.343+0000 7f8b33e00700 1 -- 172.21.15.139:0/1446622264 wait complete. 2024-09-13T17:25:20.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:20.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:20.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.539+0000 7f8215000700 1 Processor -- start 2024-09-13T17:25:20.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.539+0000 7f8215000700 1 -- start start 2024-09-13T17:25:20.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8215000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f821015aff0 0x7f82100cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8215000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f82100cdc00 0x7f82100711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8215000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8210070140 con 0x7f8210144300 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8215000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82100ce070 con 0x7f82100cdc00 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8215000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8210070420 con 0x7f821015aff0 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f82100cdc00 0x7f82100711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820f400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8210144300 0x7f821006d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:50948/0 (socket says 172.21.15.139:50948) 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820f400700 1 -- 172.21.15.139:0/4118306395 learned_addr learned my addr 172.21.15.139:0/4118306395 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f82100cdc00 0x7f82100711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37220/0 (socket says 172.21.15.139:37220) 2024-09-13T17:25:20.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8206a00700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f821015aff0 0x7f82100cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 -- 172.21.15.139:0/4118306395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f821015aff0 msgr2=0x7f82100cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:20.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f821015aff0 0x7f82100cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 -- 172.21.15.139:0/4118306395 >> v1:172.21.15.176:6789/0 conn(0x7f8210144300 legacy=0x7f821006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 -- 172.21.15.139:0/4118306395 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210070700 con 0x7f82100cdc00 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820ea00700 1 -- 172.21.15.139:0/4118306395 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107803257 0 0) 0x7f8210070140 con 0x7f8210144300 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f8206a00700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f821015aff0 0x7f82100cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820fe00700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82100cdc00 0x7f82100711e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8208009d90 tx=0x7f820800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c9d202e6cefa64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820ea00700 1 -- 172.21.15.139:0/4118306395 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800e070 con 0x7f82100cdc00 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820ea00700 1 -- 172.21.15.139:0/4118306395 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800bbd0 con 0x7f82100cdc00 2024-09-13T17:25:20.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.543+0000 7f820ea00700 1 -- 172.21.15.139:0/4118306395 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208012430 con 0x7f82100cdc00 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 -- 172.21.15.139:0/4118306395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82100cdc00 msgr2=0x7f82100711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82100cdc00 0x7f82100711e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8208009d90 tx=0x7f820800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 -- 172.21.15.139:0/4118306395 shutdown_connections 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82100cdc00 0x7f82100711e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 --2- 172.21.15.139:0/4118306395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f821015aff0 0x7f82100cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 -- 172.21.15.139:0/4118306395 >> 172.21.15.139:0/4118306395 conn(0x7f82100ce9d0 msgr2=0x7f82100cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:20.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 -- 172.21.15.139:0/4118306395 shutdown_connections 2024-09-13T17:25:20.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.547+0000 7f8215000700 1 -- 172.21.15.139:0/4118306395 wait complete. 2024-09-13T17:25:20.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 Processor -- start 2024-09-13T17:25:20.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 -- start start 2024-09-13T17:25:20.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 0x7f82100adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8210144300 0x7f821006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f821015aff0 0x7f8210130f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82101f63e0 con 0x7f821015aff0 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82101f6870 con 0x7f82100cdc00 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8215000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82101372d0 con 0x7f8210144300 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 0x7f82100adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 0x7f82100adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:40060/0 (socket says 172.21.15.139:40060) 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 -- 172.21.15.139:0/1047570238 learned_addr learned my addr 172.21.15.139:0/1047570238 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:20.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820fe00700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f821015aff0 0x7f8210130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8206a00700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8210144300 0x7f821006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 -- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8210144300 msgr2=0x7f821006cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8210144300 0x7f821006cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 -- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f821015aff0 msgr2=0x7f8210130f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f821015aff0 0x7f8210130f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f820f400700 1 -- 172.21.15.139:0/1047570238 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009a70 con 0x7f82100cdc00 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.551+0000 7f8206a00700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8210144300 0x7f821006cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f820f400700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 0x7f82100adc20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f820000c550 tx=0x7f820000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200004ca0 con 0x7f82100cdc00 2024-09-13T17:25:20.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8200004e00 con 0x7f82100cdc00 2024-09-13T17:25:20.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200007310 con 0x7f82100cdc00 2024-09-13T17:25:20.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82100ae160 con 0x7f82100cdc00 2024-09-13T17:25:20.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82101f5d90 con 0x7f82100cdc00 2024-09-13T17:25:20.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.555+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82101446e0 con 0x7f82100cdc00 2024-09-13T17:25:20.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.559+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8200007470 con 0x7f82100cdc00 2024-09-13T17:25:20.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.559+0000 7f8207e00700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f81ec066730 0x7f81ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.559+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f82000842e0 con 0x7f82100cdc00 2024-09-13T17:25:20.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.559+0000 7f8206a00700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f81ec066730 0x7f81ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.559+0000 7f8206a00700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f81ec066730 0x7f81ec068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f82101f5870 tx=0x7f81f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.567+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82000511f0 con 0x7f82100cdc00 2024-09-13T17:25:20.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.747+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82100cf1c0 con 0x7f82100cdc00 2024-09-13T17:25:20.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.751+0000 7f8207e00700 1 -- 172.21.15.139:0/1047570238 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8200007720 con 0x7f82100cdc00 2024-09-13T17:25:20.754 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:20.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f81ec066730 msgr2=0x7f81ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f81ec066730 0x7f81ec068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f82101f5870 tx=0x7f81f8008040 comp rx=0 tx=0).stop 2024-09-13T17:25:20.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 msgr2=0x7f82100adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 0x7f82100adc20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f820000c550 tx=0x7f820000c860 comp rx=0 tx=0).stop 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 shutdown_connections 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f81ec066730 0x7f81ec068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f821015aff0 0x7f8210130f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8210144300 0x7f821006cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 --2- 172.21.15.139:0/1047570238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82100cdc00 0x7f82100adc20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 >> 172.21.15.139:0/1047570238 conn(0x7f82100ce9d0 msgr2=0x7f82100afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 shutdown_connections 2024-09-13T17:25:20.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.755+0000 7f8215000700 1 -- 172.21.15.139:0/1047570238 wait complete. 2024-09-13T17:25:20.783 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:20.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.959+0000 7f8e3ee00700 1 Processor -- start 2024-09-13T17:25:20.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.959+0000 7f8e3ee00700 1 -- start start 2024-09-13T17:25:20.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3ee00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 0x7f8e380cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3ee00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e380cde80 0x7f8e3806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3ee00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8e3806a8d0 0x7f8e380d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3ee00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3806ad60 con 0x7f8e3806a8d0 2024-09-13T17:25:20.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3ee00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3815d190 con 0x7f8e3815cdb0 2024-09-13T17:25:20.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3ee00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380ce4b0 con 0x7f8e380cde80 2024-09-13T17:25:20.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3d000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e380cde80 0x7f8e3806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3da00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 0x7f8e380cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8e3806a8d0 0x7f8e380d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3da00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 0x7f8e380cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:40068/0 (socket says 172.21.15.139:40068) 2024-09-13T17:25:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3d000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e380cde80 0x7f8e3806a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:59390/0 (socket says 172.21.15.139:59390) 2024-09-13T17:25:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3da00700 1 -- 172.21.15.139:0/2206000718 learned_addr learned my addr 172.21.15.139:0/2206000718 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 -- 172.21.15.139:0/2206000718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e380cde80 msgr2=0x7f8e3806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 --2- 172.21.15.139:0/2206000718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e380cde80 0x7f8e3806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 -- 172.21.15.139:0/2206000718 >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 msgr2=0x7f8e380cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:20.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 --2- 172.21.15.139:0/2206000718 >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 0x7f8e380cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 -- 172.21.15.139:0/2206000718 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380ce790 con 0x7f8e3806a8d0 2024-09-13T17:25:20.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3da00700 1 --2- 172.21.15.139:0/2206000718 >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 0x7f8e380cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:20.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e3e400700 1 --2- 172.21.15.139:0/2206000718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e3806a8d0 0x7f8e380d0940 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e380d3e70 tx=0x7f8e3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60476e8de23a0867 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e37e00700 1 -- 172.21.15.139:0/2206000718 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000e070 con 0x7f8e3806a8d0 2024-09-13T17:25:20.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e37e00700 1 -- 172.21.15.139:0/2206000718 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000bb20 con 0x7f8e3806a8d0 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.963+0000 7f8e37e00700 1 -- 172.21.15.139:0/2206000718 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30012430 con 0x7f8e3806a8d0 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 -- 172.21.15.139:0/2206000718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e3806a8d0 msgr2=0x7f8e380d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/2206000718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e3806a8d0 0x7f8e380d0940 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e380d3e70 tx=0x7f8e3000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 -- 172.21.15.139:0/2206000718 shutdown_connections 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/2206000718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e3806a8d0 0x7f8e380d0940 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/2206000718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e380cde80 0x7f8e3806a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/2206000718 >> v2:172.21.15.176:3300/0 conn(0x7f8e3815cdb0 0x7f8e380cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 -- 172.21.15.139:0/2206000718 >> 172.21.15.139:0/2206000718 conn(0x7f8e380d2d70 msgr2=0x7f8e380d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:20.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 -- 172.21.15.139:0/2206000718 shutdown_connections 2024-09-13T17:25:20.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 -- 172.21.15.139:0/2206000718 wait complete. 2024-09-13T17:25:20.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.967+0000 7f8e3ee00700 1 Processor -- start 2024-09-13T17:25:20.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 -- start start 2024-09-13T17:25:20.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e3806a8d0 0x7f8e3814de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 0x7f8e380cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e3815cdb0 0x7f8e3815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c7360 con 0x7f8e380cde80 2024-09-13T17:25:20.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3814e3d0 con 0x7f8e3815cdb0 2024-09-13T17:25:20.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c6d30 con 0x7f8e3806a8d0 2024-09-13T17:25:20.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 0x7f8e380cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 0x7f8e380cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37248/0 (socket says 172.21.15.139:37248) 2024-09-13T17:25:20.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 -- 172.21.15.139:0/1155615471 learned_addr learned my addr 172.21.15.139:0/1155615471 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:20.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3da00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e3806a8d0 0x7f8e3814de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3e400700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e3815cdb0 0x7f8e3815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 -- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e3806a8d0 msgr2=0x7f8e3814de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e3806a8d0 0x7f8e3814de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 -- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e3815cdb0 msgr2=0x7f8e3815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:20.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e3815cdb0 0x7f8e3815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:20.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 -- 172.21.15.139:0/1155615471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c009570 con 0x7f8e380cde80 2024-09-13T17:25:20.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3d000700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 0x7f8e380cb950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e960 tx=0x7f8e2400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240096c0 con 0x7f8e380cde80 2024-09-13T17:25:20.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400eeb0 con 0x7f8e380cde80 2024-09-13T17:25:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.971+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e30009a70 con 0x7f8e380cde80 2024-09-13T17:25:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.975+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400ca50 con 0x7f8e380cde80 2024-09-13T17:25:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.975+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e380cc130 con 0x7f8e380cde80 2024-09-13T17:25:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.975+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e380677e0 con 0x7f8e380cde80 2024-09-13T17:25:20.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.975+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e2400cc10 con 0x7f8e380cde80 2024-09-13T17:25:20.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.979+0000 7f8e35600700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8e18066730 0x7f8e18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:20.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.979+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8e24084550 con 0x7f8e380cde80 2024-09-13T17:25:20.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.979+0000 7f8e3da00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8e18066730 0x7f8e18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:20.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.979+0000 7f8e3da00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8e18066730 0x7f8e18068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c006d50 tx=0x7f8e2c0092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:20.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:20.983+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e24051510 con 0x7f8e380cde80 2024-09-13T17:25:21.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e380c74a0 con 0x7f8e380cde80 2024-09-13T17:25:21.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e35600700 1 -- 172.21.15.139:0/1155615471 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e380c74a0 con 0x7f8e380cde80 2024-09-13T17:25:21.166 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8e18066730 msgr2=0x7f8e18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8e18066730 0x7f8e18068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c006d50 tx=0x7f8e2c0092e0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 msgr2=0x7f8e380cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 0x7f8e380cb950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e960 tx=0x7f8e2400ec70 comp rx=0 tx=0).stop 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 shutdown_connections 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8e18066730 0x7f8e18068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e3815cdb0 0x7f8e3815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e380cde80 0x7f8e380cb950 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.163+0000 7f8e3ee00700 1 --2- 172.21.15.139:0/1155615471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e3806a8d0 0x7f8e3814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.167+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 >> 172.21.15.139:0/1155615471 conn(0x7f8e380d2d70 msgr2=0x7f8e38157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:21.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.167+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 shutdown_connections 2024-09-13T17:25:21.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.167+0000 7f8e3ee00700 1 -- 172.21.15.139:0/1155615471 wait complete. 2024-09-13T17:25:21.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:21.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.367+0000 7f3524200700 1 Processor -- start 2024-09-13T17:25:21.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3524200700 1 -- start start 2024-09-13T17:25:21.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3524200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f351c0b0f80 0x7f351c0b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3524200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06cd90 0x7f351c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3524200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c06e6e0 con 0x7f351c06f710 2024-09-13T17:25:21.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3524200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c06f2f0 con 0x7f351c0b0f80 2024-09-13T17:25:21.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3524200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0cd900 con 0x7f351c06cd90 2024-09-13T17:25:21.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3520e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f351c06f710 0x7f351c0cd1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:50964/0 (socket says 172.21.15.139:50964) 2024-09-13T17:25:21.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3520e00700 1 -- 172.21.15.139:0/3152118573 learned_addr learned my addr 172.21.15.139:0/3152118573 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:21.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3521800700 1 --2- 172.21.15.139:0/3152118573 >> v2:172.21.15.176:3300/0 conn(0x7f351c0b0f80 0x7f351c0b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.371+0000 7f3522200700 1 --2- 172.21.15.139:0/3152118573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06cd90 0x7f351c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f351be00700 1 -- 172.21.15.139:0/3152118573 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977728426 0 0) 0x7f351c06e6e0 con 0x7f351c06f710 2024-09-13T17:25:21.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f351be00700 1 -- 172.21.15.139:0/3152118573 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35040035d0 con 0x7f351c06f710 2024-09-13T17:25:21.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3522200700 1 -- 172.21.15.139:0/3152118573 >> v2:172.21.15.176:3300/0 conn(0x7f351c0b0f80 msgr2=0x7f351c0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:21.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3522200700 1 --2- 172.21.15.139:0/3152118573 >> v2:172.21.15.176:3300/0 conn(0x7f351c0b0f80 0x7f351c0b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3522200700 1 -- 172.21.15.139:0/3152118573 >> v1:172.21.15.176:6789/0 conn(0x7f351c06f710 legacy=0x7f351c0cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3522200700 1 -- 172.21.15.139:0/3152118573 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c0b18a0 con 0x7f351c06cd90 2024-09-13T17:25:21.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3521800700 1 --2- 172.21.15.139:0/3152118573 >> v2:172.21.15.176:3300/0 conn(0x7f351c0b0f80 0x7f351c0b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:21.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3522200700 1 --2- 172.21.15.139:0/3152118573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06cd90 0x7f351c0cdb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3514009d90 tx=0x7f351400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593ec134e903ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:21.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f351be00700 1 -- 172.21.15.139:0/3152118573 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400e070 con 0x7f351c06cd90 2024-09-13T17:25:21.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f351be00700 1 -- 172.21.15.139:0/3152118573 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351400bb20 con 0x7f351c06cd90 2024-09-13T17:25:21.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f351be00700 1 -- 172.21.15.139:0/3152118573 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514012430 con 0x7f351c06cd90 2024-09-13T17:25:21.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 -- 172.21.15.139:0/3152118573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06cd90 msgr2=0x7f351c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 --2- 172.21.15.139:0/3152118573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06cd90 0x7f351c0cdb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3514009d90 tx=0x7f351400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:21.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 -- 172.21.15.139:0/3152118573 shutdown_connections 2024-09-13T17:25:21.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 --2- 172.21.15.139:0/3152118573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06cd90 0x7f351c0cdb30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 --2- 172.21.15.139:0/3152118573 >> v2:172.21.15.176:3300/0 conn(0x7f351c0b0f80 0x7f351c0b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 -- 172.21.15.139:0/3152118573 >> 172.21.15.139:0/3152118573 conn(0x7f351c0afb90 msgr2=0x7f351c0b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:21.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 -- 172.21.15.139:0/3152118573 shutdown_connections 2024-09-13T17:25:21.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.375+0000 7f3524200700 1 -- 172.21.15.139:0/3152118573 wait complete. 2024-09-13T17:25:21.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.379+0000 7f3524200700 1 Processor -- start 2024-09-13T17:25:21.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 -- start start 2024-09-13T17:25:21.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f351c06cd90 0x7f351c148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06f710 0x7f351c06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 0x7f351c144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c144750 con 0x7f351c0b0f80 2024-09-13T17:25:21.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c144400 con 0x7f351c06cd90 2024-09-13T17:25:21.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0acd70 con 0x7f351c06f710 2024-09-13T17:25:21.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 0x7f351c144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 0x7f351c144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37258/0 (socket says 172.21.15.139:37258) 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 -- 172.21.15.139:0/1464148772 learned_addr learned my addr 172.21.15.139:0/1464148772 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3521800700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f351c06cd90 0x7f351c148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3520e00700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06f710 0x7f351c06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 -- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06f710 msgr2=0x7f351c06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06f710 0x7f351c06ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 -- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f351c06cd90 msgr2=0x7f351c148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f351c06cd90 0x7f351c148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 -- 172.21.15.139:0/1464148772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100094b0 con 0x7f351c0b0f80 2024-09-13T17:25:21.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3522200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 0x7f351c144b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3514014040 tx=0x7f3514004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:21.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514012430 con 0x7f351c0b0f80 2024-09-13T17:25:21.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514020070 con 0x7f351c0b0f80 2024-09-13T17:25:21.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3514009a70 con 0x7f351c0b0f80 2024-09-13T17:25:21.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514003e10 con 0x7f351c0b0f80 2024-09-13T17:25:21.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.383+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c0ad330 con 0x7f351c0b0f80 2024-09-13T17:25:21.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.387+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c1449c0 con 0x7f351c0b0f80 2024-09-13T17:25:21.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.387+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3514004040 con 0x7f351c0b0f80 2024-09-13T17:25:21.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.387+0000 7f3519600700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34fc066730 0x7f34fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.387+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3514022070 con 0x7f351c0b0f80 2024-09-13T17:25:21.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.387+0000 7f3521800700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34fc066730 0x7f34fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.391+0000 7f3521800700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34fc066730 0x7f34fc068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3510009d80 tx=0x7f3510009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:21.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.395+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3514053000 con 0x7f351c0b0f80 2024-09-13T17:25:21.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.575+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f351c0ad550 con 0x7f351c0b0f80 2024-09-13T17:25:21.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.575+0000 7f3519600700 1 -- 172.21.15.139:0/1464148772 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f351402c020 con 0x7f351c0b0f80 2024-09-13T17:25:21.580 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:21.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34fc066730 msgr2=0x7f34fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34fc066730 0x7f34fc068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3510009d80 tx=0x7f3510009240 comp rx=0 tx=0).stop 2024-09-13T17:25:21.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 msgr2=0x7f351c144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 0x7f351c144b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3514014040 tx=0x7f3514004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 shutdown_connections 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f34fc066730 0x7f34fc068bf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f351c0b0f80 0x7f351c144b50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f351c06f710 0x7f351c06ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 --2- 172.21.15.139:0/1464148772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f351c06cd90 0x7f351c148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 >> 172.21.15.139:0/1464148772 conn(0x7f351c0afb90 msgr2=0x7f351c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 shutdown_connections 2024-09-13T17:25:21.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.579+0000 7f3524200700 1 -- 172.21.15.139:0/1464148772 wait complete. 2024-09-13T17:25:21.604 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:21.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 Processor -- start 2024-09-13T17:25:21.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 -- start start 2024-09-13T17:25:21.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8db415ebb0 0x7f8db40b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8db415f5c0 0x7f8db41434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 0x7f8db4143a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db40b41a0 con 0x7f8db415f5c0 2024-09-13T17:25:21.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db40b6370 con 0x7f8db415ebb0 2024-09-13T17:25:21.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.783+0000 7f8db9600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db40b6650 con 0x7f8db415ef90 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 0x7f8db4143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 0x7f8db4143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:59424/0 (socket says 172.21.15.139:59424) 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 -- 172.21.15.139:0/1780687307 learned_addr learned my addr 172.21.15.139:0/1780687307 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8dabe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8db415f5c0 0x7f8db41434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db3e00700 1 --2- 172.21.15.139:0/1780687307 >> v2:172.21.15.176:3300/0 conn(0x7f8db415ebb0 0x7f8db40b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 -- 172.21.15.139:0/1780687307 >> v2:172.21.15.176:3300/0 conn(0x7f8db415ebb0 msgr2=0x7f8db40b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 --2- 172.21.15.139:0/1780687307 >> v2:172.21.15.176:3300/0 conn(0x7f8db415ebb0 0x7f8db40b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 -- 172.21.15.139:0/1780687307 >> v2:172.21.15.139:3300/0 conn(0x7f8db415f5c0 msgr2=0x7f8db41434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:21.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 --2- 172.21.15.139:0/1780687307 >> v2:172.21.15.139:3300/0 conn(0x7f8db415f5c0 0x7f8db41434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 -- 172.21.15.139:0/1780687307 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40b6930 con 0x7f8db415ef90 2024-09-13T17:25:21.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db8c00700 1 --2- 172.21.15.139:0/1780687307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 0x7f8db4143a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8db4071870 tx=0x7f8dac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf4349e35866bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:21.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db3400700 1 -- 172.21.15.139:0/1780687307 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00e070 con 0x7f8db415ef90 2024-09-13T17:25:21.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db3400700 1 -- 172.21.15.139:0/1780687307 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac00b910 con 0x7f8db415ef90 2024-09-13T17:25:21.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db3400700 1 -- 172.21.15.139:0/1780687307 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00bcc0 con 0x7f8db415ef90 2024-09-13T17:25:21.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 -- 172.21.15.139:0/1780687307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 msgr2=0x7f8db4143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 --2- 172.21.15.139:0/1780687307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 0x7f8db4143a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8db4071870 tx=0x7f8dac00b330 comp rx=0 tx=0).stop 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 -- 172.21.15.139:0/1780687307 shutdown_connections 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 --2- 172.21.15.139:0/1780687307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ef90 0x7f8db4143a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 --2- 172.21.15.139:0/1780687307 >> v2:172.21.15.139:3300/0 conn(0x7f8db415f5c0 0x7f8db41434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 --2- 172.21.15.139:0/1780687307 >> v2:172.21.15.176:3300/0 conn(0x7f8db415ebb0 0x7f8db40b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 -- 172.21.15.139:0/1780687307 >> 172.21.15.139:0/1780687307 conn(0x7f8db4071fa0 msgr2=0x7f8db4072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 -- 172.21.15.139:0/1780687307 shutdown_connections 2024-09-13T17:25:21.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.787+0000 7f8db9600700 1 -- 172.21.15.139:0/1780687307 wait complete. 2024-09-13T17:25:21.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 Processor -- start 2024-09-13T17:25:21.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 -- start start 2024-09-13T17:25:21.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ebb0 0x7f8db41f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db415ef90 0x7f8db4157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 0x7f8db4154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db415cd00 con 0x7f8db415f5c0 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4154b10 con 0x7f8db415ef90 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.791+0000 7f8db9600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db415c3d0 con 0x7f8db415ebb0 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 0x7f8db4154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 0x7f8db4154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37282/0 (socket says 172.21.15.139:37282) 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 -- 172.21.15.139:0/1098377456 learned_addr learned my addr 172.21.15.139:0/1098377456 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db3e00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ebb0 0x7f8db41f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8dabe00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db415ef90 0x7f8db4157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 -- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ebb0 msgr2=0x7f8db41f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ebb0 0x7f8db41f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 -- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db415ef90 msgr2=0x7f8db4157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db415ef90 0x7f8db4157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 -- 172.21.15.139:0/1098377456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009b30 con 0x7f8db415f5c0 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db8c00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 0x7f8db4154100 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8db40b6790 tx=0x7f8dac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0099b0 con 0x7f8db415f5c0 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac00ce80 con 0x7f8db415f5c0 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db415c6b0 con 0x7f8db415f5c0 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac004490 con 0x7f8db415f5c0 2024-09-13T17:25:21.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db41581d0 con 0x7f8db415f5c0 2024-09-13T17:25:21.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.795+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db40677e0 con 0x7f8db415f5c0 2024-09-13T17:25:21.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.799+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8dac0045f0 con 0x7f8db415f5c0 2024-09-13T17:25:21.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.799+0000 7f8db0c00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d90066730 0x7f8d90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:21.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.799+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8dac085bf0 con 0x7f8db415f5c0 2024-09-13T17:25:21.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.799+0000 7f8db3e00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d90066730 0x7f8d90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:21.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.803+0000 7f8db3e00700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d90066730 0x7f8d90068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8db4144450 tx=0x7f8da4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:21.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.807+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8dac052b10 con 0x7f8db415f5c0 2024-09-13T17:25:21.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.986+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8db40b06f0 con 0x7f8db415f5c0 2024-09-13T17:25:22.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.986+0000 7f8db0c00700 1 -- 172.21.15.139:0/1098377456 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8db40b06f0 con 0x7f8db415f5c0 2024-09-13T17:25:22.046 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:22.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d90066730 msgr2=0x7f8d90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d90066730 0x7f8d90068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8db4144450 tx=0x7f8da4009240 comp rx=0 tx=0).stop 2024-09-13T17:25:22.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 msgr2=0x7f8db4154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 0x7f8db4154100 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8db40b6790 tx=0x7f8dac004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 shutdown_connections 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d90066730 0x7f8d90068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8db415f5c0 0x7f8db4154100 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8db415ef90 0x7f8db4157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 --2- 172.21.15.139:0/1098377456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8db415ebb0 0x7f8db41f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 >> 172.21.15.139:0/1098377456 conn(0x7f8db4071fa0 msgr2=0x7f8db413ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 shutdown_connections 2024-09-13T17:25:22.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:21.990+0000 7f8db9600700 1 -- 172.21.15.139:0/1098377456 wait complete. 2024-09-13T17:25:22.049 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:25:22.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.210+0000 7f3cf6200700 1 Processor -- start 2024-09-13T17:25:22.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.210+0000 7f3cf6200700 1 -- start start 2024-09-13T17:25:22.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf6200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cf0144300 0x7f3cf006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf6200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0070140 con 0x7f3cf00cddd0 2024-09-13T17:25:22.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf6200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0070420 con 0x7f3cf015aff0 2024-09-13T17:25:22.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf6200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf0070700 con 0x7f3cf0144300 2024-09-13T17:25:22.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf4e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cf0144300 0x7f3cf006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf4e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3cf0144300 0x7f3cf006d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37294/0 (socket says 172.21.15.139:37294) 2024-09-13T17:25:22.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf5800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3cf00cddd0 0x7f3cf00711e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53658/0 (socket says 172.21.15.139:53658) 2024-09-13T17:25:22.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf4e00700 1 -- 172.21.15.139:0/3543777411 learned_addr learned my addr 172.21.15.139:0/3543777411 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:22.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf4e00700 1 -- 172.21.15.139:0/3543777411 >> v1:172.21.15.176:6789/0 conn(0x7f3cf015aff0 legacy=0x7f3cf00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cefe00700 1 -- 172.21.15.139:0/3543777411 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013097708 0 0) 0x7f3cf0070140 con 0x7f3cf00cddd0 2024-09-13T17:25:22.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf4e00700 1 -- 172.21.15.139:0/3543777411 >> v1:172.21.15.139:6789/0 conn(0x7f3cf00cddd0 legacy=0x7f3cf00711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.214+0000 7f3cf4e00700 1 -- 172.21.15.139:0/3543777411 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00709e0 con 0x7f3cf0144300 2024-09-13T17:25:22.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf4e00700 1 --2- 172.21.15.139:0/3543777411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf0144300 0x7f3cf006d620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009940 tx=0x7f3ce0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05db6f8afbb738d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cefe00700 1 -- 172.21.15.139:0/3543777411 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000ba20 con 0x7f3cf0144300 2024-09-13T17:25:22.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cefe00700 1 -- 172.21.15.139:0/3543777411 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce0009e90 con 0x7f3cf0144300 2024-09-13T17:25:22.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cefe00700 1 -- 172.21.15.139:0/3543777411 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000bda0 con 0x7f3cf0144300 2024-09-13T17:25:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 -- 172.21.15.139:0/3543777411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf0144300 msgr2=0x7f3cf006d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 --2- 172.21.15.139:0/3543777411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf0144300 0x7f3cf006d620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009940 tx=0x7f3ce0009c50 comp rx=0 tx=0).stop 2024-09-13T17:25:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 -- 172.21.15.139:0/3543777411 shutdown_connections 2024-09-13T17:25:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 --2- 172.21.15.139:0/3543777411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf0144300 0x7f3cf006d620 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 -- 172.21.15.139:0/3543777411 >> 172.21.15.139:0/3543777411 conn(0x7f3cf00ce9d0 msgr2=0x7f3cf00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 -- 172.21.15.139:0/3543777411 shutdown_connections 2024-09-13T17:25:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.218+0000 7f3cf6200700 1 -- 172.21.15.139:0/3543777411 wait complete. 2024-09-13T17:25:22.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 Processor -- start 2024-09-13T17:25:22.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 -- start start 2024-09-13T17:25:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 0x7f3cf01f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf0144300 0x7f3cf0142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf015aff0 0x7f3cf0143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf01e8cc0 con 0x7f3cf00cddd0 2024-09-13T17:25:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf013ae90 con 0x7f3cf015aff0 2024-09-13T17:25:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf6200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf01f6630 con 0x7f3cf0144300 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf4e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 0x7f3cf01f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf4e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 0x7f3cf01f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37308/0 (socket says 172.21.15.139:37308) 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf4e00700 1 -- 172.21.15.139:0/2966304379 learned_addr learned my addr 172.21.15.139:0/2966304379 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3ce7e00700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf0144300 0x7f3cf0142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.222+0000 7f3cf5800700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf015aff0 0x7f3cf0143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf4e00700 1 -- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf0144300 msgr2=0x7f3cf0142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf4e00700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf0144300 0x7f3cf0142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf4e00700 1 -- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf015aff0 msgr2=0x7f3cf0143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf4e00700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf015aff0 0x7f3cf0143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf4e00700 1 -- 172.21.15.139:0/2966304379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0009570 con 0x7f3cf00cddd0 2024-09-13T17:25:22.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf4e00700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 0x7f3cf01f60f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0000c00 tx=0x7f3ce0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00119f0 con 0x7f3cf00cddd0 2024-09-13T17:25:22.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce001f070 con 0x7f3cf00cddd0 2024-09-13T17:25:22.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0011db0 con 0x7f3cf00cddd0 2024-09-13T17:25:22.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf01e89e0 con 0x7f3cf00cddd0 2024-09-13T17:25:22.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf01e05d0 con 0x7f3cf00cddd0 2024-09-13T17:25:22.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.226+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf01e0150 con 0x7f3cf00cddd0 2024-09-13T17:25:22.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.230+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ce001a430 con 0x7f3cf00cddd0 2024-09-13T17:25:22.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.230+0000 7f3ced600700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3ccc066730 0x7f3ccc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.230+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3ce0021070 con 0x7f3cf00cddd0 2024-09-13T17:25:22.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.230+0000 7f3ce7e00700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3ccc066730 0x7f3ccc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.230+0000 7f3ce7e00700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3ccc066730 0x7f3ccc068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cf013bc10 tx=0x7f3cd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.238+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3cf01e0150 con 0x7f3cf00cddd0 2024-09-13T17:25:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.442+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3cf01e0150 con 0x7f3cf00cddd0 2024-09-13T17:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3ced600700 1 -- 172.21.15.139:0/2966304379 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3cf01e0150 con 0x7f3cf00cddd0 2024-09-13T17:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3ccc066730 msgr2=0x7f3ccc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3ccc066730 0x7f3ccc068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cf013bc10 tx=0x7f3cd8009040 comp rx=0 tx=0).stop 2024-09-13T17:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 msgr2=0x7f3cf01f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 0x7f3cf01f60f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0000c00 tx=0x7f3ce0004770 comp rx=0 tx=0).stop 2024-09-13T17:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 shutdown_connections 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f3ccc066730 0x7f3ccc068bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf015aff0 0x7f3cf0143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf0144300 0x7f3cf0142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 --2- 172.21.15.139:0/2966304379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cf00cddd0 0x7f3cf01f60f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 >> 172.21.15.139:0/2966304379 conn(0x7f3cf00ce9d0 msgr2=0x7f3cf00b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 shutdown_connections 2024-09-13T17:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.446+0000 7f3cf6200700 1 -- 172.21.15.139:0/2966304379 wait complete. 2024-09-13T17:25:22.454 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-09-13T17:25:22.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T17:25:22.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:22.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T17:25:22.513 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:25:22.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:22.514 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:25:22.575 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:22.575 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:22.594 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:22.594 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:22.652 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:25:22.652 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:22.708 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:22.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.878+0000 7eff3e800700 1 Processor -- start 2024-09-13T17:25:22.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.878+0000 7eff3e800700 1 -- start start 2024-09-13T17:25:22.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3e800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff3814a6d0 0x7eff380cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3e800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380cd890 con 0x7eff380b3280 2024-09-13T17:25:22.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3e800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3814aab0 con 0x7eff380cd450 2024-09-13T17:25:22.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3e800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff380cc3b0 con 0x7eff3814a6d0 2024-09-13T17:25:22.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3de00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7eff380b3280 0x7eff38161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53674/0 (socket says 172.21.15.139:53674) 2024-09-13T17:25:22.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3de00700 1 -- 172.21.15.139:0/1233073971 learned_addr learned my addr 172.21.15.139:0/1233073971 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:22.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3d400700 1 --2- 172.21.15.139:0/1233073971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff3814a6d0 0x7eff380cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff37e00700 1 -- 172.21.15.139:0/1233073971 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335758549 0 0) 0x7eff380cd890 con 0x7eff380b3280 2024-09-13T17:25:22.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff37e00700 1 -- 172.21.15.139:0/1233073971 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff200035d0 con 0x7eff380b3280 2024-09-13T17:25:22.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3d400700 1 -- 172.21.15.139:0/1233073971 >> v1:172.21.15.176:6789/0 conn(0x7eff380cd450 legacy=0x7eff380b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3d400700 1 -- 172.21.15.139:0/1233073971 >> v1:172.21.15.139:6789/0 conn(0x7eff380b3280 legacy=0x7eff38161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff37e00700 1 -- 172.21.15.139:0/1233073971 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321365803 0 0) 0x7eff3814aab0 con 0x7eff380cd450 2024-09-13T17:25:22.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3d400700 1 -- 172.21.15.139:0/1233073971 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380cc690 con 0x7eff3814a6d0 2024-09-13T17:25:22.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff3d400700 1 --2- 172.21.15.139:0/1233073971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff3814a6d0 0x7eff380cbd40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009880 tx=0x7eff2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5a60f37bbe69b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff37e00700 1 -- 172.21.15.139:0/1233073971 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011830 con 0x7eff3814a6d0 2024-09-13T17:25:22.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff37e00700 1 -- 172.21.15.139:0/1233073971 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c011990 con 0x7eff3814a6d0 2024-09-13T17:25:22.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.882+0000 7eff37e00700 1 -- 172.21.15.139:0/1233073971 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011d20 con 0x7eff3814a6d0 2024-09-13T17:25:22.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 -- 172.21.15.139:0/1233073971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff3814a6d0 msgr2=0x7eff380cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 --2- 172.21.15.139:0/1233073971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff3814a6d0 0x7eff380cbd40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009880 tx=0x7eff2c009b90 comp rx=0 tx=0).stop 2024-09-13T17:25:22.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 -- 172.21.15.139:0/1233073971 shutdown_connections 2024-09-13T17:25:22.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 --2- 172.21.15.139:0/1233073971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff3814a6d0 0x7eff380cbd40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 -- 172.21.15.139:0/1233073971 >> 172.21.15.139:0/1233073971 conn(0x7eff380ce9d0 msgr2=0x7eff380cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:22.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 -- 172.21.15.139:0/1233073971 shutdown_connections 2024-09-13T17:25:22.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.886+0000 7eff3e800700 1 -- 172.21.15.139:0/1233073971 wait complete. 2024-09-13T17:25:22.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 Processor -- start 2024-09-13T17:25:22.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 -- start start 2024-09-13T17:25:22.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff380b3280 0x7eff3813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff380cd450 0x7eff38163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 0x7eff3813ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3813eb20 con 0x7eff3814a6d0 2024-09-13T17:25:22.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38140980 con 0x7eff380b3280 2024-09-13T17:25:22.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3e800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3813e180 con 0x7eff380cd450 2024-09-13T17:25:22.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 0x7eff3813ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 0x7eff3813ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37310/0 (socket says 172.21.15.139:37310) 2024-09-13T17:25:22.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3d400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff380b3280 0x7eff3813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 -- 172.21.15.139:0/1366988056 learned_addr learned my addr 172.21.15.139:0/1366988056 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3ca00700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff380cd450 0x7eff38163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 -- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff380cd450 msgr2=0x7eff38163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff380cd450 0x7eff38163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 -- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff380b3280 msgr2=0x7eff3813ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff380b3280 0x7eff3813ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.890+0000 7eff3de00700 1 -- 172.21.15.139:0/1366988056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0094b0 con 0x7eff3814a6d0 2024-09-13T17:25:22.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff3de00700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 0x7eff3813ff50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7eff30002230 tx=0x7eff3000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30007480 con 0x7eff3814a6d0 2024-09-13T17:25:22.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff300075e0 con 0x7eff3814a6d0 2024-09-13T17:25:22.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3813e460 con 0x7eff3814a6d0 2024-09-13T17:25:22.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30007950 con 0x7eff3814a6d0 2024-09-13T17:25:22.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff38160bd0 con 0x7eff3814a6d0 2024-09-13T17:25:22.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3813ed90 con 0x7eff3814a6d0 2024-09-13T17:25:22.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.894+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff30012400 con 0x7eff3814a6d0 2024-09-13T17:25:22.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.898+0000 7eff35600700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7eff18066730 0x7eff18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:22.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.898+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff30083c90 con 0x7eff3814a6d0 2024-09-13T17:25:22.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.898+0000 7eff3d400700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7eff18066730 0x7eff18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:22.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.898+0000 7eff3d400700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7eff18066730 0x7eff18068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0090b0 tx=0x7eff2c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:22.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:22.902+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff30050d80 con 0x7eff3814a6d0 2024-09-13T17:25:23.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.094+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff38071e90 con 0x7eff3814a6d0 2024-09-13T17:25:23.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.098+0000 7eff35600700 1 -- 172.21.15.139:0/1366988056 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7eff30017020 con 0x7eff3814a6d0 2024-09-13T17:25:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:23.105 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:23.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7eff18066730 msgr2=0x7eff18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7eff18066730 0x7eff18068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0090b0 tx=0x7eff2c01c040 comp rx=0 tx=0).stop 2024-09-13T17:25:23.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 msgr2=0x7eff3813ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 0x7eff3813ff50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7eff30002230 tx=0x7eff3000cae0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 shutdown_connections 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7eff18066730 0x7eff18068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff3814a6d0 0x7eff3813ff50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff380cd450 0x7eff38163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 --2- 172.21.15.139:0/1366988056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff380b3280 0x7eff3813ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 >> 172.21.15.139:0/1366988056 conn(0x7eff380ce9d0 msgr2=0x7eff380cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 shutdown_connections 2024-09-13T17:25:23.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.102+0000 7eff3e800700 1 -- 172.21.15.139:0/1366988056 wait complete. 2024-09-13T17:25:23.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:23.129 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:23.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.290+0000 7f6f3e800700 1 Processor -- start 2024-09-13T17:25:23.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.290+0000 7f6f3e800700 1 -- start start 2024-09-13T17:25:23.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3e800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 0x7f6f3806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3e800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f3815aff0 0x7f6f380cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3e800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38070140 con 0x7f6f3806db60 2024-09-13T17:25:23.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3e800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f38070420 con 0x7f6f3815aff0 2024-09-13T17:25:23.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3e800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38070700 con 0x7f6f38144300 2024-09-13T17:25:23.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 0x7f6f3806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 0x7f6f3806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:59476/0 (socket says 172.21.15.139:59476) 2024-09-13T17:25:23.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3de00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6f3806db60 0x7f6f380b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:51002/0 (socket says 172.21.15.139:51002) 2024-09-13T17:25:23.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3ca00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f3815aff0 0x7f6f380cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 -- 172.21.15.139:0/1961093169 learned_addr learned my addr 172.21.15.139:0/1961093169 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:23.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 -- 172.21.15.139:0/1961093169 >> v2:172.21.15.176:3300/0 conn(0x7f6f3815aff0 msgr2=0x7f6f380cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:23.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 --2- 172.21.15.139:0/1961093169 >> v2:172.21.15.176:3300/0 conn(0x7f6f3815aff0 0x7f6f380cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 -- 172.21.15.139:0/1961093169 >> v1:172.21.15.176:6789/0 conn(0x7f6f3806db60 legacy=0x7f6f380b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 -- 172.21.15.139:0/1961093169 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380709e0 con 0x7f6f38144300 2024-09-13T17:25:23.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3ca00700 1 --2- 172.21.15.139:0/1961093169 >> v2:172.21.15.176:3300/0 conn(0x7f6f3815aff0 0x7f6f380cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:23.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f37e00700 1 -- 172.21.15.139:0/1961093169 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805022868 0 0) 0x7f6f38070140 con 0x7f6f3806db60 2024-09-13T17:25:23.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.294+0000 7f6f3d400700 1 --2- 172.21.15.139:0/1961093169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 0x7f6f3806d620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009910 tx=0x7f6f2c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5830fa7a0e563653 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:23.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f37e00700 1 -- 172.21.15.139:0/1961093169 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011830 con 0x7f6f38144300 2024-09-13T17:25:23.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f37e00700 1 -- 172.21.15.139:0/1961093169 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c011990 con 0x7f6f38144300 2024-09-13T17:25:23.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f37e00700 1 -- 172.21.15.139:0/1961093169 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011d40 con 0x7f6f38144300 2024-09-13T17:25:23.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 -- 172.21.15.139:0/1961093169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 msgr2=0x7f6f3806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 --2- 172.21.15.139:0/1961093169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 0x7f6f3806d620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009910 tx=0x7f6f2c009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:23.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 -- 172.21.15.139:0/1961093169 shutdown_connections 2024-09-13T17:25:23.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 --2- 172.21.15.139:0/1961093169 >> v2:172.21.15.176:3300/0 conn(0x7f6f3815aff0 0x7f6f380cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 --2- 172.21.15.139:0/1961093169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38144300 0x7f6f3806d620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 -- 172.21.15.139:0/1961093169 >> 172.21.15.139:0/1961093169 conn(0x7f6f380ce9d0 msgr2=0x7f6f380cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:23.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 -- 172.21.15.139:0/1961093169 shutdown_connections 2024-09-13T17:25:23.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.298+0000 7f6f3e800700 1 -- 172.21.15.139:0/1961093169 wait complete. 2024-09-13T17:25:23.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 Processor -- start 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 -- start start 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f3806db60 0x7f6f3813e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38144300 0x7f6f381ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 0x7f6f3813c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38157790 con 0x7f6f3815aff0 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3813d220 con 0x7f6f38144300 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3e800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3813d500 con 0x7f6f3806db60 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 0x7f6f3813c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 0x7f6f3813c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37326/0 (socket says 172.21.15.139:37326) 2024-09-13T17:25:23.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 -- 172.21.15.139:0/511636341 learned_addr learned my addr 172.21.15.139:0/511636341 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3d400700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f3806db60 0x7f6f3813e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3ca00700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38144300 0x7f6f381ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 -- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f3806db60 msgr2=0x7f6f3813e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f3806db60 0x7f6f3813e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 -- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38144300 msgr2=0x7f6f381ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38144300 0x7f6f381ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.302+0000 7f6f3de00700 1 -- 172.21.15.139:0/511636341 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240094b0 con 0x7f6f3815aff0 2024-09-13T17:25:23.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f3de00700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 0x7f6f3813c8b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f30002230 tx=0x7f6f3000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:23.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000aac0 con 0x7f6f3815aff0 2024-09-13T17:25:23.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3000ac40 con 0x7f6f3815aff0 2024-09-13T17:25:23.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300070d0 con 0x7f6f3815aff0 2024-09-13T17:25:23.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c009570 con 0x7f6f3815aff0 2024-09-13T17:25:23.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f38157420 con 0x7f6f3815aff0 2024-09-13T17:25:23.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.306+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f38157900 con 0x7f6f3815aff0 2024-09-13T17:25:23.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.310+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f30007250 con 0x7f6f3815aff0 2024-09-13T17:25:23.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.310+0000 7f6f35600700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6f18066730 0x7f6f18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.310+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f30083fe0 con 0x7f6f3815aff0 2024-09-13T17:25:23.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.310+0000 7f6f3d400700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6f18066730 0x7f6f18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.310+0000 7f6f3d400700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6f18066730 0x7f6f18068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000c00 tx=0x7f6f2c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:23.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.318+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f30050f30 con 0x7f6f3815aff0 2024-09-13T17:25:23.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.498+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f3806d620 con 0x7f6f3815aff0 2024-09-13T17:25:23.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.498+0000 7f6f35600700 1 -- 172.21.15.139:0/511636341 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f30018020 con 0x7f6f3815aff0 2024-09-13T17:25:23.502 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6f18066730 msgr2=0x7f6f18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6f18066730 0x7f6f18068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000c00 tx=0x7f6f2c008030 comp rx=0 tx=0).stop 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 msgr2=0x7f6f3813c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 0x7f6f3813c8b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f30002230 tx=0x7f6f3000cf50 comp rx=0 tx=0).stop 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 shutdown_connections 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f6f18066730 0x7f6f18068bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3815aff0 0x7f6f3813c8b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38144300 0x7f6f381ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 --2- 172.21.15.139:0/511636341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f3806db60 0x7f6f3813e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 >> 172.21.15.139:0/511636341 conn(0x7f6f380ce9d0 msgr2=0x7f6f38141830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:23.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 shutdown_connections 2024-09-13T17:25:23.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.502+0000 7f6f3e800700 1 -- 172.21.15.139:0/511636341 wait complete. 2024-09-13T17:25:23.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:23.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.702+0000 7f368b200700 1 Processor -- start 2024-09-13T17:25:23.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.702+0000 7f368b200700 1 -- start start 2024-09-13T17:25:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368b200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f368c0b4310 0x7f368c06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368b200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f368c071c80 0x7f368c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368b200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c071560 con 0x7f368c15cc10 2024-09-13T17:25:23.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368b200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c15cff0 con 0x7f368c071c80 2024-09-13T17:25:23.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368b200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c070950 con 0x7f368c0b4310 2024-09-13T17:25:23.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f368c071c80 0x7f368c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f368c071c80 0x7f368c06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37342/0 (socket says 172.21.15.139:37342) 2024-09-13T17:25:23.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 -- 172.21.15.139:0/22111587 learned_addr learned my addr 172.21.15.139:0/22111587 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:23.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f3689400700 1 --2- 172.21.15.139:0/22111587 >> v2:172.21.15.176:3300/0 conn(0x7f368c0b4310 0x7f368c06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 -- 172.21.15.139:0/22111587 >> v2:172.21.15.176:3300/0 conn(0x7f368c0b4310 msgr2=0x7f368c06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:23.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 --2- 172.21.15.139:0/22111587 >> v2:172.21.15.176:3300/0 conn(0x7f368c0b4310 0x7f368c06bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 -- 172.21.15.139:0/22111587 >> v1:172.21.15.176:6789/0 conn(0x7f368c15cc10 legacy=0x7f368c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 -- 172.21.15.139:0/22111587 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c070c30 con 0x7f368c071c80 2024-09-13T17:25:23.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f368a800700 1 --2- 172.21.15.139:0/22111587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c071c80 0x7f368c06c160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f368c0af020 tx=0x7f368400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d290f6110e1ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:23.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f3688a00700 1 -- 172.21.15.139:0/22111587 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400e070 con 0x7f368c071c80 2024-09-13T17:25:23.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f3688a00700 1 -- 172.21.15.139:0/22111587 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400b910 con 0x7f368c071c80 2024-09-13T17:25:23.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.706+0000 7f3688a00700 1 -- 172.21.15.139:0/22111587 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400bcc0 con 0x7f368c071c80 2024-09-13T17:25:23.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 -- 172.21.15.139:0/22111587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c071c80 msgr2=0x7f368c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 --2- 172.21.15.139:0/22111587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c071c80 0x7f368c06c160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f368c0af020 tx=0x7f368400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:23.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 -- 172.21.15.139:0/22111587 shutdown_connections 2024-09-13T17:25:23.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 --2- 172.21.15.139:0/22111587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c071c80 0x7f368c06c160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 --2- 172.21.15.139:0/22111587 >> v2:172.21.15.176:3300/0 conn(0x7f368c0b4310 0x7f368c06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 -- 172.21.15.139:0/22111587 >> 172.21.15.139:0/22111587 conn(0x7f368c06ece0 msgr2=0x7f368c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:23.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 -- 172.21.15.139:0/22111587 shutdown_connections 2024-09-13T17:25:23.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 -- 172.21.15.139:0/22111587 wait complete. 2024-09-13T17:25:23.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 Processor -- start 2024-09-13T17:25:23.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.710+0000 7f368b200700 1 -- start start 2024-09-13T17:25:23.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c071c80 0x7f368c144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b4310 0x7f368c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 0x7f368c1f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0cc3b0 con 0x7f368c15cc10 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c160320 con 0x7f368c071c80 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0cbdc0 con 0x7f368c0b4310 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 0x7f368c1f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 0x7f368c1f2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37344/0 (socket says 172.21.15.139:37344) 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 -- 172.21.15.139:0/2712970407 learned_addr learned my addr 172.21.15.139:0/2712970407 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f3689400700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b4310 0x7f368c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f3689e00700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c071c80 0x7f368c144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 -- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b4310 msgr2=0x7f368c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b4310 0x7f368c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 -- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c071c80 msgr2=0x7f368c144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c071c80 0x7f368c144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 -- 172.21.15.139:0/2712970407 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684009b30 con 0x7f368c15cc10 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368a800700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 0x7f368c1f2650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f368400b370 tx=0x7f3684004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684004900 con 0x7f368c15cc10 2024-09-13T17:25:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840099b0 con 0x7f368c15cc10 2024-09-13T17:25:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368401c680 con 0x7f368c15cc10 2024-09-13T17:25:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c1f3190 con 0x7f368c15cc10 2024-09-13T17:25:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.714+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c0cbfd0 con 0x7f368c15cc10 2024-09-13T17:25:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.718+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c1f3650 con 0x7f368c15cc10 2024-09-13T17:25:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.718+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f368401c7e0 con 0x7f368c15cc10 2024-09-13T17:25:23.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.718+0000 7f3682000700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f366c066730 0x7f366c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:23.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.718+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36840860e0 con 0x7f368c15cc10 2024-09-13T17:25:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.722+0000 7f3689e00700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f366c066730 0x7f366c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.722+0000 7f3689e00700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f366c066730 0x7f366c068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f368c15ab90 tx=0x7f367c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.726+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36840530a0 con 0x7f368c15cc10 2024-09-13T17:25:23.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.906+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f368c15a8e0 con 0x7f368c15cc10 2024-09-13T17:25:23.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.906+0000 7f3682000700 1 -- 172.21.15.139:0/2712970407 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36840566c0 con 0x7f368c15cc10 2024-09-13T17:25:23.911 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f366c066730 msgr2=0x7f366c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f366c066730 0x7f366c068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f368c15ab90 tx=0x7f367c009040 comp rx=0 tx=0).stop 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 msgr2=0x7f368c1f2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 0x7f368c1f2650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f368400b370 tx=0x7f3684004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 shutdown_connections 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f366c066730 0x7f366c068bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f368c15cc10 0x7f368c1f2650 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b4310 0x7f368c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 --2- 172.21.15.139:0/2712970407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c071c80 0x7f368c144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:23.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 >> 172.21.15.139:0/2712970407 conn(0x7f368c06ece0 msgr2=0x7f368c159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:23.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 shutdown_connections 2024-09-13T17:25:23.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:23.910+0000 7f368b200700 1 -- 172.21.15.139:0/2712970407 wait complete. 2024-09-13T17:25:23.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:24.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.094+0000 7f137e600700 1 Processor -- start 2024-09-13T17:25:24.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.094+0000 7f137e600700 1 -- start start 2024-09-13T17:25:24.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.094+0000 7f137e600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f13780ae330 0x7f13780ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f137e600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780acdd0 con 0x7f1378146770 2024-09-13T17:25:24.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f137e600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1378071190 con 0x7f137806d9e0 2024-09-13T17:25:24.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f137e600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780ad8a0 con 0x7f13780ae330 2024-09-13T17:25:24.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1378146770 0x7f13780b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53688/0 (socket says 172.21.15.139:53688) 2024-09-13T17:25:24.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377400700 1 -- 172.21.15.139:0/2747738331 learned_addr learned my addr 172.21.15.139:0/2747738331 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:24.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377e00700 1 --2- 172.21.15.139:0/2747738331 >> v2:172.21.15.176:3300/0 conn(0x7f13780ae330 0x7f13780ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207830281 0 0) 0x7f13780acdd0 con 0x7f1378146770 2024-09-13T17:25:24.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f135c0035d0 con 0x7f1378146770 2024-09-13T17:25:24.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588310403 0 0) 0x7f1378071190 con 0x7f137806d9e0 2024-09-13T17:25:24.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13780acdd0 con 0x7f137806d9e0 2024-09-13T17:25:24.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377e00700 1 -- 172.21.15.139:0/2747738331 >> v1:172.21.15.176:6789/0 conn(0x7f137806d9e0 legacy=0x7f13780adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425846627 0 0) 0x7f135c0035d0 con 0x7f1378146770 2024-09-13T17:25:24.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377e00700 1 -- 172.21.15.139:0/2747738331 >> v1:172.21.15.139:6789/0 conn(0x7f1378146770 legacy=0x7f13780b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377e00700 1 -- 172.21.15.139:0/2747738331 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780ad000 con 0x7f13780ae330 2024-09-13T17:25:24.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1377e00700 1 --2- 172.21.15.139:0/2747738331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13780ae330 0x7f13780ac890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1370009d90 tx=0x7f137000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77e09c289702321 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000e070 con 0x7f13780ae330 2024-09-13T17:25:24.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370003a40 con 0x7f13780ae330 2024-09-13T17:25:24.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.098+0000 7f1376000700 1 -- 172.21.15.139:0/2747738331 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368001670 con 0x7f13780ae330 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 -- 172.21.15.139:0/2747738331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13780ae330 msgr2=0x7f13780ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 --2- 172.21.15.139:0/2747738331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13780ae330 0x7f13780ac890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1370009d90 tx=0x7f137000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 -- 172.21.15.139:0/2747738331 shutdown_connections 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 --2- 172.21.15.139:0/2747738331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13780ae330 0x7f13780ac890 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 -- 172.21.15.139:0/2747738331 >> 172.21.15.139:0/2747738331 conn(0x7f137806b1e0 msgr2=0x7f137806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 -- 172.21.15.139:0/2747738331 shutdown_connections 2024-09-13T17:25:24.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.102+0000 7f137e600700 1 -- 172.21.15.139:0/2747738331 wait complete. 2024-09-13T17:25:24.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 Processor -- start 2024-09-13T17:25:24.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 -- start start 2024-09-13T17:25:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f137806d9e0 0x7f1378138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780ae330 0x7f1378146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1378146770 0x7f137815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137813b290 con 0x7f137806d9e0 2024-09-13T17:25:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c5fa0 con 0x7f1378146770 2024-09-13T17:25:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f137e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c6280 con 0x7f13780ae330 2024-09-13T17:25:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f137806d9e0 0x7f1378138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f137806d9e0 0x7f1378138310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37354/0 (socket says 172.21.15.139:37354) 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377400700 1 -- 172.21.15.139:0/1269676755 learned_addr learned my addr 172.21.15.139:0/1269676755 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377e00700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1378146770 0x7f137815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1376a00700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780ae330 0x7f1378146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377e00700 1 -- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780ae330 msgr2=0x7f1378146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377e00700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780ae330 0x7f1378146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377e00700 1 -- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f137806d9e0 msgr2=0x7f1378138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377e00700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f137806d9e0 0x7f1378138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.106+0000 7f1377e00700 1 -- 172.21.15.139:0/1269676755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370009a70 con 0x7f1378146770 2024-09-13T17:25:24.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f1377e00700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1378146770 0x7f137815c050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1370014000 tx=0x7f1370004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370004540 con 0x7f1378146770 2024-09-13T17:25:24.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13780c6560 con 0x7f1378146770 2024-09-13T17:25:24.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700046c0 con 0x7f1378146770 2024-09-13T17:25:24.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370012430 con 0x7f1378146770 2024-09-13T17:25:24.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378147300 con 0x7f1378146770 2024-09-13T17:25:24.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.110+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13780c6a80 con 0x7f1378146770 2024-09-13T17:25:24.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.114+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1370012590 con 0x7f1378146770 2024-09-13T17:25:24.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.114+0000 7f136f400700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1358066730 0x7f1358068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.114+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1370085980 con 0x7f1378146770 2024-09-13T17:25:24.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.114+0000 7f1377400700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1358066730 0x7f1358068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.114+0000 7f1377400700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1358066730 0x7f1358068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1368001ab0 tx=0x7f1368001a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.122+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f13700564d0 con 0x7f1378146770 2024-09-13T17:25:24.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.302+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13780c60e0 con 0x7f1378146770 2024-09-13T17:25:24.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.302+0000 7f136f400700 1 -- 172.21.15.139:0/1269676755 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1370016020 con 0x7f1378146770 2024-09-13T17:25:24.308 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:24.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1358066730 msgr2=0x7f1358068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1358066730 0x7f1358068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1368001ab0 tx=0x7f1368001a40 comp rx=0 tx=0).stop 2024-09-13T17:25:24.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1378146770 msgr2=0x7f137815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1378146770 0x7f137815c050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1370014000 tx=0x7f1370004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 shutdown_connections 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1358066730 0x7f1358068bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1378146770 0x7f137815c050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13780ae330 0x7f1378146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 --2- 172.21.15.139:0/1269676755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f137806d9e0 0x7f1378138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 >> 172.21.15.139:0/1269676755 conn(0x7f137806b1e0 msgr2=0x7f13780b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 shutdown_connections 2024-09-13T17:25:24.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.306+0000 7f137e600700 1 -- 172.21.15.139:0/1269676755 wait complete. 2024-09-13T17:25:24.337 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:24.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.494+0000 7fcc0d800700 1 Processor -- start 2024-09-13T17:25:24.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.494+0000 7fcc0d800700 1 -- start start 2024-09-13T17:25:24.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc0d800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 0x7fcc080b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc0d800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcc080721e0 0x7fcc08070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc0d800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcc080712c0 0x7fcc0806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc0d800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc08159fb0 con 0x7fcc080712c0 2024-09-13T17:25:24.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc0d800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc080705c0 con 0x7fcc080721e0 2024-09-13T17:25:24.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc0d800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080cb920 con 0x7fcc08159bd0 2024-09-13T17:25:24.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc07400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcc080712c0 0x7fcc0806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 0x7fcc080b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 0x7fcc080b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:59512/0 (socket says 172.21.15.139:59512) 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 -- 172.21.15.139:0/2698854787 learned_addr learned my addr 172.21.15.139:0/2698854787 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcbfe000700 1 --2- 172.21.15.139:0/2698854787 >> v2:172.21.15.176:3300/0 conn(0x7fcc080721e0 0x7fcc08070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 -- 172.21.15.139:0/2698854787 >> v2:172.21.15.176:3300/0 conn(0x7fcc080721e0 msgr2=0x7fcc08070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 --2- 172.21.15.139:0/2698854787 >> v2:172.21.15.176:3300/0 conn(0x7fcc080721e0 0x7fcc08070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 -- 172.21.15.139:0/2698854787 >> v2:172.21.15.139:3300/0 conn(0x7fcc080712c0 msgr2=0x7fcc0806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:24.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 --2- 172.21.15.139:0/2698854787 >> v2:172.21.15.139:3300/0 conn(0x7fcc080712c0 0x7fcc0806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 -- 172.21.15.139:0/2698854787 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080cbc00 con 0x7fcc08159bd0 2024-09-13T17:25:24.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06a00700 1 --2- 172.21.15.139:0/2698854787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 0x7fcc080b39e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcc080739a0 tx=0x7fcbf8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9afa1942473abf3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06000700 1 -- 172.21.15.139:0/2698854787 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8011830 con 0x7fcc08159bd0 2024-09-13T17:25:24.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06000700 1 -- 172.21.15.139:0/2698854787 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8011990 con 0x7fcc08159bd0 2024-09-13T17:25:24.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.498+0000 7fcc06000700 1 -- 172.21.15.139:0/2698854787 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8011d20 con 0x7fcc08159bd0 2024-09-13T17:25:24.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 -- 172.21.15.139:0/2698854787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 msgr2=0x7fcc080b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2698854787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 0x7fcc080b39e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcc080739a0 tx=0x7fcbf8009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 -- 172.21.15.139:0/2698854787 shutdown_connections 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2698854787 >> v2:172.21.15.139:3300/0 conn(0x7fcc080712c0 0x7fcc0806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2698854787 >> v2:172.21.15.176:3300/0 conn(0x7fcc080721e0 0x7fcc08070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2698854787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc08159bd0 0x7fcc080b39e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 -- 172.21.15.139:0/2698854787 >> 172.21.15.139:0/2698854787 conn(0x7fcc0806b1e0 msgr2=0x7fcc0806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 -- 172.21.15.139:0/2698854787 shutdown_connections 2024-09-13T17:25:24.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.502+0000 7fcc0d800700 1 -- 172.21.15.139:0/2698854787 wait complete. 2024-09-13T17:25:24.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 Processor -- start 2024-09-13T17:25:24.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 -- start start 2024-09-13T17:25:24.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc080712c0 0x7fcc08158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 0x7fcc0815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc08159bd0 0x7fcc08149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc081451d0 con 0x7fcc080721e0 2024-09-13T17:25:24.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08159250 con 0x7fcc08159bd0 2024-09-13T17:25:24.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08145980 con 0x7fcc080712c0 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 0x7fcc0815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 0x7fcc0815a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37362/0 (socket says 172.21.15.139:37362) 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 -- 172.21.15.139:0/2910078374 learned_addr learned my addr 172.21.15.139:0/2910078374 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc06a00700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc080712c0 0x7fcc08158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc07400700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc08159bd0 0x7fcc08149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 -- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc080712c0 msgr2=0x7fcc08158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc080712c0 0x7fcc08158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 -- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc08159bd0 msgr2=0x7fcc08149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc08159bd0 0x7fcc08149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 -- 172.21.15.139:0/2910078374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009570 con 0x7fcc080721e0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc07400700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc08159bd0 0x7fcc08149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbfe000700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 0x7fcc0815a0f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000e760 tx=0x7fcbf000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0013610 con 0x7fcc080721e0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0013770 con 0x7fcc080721e0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0013ae0 con 0x7fcc080721e0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.506+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc08145c60 con 0x7fcc080721e0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.510+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc08149230 con 0x7fcc080721e0 2024-09-13T17:25:24.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.510+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc08070d80 con 0x7fcc080721e0 2024-09-13T17:25:24.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.510+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbf0013c40 con 0x7fcc080721e0 2024-09-13T17:25:24.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.514+0000 7fcbff400700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcbe4066730 0x7fcbe4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.514+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcbf0084170 con 0x7fcc080721e0 2024-09-13T17:25:24.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.514+0000 7fcc06a00700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcbe4066730 0x7fcbe4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.514+0000 7fcc06a00700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcbe4066730 0x7fcbe4068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8014040 tx=0x7fcbf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.522+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbf0051120 con 0x7fcc080721e0 2024-09-13T17:25:24.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.710+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcc0815d410 con 0x7fcc080721e0 2024-09-13T17:25:24.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcbff400700 1 -- 172.21.15.139:0/2910078374 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcbf0054740 con 0x7fcc080721e0 2024-09-13T17:25:24.718 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:24.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcbe4066730 msgr2=0x7fcbe4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcbe4066730 0x7fcbe4068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8014040 tx=0x7fcbf8008030 comp rx=0 tx=0).stop 2024-09-13T17:25:24.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 msgr2=0x7fcc0815a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 0x7fcc0815a0f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000e760 tx=0x7fcbf000ea70 comp rx=0 tx=0).stop 2024-09-13T17:25:24.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 shutdown_connections 2024-09-13T17:25:24.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fcbe4066730 0x7fcbe4068bf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc08159bd0 0x7fcc08149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc080721e0 0x7fcc0815a0f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 --2- 172.21.15.139:0/2910078374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc080712c0 0x7fcc08158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.714+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 >> 172.21.15.139:0/2910078374 conn(0x7fcc0806b1e0 msgr2=0x7fcc0806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:24.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.718+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 shutdown_connections 2024-09-13T17:25:24.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.718+0000 7fcc0d800700 1 -- 172.21.15.139:0/2910078374 wait complete. 2024-09-13T17:25:24.741 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:25:24.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.906+0000 7f15df200700 1 Processor -- start 2024-09-13T17:25:24.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.906+0000 7f15df200700 1 -- start start 2024-09-13T17:25:24.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15df200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f15e015cdb0 0x7f15e00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15df200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f15e00cde80 0x7f15e006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15df200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e015d190 con 0x7f15e006a8d0 2024-09-13T17:25:24.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15df200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e006acf0 con 0x7f15e015cdb0 2024-09-13T17:25:24.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15df200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e00ce4b0 con 0x7f15e00cde80 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f15e015cdb0 0x7f15e00cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f15e015cdb0 0x7f15e00cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57414/0 (socket says 172.21.15.139:57414) 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 -- 172.21.15.139:0/2226037236 learned_addr learned my addr 172.21.15.139:0/2226037236 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 -- 172.21.15.139:0/2226037236 >> v2:172.21.15.176:3300/0 conn(0x7f15e00cde80 msgr2=0x7f15e006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 --2- 172.21.15.139:0/2226037236 >> v2:172.21.15.176:3300/0 conn(0x7f15e00cde80 0x7f15e006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 -- 172.21.15.139:0/2226037236 >> v1:172.21.15.176:6789/0 conn(0x7f15e006a8d0 legacy=0x7f15e00d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:24.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 -- 172.21.15.139:0/2226037236 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00ce790 con 0x7f15e015cdb0 2024-09-13T17:25:24.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dde00700 1 --2- 172.21.15.139:0/2226037236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e00cd940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15e006c810 tx=0x7f15d0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75b0223726a8836 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.910+0000 7f15dca00700 1 -- 172.21.15.139:0/2226037236 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0004230 con 0x7f15e015cdb0 2024-09-13T17:25:24.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15dca00700 1 -- 172.21.15.139:0/2226037236 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d0004390 con 0x7f15e015cdb0 2024-09-13T17:25:24.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15dca00700 1 -- 172.21.15.139:0/2226037236 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d00036c0 con 0x7f15e015cdb0 2024-09-13T17:25:24.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 -- 172.21.15.139:0/2226037236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 msgr2=0x7f15e00cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 --2- 172.21.15.139:0/2226037236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e00cd940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15e006c810 tx=0x7f15d0009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 -- 172.21.15.139:0/2226037236 shutdown_connections 2024-09-13T17:25:24.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 --2- 172.21.15.139:0/2226037236 >> v2:172.21.15.176:3300/0 conn(0x7f15e00cde80 0x7f15e006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 --2- 172.21.15.139:0/2226037236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e00cd940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 -- 172.21.15.139:0/2226037236 >> 172.21.15.139:0/2226037236 conn(0x7f15e00d2d70 msgr2=0x7f15e00d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:24.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 -- 172.21.15.139:0/2226037236 shutdown_connections 2024-09-13T17:25:24.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.914+0000 7f15df200700 1 -- 172.21.15.139:0/2226037236 wait complete. 2024-09-13T17:25:24.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 Processor -- start 2024-09-13T17:25:24.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 -- start start 2024-09-13T17:25:24.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15e006a8d0 0x7f15e015f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15e00cde80 0x7f15e00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e014f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e0150740 con 0x7f15e015cdb0 2024-09-13T17:25:24.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00ca500 con 0x7f15e006a8d0 2024-09-13T17:25:24.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15df200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00ca7e0 con 0x7f15e00cde80 2024-09-13T17:25:24.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e014f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e014f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57424/0 (socket says 172.21.15.139:57424) 2024-09-13T17:25:24.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 -- 172.21.15.139:0/1415417763 learned_addr learned my addr 172.21.15.139:0/1415417763 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:24.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15dde00700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15e006a8d0 0x7f15e015f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15dd400700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15e00cde80 0x7f15e00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 -- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15e00cde80 msgr2=0x7f15e00c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15e00cde80 0x7f15e00c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 -- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15e006a8d0 msgr2=0x7f15e015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:24.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15e006a8d0 0x7f15e015f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:24.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15de800700 1 -- 172.21.15.139:0/1415417763 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009570 con 0x7f15e015cdb0 2024-09-13T17:25:24.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.918+0000 7f15dd400700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15e00cde80 0x7f15e00c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:24.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15de800700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e014f580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b990 tx=0x7f15d800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800d890 con 0x7f15e015cdb0 2024-09-13T17:25:24.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d800d9f0 con 0x7f15e015cdb0 2024-09-13T17:25:24.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e00caac0 con 0x7f15e015cdb0 2024-09-13T17:25:24.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800dda0 con 0x7f15e015cdb0 2024-09-13T17:25:24.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e00cb080 con 0x7f15e015cdb0 2024-09-13T17:25:24.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e00677e0 con 0x7f15e015cdb0 2024-09-13T17:25:24.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.922+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15d800e460 con 0x7f15e015cdb0 2024-09-13T17:25:24.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.926+0000 7f15d6000700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f15c0066730 0x7f15c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:24.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.926+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15d80846a0 con 0x7f15e015cdb0 2024-09-13T17:25:24.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.926+0000 7f15dde00700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f15c0066730 0x7f15c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:24.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.926+0000 7f15dde00700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f15c0066730 0x7f15c0068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15e006c810 tx=0x7f15d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:24.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:24.934+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15d8051700 con 0x7f15e015cdb0 2024-09-13T17:25:25.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.126+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15e00cb2a0 con 0x7f15e015cdb0 2024-09-13T17:25:25.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.126+0000 7f15d6000700 1 -- 172.21.15.139:0/1415417763 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f15d8054d20 con 0x7f15e015cdb0 2024-09-13T17:25:25.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.126+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f15c0066730 msgr2=0x7f15c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.126+0000 7f15df200700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f15c0066730 0x7f15c0068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15e006c810 tx=0x7f15d0008030 comp rx=0 tx=0).stop 2024-09-13T17:25:25.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.126+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 msgr2=0x7f15e014f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.126+0000 7f15df200700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e014f580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b990 tx=0x7f15d800bca0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 shutdown_connections 2024-09-13T17:25:25.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f15c0066730 0x7f15c0068bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15e015cdb0 0x7f15e014f580 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15e00cde80 0x7f15e00c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 --2- 172.21.15.139:0/1415417763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15e006a8d0 0x7f15e015f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 >> 172.21.15.139:0/1415417763 conn(0x7f15e00d2d70 msgr2=0x7f15e006aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:25.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 shutdown_connections 2024-09-13T17:25:25.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.130+0000 7f15df200700 1 -- 172.21.15.139:0/1415417763 wait complete. 2024-09-13T17:25:25.136 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-09-13T17:25:25.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T17:25:25.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:25.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T17:25:25.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:25:25.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:25.198 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:25:25.260 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:25:25.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:25:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.434+0000 7f55f5e00700 1 Processor -- start 2024-09-13T17:25:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.434+0000 7f55f5e00700 1 -- start start 2024-09-13T17:25:25.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55f5e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f0146690 0x7f55f00d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55f5e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f00b1740 con 0x7f55f015e030 2024-09-13T17:25:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55f5e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f015e490 con 0x7f55f00d1740 2024-09-13T17:25:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55f5e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00d08c0 con 0x7f55f0146690 2024-09-13T17:25:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55e7e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f55f015e030 0x7f55f00d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38138/0 (socket says 172.21.15.139:38138) 2024-09-13T17:25:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55e7e00700 1 -- 172.21.15.139:0/1791323055 learned_addr learned my addr 172.21.15.139:0/1791323055 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:25.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55f4a00700 1 --2- 172.21.15.139:0/1791323055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f0146690 0x7f55f00d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170859624 0 0) 0x7f55f00b1740 con 0x7f55f015e030 2024-09-13T17:25:25.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d40035d0 con 0x7f55f015e030 2024-09-13T17:25:25.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.438+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521209109 0 0) 0x7f55f015e490 con 0x7f55f00d1740 2024-09-13T17:25:25.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f00b1740 con 0x7f55f00d1740 2024-09-13T17:25:25.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788664949 0 0) 0x7f55d40035d0 con 0x7f55f015e030 2024-09-13T17:25:25.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f4a00700 1 -- 172.21.15.139:0/1791323055 >> v1:172.21.15.176:6789/0 conn(0x7f55f00d1740 legacy=0x7f55f00b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f4a00700 1 -- 172.21.15.139:0/1791323055 >> v1:172.21.15.139:6789/0 conn(0x7f55f015e030 legacy=0x7f55f00d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f4a00700 1 -- 172.21.15.139:0/1791323055 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00b1990 con 0x7f55f0146690 2024-09-13T17:25:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f4a00700 1 --2- 172.21.15.139:0/1791323055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f0146690 0x7f55f00d0380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009dc0 tx=0x7f55e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a58fb2d4640ee44b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000e070 con 0x7f55f0146690 2024-09-13T17:25:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e0003a40 con 0x7f55f0146690 2024-09-13T17:25:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55efe00700 1 -- 172.21.15.139:0/1791323055 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8001670 con 0x7f55f0146690 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 -- 172.21.15.139:0/1791323055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f0146690 msgr2=0x7f55f00d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 --2- 172.21.15.139:0/1791323055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f0146690 0x7f55f00d0380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009dc0 tx=0x7f55e000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 -- 172.21.15.139:0/1791323055 shutdown_connections 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 --2- 172.21.15.139:0/1791323055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f0146690 0x7f55f00d0380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 -- 172.21.15.139:0/1791323055 >> 172.21.15.139:0/1791323055 conn(0x7f55f0071fa0 msgr2=0x7f55f0072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 -- 172.21.15.139:0/1791323055 shutdown_connections 2024-09-13T17:25:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.442+0000 7f55f5e00700 1 -- 172.21.15.139:0/1791323055 wait complete. 2024-09-13T17:25:25.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 Processor -- start 2024-09-13T17:25:25.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 -- start start 2024-09-13T17:25:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00d1740 0x7f55f0135130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 0x7f55f00aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015e030 0x7f55f00ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00cc030 con 0x7f55f0146690 2024-09-13T17:25:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00a8480 con 0x7f55f015e030 2024-09-13T17:25:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00cbd50 con 0x7f55f00d1740 2024-09-13T17:25:25.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 0x7f55f00aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 0x7f55f00aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57432/0 (socket says 172.21.15.139:57432) 2024-09-13T17:25:25.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 -- 172.21.15.139:0/3145285415 learned_addr learned my addr 172.21.15.139:0/3145285415 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:25.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f5400700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015e030 0x7f55f00ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55f4a00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00d1740 0x7f55f0135130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 -- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00d1740 msgr2=0x7f55f0135130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00d1740 0x7f55f0135130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 -- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015e030 msgr2=0x7f55f00ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015e030 0x7f55f00ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 -- 172.21.15.139:0/3145285415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0009a70 con 0x7f55f0146690 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.446+0000 7f55e7e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 0x7f55f00aab80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c700 tx=0x7f55d800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8004ca0 con 0x7f55f0146690 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8004e00 con 0x7f55f0146690 2024-09-13T17:25:25.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0135a10 con 0x7f55f0146690 2024-09-13T17:25:25.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8007310 con 0x7f55f0146690 2024-09-13T17:25:25.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f0135fd0 con 0x7f55f0146690 2024-09-13T17:25:25.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00677e0 con 0x7f55f0146690 2024-09-13T17:25:25.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.450+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55d8007470 con 0x7f55f0146690 2024-09-13T17:25:25.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.454+0000 7f55ed600700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55cc066730 0x7f55cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.454+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f55d8084220 con 0x7f55f0146690 2024-09-13T17:25:25.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.454+0000 7f55f4a00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55cc066730 0x7f55cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.454+0000 7f55f4a00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55cc066730 0x7f55cc068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009dc0 tx=0x7f55e0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:25.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.458+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55d8051130 con 0x7f55f0146690 2024-09-13T17:25:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.674+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55f0135870 con 0x7f55f0146690 2024-09-13T17:25:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.674+0000 7f55ed600700 1 -- 172.21.15.139:0/3145285415 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f55f0135870 con 0x7f55f0146690 2024-09-13T17:25:25.680 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:25.681 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:25:25.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55cc066730 msgr2=0x7f55cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55cc066730 0x7f55cc068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009dc0 tx=0x7f55e0011000 comp rx=0 tx=0).stop 2024-09-13T17:25:25.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 msgr2=0x7f55f00aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 0x7f55f00aab80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c700 tx=0x7f55d800ca10 comp rx=0 tx=0).stop 2024-09-13T17:25:25.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 shutdown_connections 2024-09-13T17:25:25.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f55cc066730 0x7f55cc068bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015e030 0x7f55f00ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f0146690 0x7f55f00aab80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 --2- 172.21.15.139:0/3145285415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00d1740 0x7f55f0135130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 >> 172.21.15.139:0/3145285415 conn(0x7f55f0071fa0 msgr2=0x7f55f015d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:25.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 shutdown_connections 2024-09-13T17:25:25.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.678+0000 7f55f5e00700 1 -- 172.21.15.139:0/3145285415 wait complete. 2024-09-13T17:25:25.686 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:25:25.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:25.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.866+0000 7efc58a00700 1 Processor -- start 2024-09-13T17:25:25.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.866+0000 7efc58a00700 1 -- start start 2024-09-13T17:25:25.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc58a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efc5414a6d0 0x7efc540cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc58a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540cd450 0x7efc54071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc58a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc54071ff0 con 0x7efc540b2b70 2024-09-13T17:25:25.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc58a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540cd890 con 0x7efc5414a6d0 2024-09-13T17:25:25.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc58a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5414aab0 con 0x7efc540cd450 2024-09-13T17:25:25.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efc5414a6d0 0x7efc540cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efc5414a6d0 0x7efc540cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57448/0 (socket says 172.21.15.139:57448) 2024-09-13T17:25:25.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 -- 172.21.15.139:0/2290895655 learned_addr learned my addr 172.21.15.139:0/2290895655 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:25.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 -- 172.21.15.139:0/2290895655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540cd450 msgr2=0x7efc54071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:25.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc51e00700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540cd450 0x7efc54071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540cd450 0x7efc54071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 -- 172.21.15.139:0/2290895655 >> v1:172.21.15.139:6789/0 conn(0x7efc540b2b70 legacy=0x7efc5406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 -- 172.21.15.139:0/2290895655 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540cc3b0 con 0x7efc5414a6d0 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc51e00700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540cd450 0x7efc54071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc52800700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc540cbd40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efc44009910 tx=0x7efc44009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16d0b43164b4d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.870+0000 7efc51400700 1 -- 172.21.15.139:0/2290895655 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400ba60 con 0x7efc5414a6d0 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc51400700 1 -- 172.21.15.139:0/2290895655 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400bbc0 con 0x7efc5414a6d0 2024-09-13T17:25:25.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc51400700 1 -- 172.21.15.139:0/2290895655 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44009e60 con 0x7efc5414a6d0 2024-09-13T17:25:25.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 -- 172.21.15.139:0/2290895655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 msgr2=0x7efc540cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc540cbd40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efc44009910 tx=0x7efc44009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:25.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 -- 172.21.15.139:0/2290895655 shutdown_connections 2024-09-13T17:25:25.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540cd450 0x7efc54071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 --2- 172.21.15.139:0/2290895655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc540cbd40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 -- 172.21.15.139:0/2290895655 >> 172.21.15.139:0/2290895655 conn(0x7efc540ce9d0 msgr2=0x7efc540cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:25.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 -- 172.21.15.139:0/2290895655 shutdown_connections 2024-09-13T17:25:25.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.874+0000 7efc58a00700 1 -- 172.21.15.139:0/2290895655 wait complete. 2024-09-13T17:25:25.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 Processor -- start 2024-09-13T17:25:25.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 -- start start 2024-09-13T17:25:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540b2b70 0x7efc54160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc540cd450 0x7efc54148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc5413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc541494a0 con 0x7efc5414a6d0 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5406be80 con 0x7efc540cd450 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc58a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5406c160 con 0x7efc540b2b70 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc5413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc5413ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57454/0 (socket says 172.21.15.139:57454) 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 -- 172.21.15.139:0/477255551 learned_addr learned my addr 172.21.15.139:0/477255551 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc52800700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540b2b70 0x7efc54160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc51e00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc540cd450 0x7efc54148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 -- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540b2b70 msgr2=0x7efc54160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540b2b70 0x7efc54160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 -- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc540cd450 msgr2=0x7efc54148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc540cd450 0x7efc54148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.878+0000 7efc53200700 1 -- 172.21.15.139:0/477255551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44009570 con 0x7efc5414a6d0 2024-09-13T17:25:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc53200700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc5413ee20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00cb50 tx=0x7efc4c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c003c20 con 0x7efc5414a6d0 2024-09-13T17:25:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c003d80 con 0x7efc5414a6d0 2024-09-13T17:25:25.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00aac0 con 0x7efc5414a6d0 2024-09-13T17:25:25.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5406c440 con 0x7efc5414a6d0 2024-09-13T17:25:25.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc541419c0 con 0x7efc5414a6d0 2024-09-13T17:25:25.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5406c660 con 0x7efc5414a6d0 2024-09-13T17:25:25.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.882+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc4c00ac20 con 0x7efc5414a6d0 2024-09-13T17:25:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.886+0000 7efc4aa00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc34066760 0x7efc34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.886+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc4c084400 con 0x7efc5414a6d0 2024-09-13T17:25:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.886+0000 7efc52800700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc34066760 0x7efc34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:25.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.886+0000 7efc52800700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc34066760 0x7efc34068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc44000c00 tx=0x7efc44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:25.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:25.890+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc4c0513c0 con 0x7efc5414a6d0 2024-09-13T17:25:26.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.082+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc54071ff0 con 0x7efc5414a6d0 2024-09-13T17:25:26.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.082+0000 7efc4aa00700 1 -- 172.21.15.139:0/477255551 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7efc54071ff0 con 0x7efc5414a6d0 2024-09-13T17:25:26.089 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:26.089 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:26.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc34066760 msgr2=0x7efc34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc34066760 0x7efc34068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc44000c00 tx=0x7efc44008030 comp rx=0 tx=0).stop 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 msgr2=0x7efc5413ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc5413ee20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00cb50 tx=0x7efc4c00ce60 comp rx=0 tx=0).stop 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 shutdown_connections 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7efc34066760 0x7efc34068c20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc5414a6d0 0x7efc5413ee20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc540cd450 0x7efc54148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 --2- 172.21.15.139:0/477255551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc540b2b70 0x7efc54160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 >> 172.21.15.139:0/477255551 conn(0x7efc540ce9d0 msgr2=0x7efc540aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 shutdown_connections 2024-09-13T17:25:26.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.086+0000 7efc58a00700 1 -- 172.21.15.139:0/477255551 wait complete. 2024-09-13T17:25:26.113 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:24:13.832183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:24:14.432049+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:24:17.495991+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:25:26.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:26.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.290+0000 7f4d8e000700 1 Processor -- start 2024-09-13T17:25:26.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.290+0000 7f4d8e000700 1 -- start start 2024-09-13T17:25:26.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4d88146b40 0x7f4d88161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d880c8ed0 0x7f4d880c9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d880c9860 con 0x7f4d8806b140 2024-09-13T17:25:26.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8806c260 con 0x7f4d88146b40 2024-09-13T17:25:26.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d88161ab0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4d88146b40 0x7f4d88161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4d88146b40 0x7f4d88161570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57458/0 (socket says 172.21.15.139:57458) 2024-09-13T17:25:26.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 -- 172.21.15.139:0/3390023170 learned_addr learned my addr 172.21.15.139:0/3390023170 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87e00700 1 --2- 172.21.15.139:0/3390023170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d880c8ed0 0x7f4d880c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 -- 172.21.15.139:0/3390023170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d880c8ed0 msgr2=0x7f4d880c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 --2- 172.21.15.139:0/3390023170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d880c8ed0 0x7f4d880c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 -- 172.21.15.139:0/3390023170 >> v1:172.21.15.139:6789/0 conn(0x7f4d8806b140 legacy=0x7f4d8806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 -- 172.21.15.139:0/3390023170 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8806cd90 con 0x7f4d88146b40 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d87400700 1 --2- 172.21.15.139:0/3390023170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d88146b40 0x7f4d88161570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009910 tx=0x7f4d78009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f63cd54251a228 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d86000700 1 -- 172.21.15.139:0/3390023170 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800ba60 con 0x7f4d88146b40 2024-09-13T17:25:26.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d86000700 1 -- 172.21.15.139:0/3390023170 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800bbc0 con 0x7f4d88146b40 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d86000700 1 -- 172.21.15.139:0/3390023170 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78009e60 con 0x7f4d88146b40 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- 172.21.15.139:0/3390023170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d88146b40 msgr2=0x7f4d88161570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 --2- 172.21.15.139:0/3390023170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d88146b40 0x7f4d88161570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009910 tx=0x7f4d78009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- 172.21.15.139:0/3390023170 shutdown_connections 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 --2- 172.21.15.139:0/3390023170 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d880c8ed0 0x7f4d880c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 --2- 172.21.15.139:0/3390023170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d88146b40 0x7f4d88161570 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- 172.21.15.139:0/3390023170 >> 172.21.15.139:0/3390023170 conn(0x7f4d880cfa80 msgr2=0x7f4d880cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:26.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- 172.21.15.139:0/3390023170 shutdown_connections 2024-09-13T17:25:26.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.294+0000 7f4d8e000700 1 -- 172.21.15.139:0/3390023170 wait complete. 2024-09-13T17:25:26.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 Processor -- start 2024-09-13T17:25:26.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 -- start start 2024-09-13T17:25:26.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8806b140 0x7f4d8813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 0x7f4d8813afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d88146b40 0x7f4d8813b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b7b00 con 0x7f4d880c8ed0 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b6ef0 con 0x7f4d88146b40 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d8e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b71d0 con 0x7f4d8806b140 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 0x7f4d8813afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 0x7f4d8813afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57464/0 (socket says 172.21.15.139:57464) 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 -- 172.21.15.139:0/654594581 learned_addr learned my addr 172.21.15.139:0/654594581 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d87400700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8806b140 0x7f4d8813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 -- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8806b140 msgr2=0x7f4d8813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8806b140 0x7f4d8813e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d87e00700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d88146b40 0x7f4d8813b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 -- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d88146b40 msgr2=0x7f4d8813b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d88146b40 0x7f4d8813b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 -- 172.21.15.139:0/654594581 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78009570 con 0x7f4d880c8ed0 2024-09-13T17:25:26.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d87400700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8806b140 0x7f4d8813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:26.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d87e00700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d88146b40 0x7f4d8813b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:26.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d86a00700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 0x7f4d8813afa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c4d0 tx=0x7f4d7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:26.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.298+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740052d0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.302+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74005430 con 0x7f4d880c8ed0 2024-09-13T17:25:26.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.302+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740055a0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.302+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d880b74b0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.302+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d88160320 con 0x7f4d880c8ed0 2024-09-13T17:25:26.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.302+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d880b7cb0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.302+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d740038a0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.306+0000 7f4d7f400700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d68066730 0x7f4d68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.306+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d740836e0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.306+0000 7f4d87400700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d68066730 0x7f4d68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.306+0000 7f4d87400700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d68066730 0x7f4d68068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009c60 tx=0x7f4d78008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:26.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.310+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d880b7cb0 con 0x7f4d880c8ed0 2024-09-13T17:25:26.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.490+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d880c9860 con 0x7f4d880c8ed0 2024-09-13T17:25:26.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.490+0000 7f4d7f400700 1 -- 172.21.15.139:0/654594581 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d880c9860 con 0x7f4d880c8ed0 2024-09-13T17:25:26.496 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d68066730 msgr2=0x7f4d68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d68066730 0x7f4d68068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009c60 tx=0x7f4d78008030 comp rx=0 tx=0).stop 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 msgr2=0x7f4d8813afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 0x7f4d8813afa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c4d0 tx=0x7f4d7400c890 comp rx=0 tx=0).stop 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 shutdown_connections 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4d68066730 0x7f4d68068bf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d88146b40 0x7f4d8813b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d880c8ed0 0x7f4d8813afa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 --2- 172.21.15.139:0/654594581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d8806b140 0x7f4d8813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 >> 172.21.15.139:0/654594581 conn(0x7f4d880cfa80 msgr2=0x7f4d880ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:26.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 shutdown_connections 2024-09-13T17:25:26.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.494+0000 7f4d8e000700 1 -- 172.21.15.139:0/654594581 wait complete. 2024-09-13T17:25:26.519 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:25:26.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.686+0000 7f1e8d400700 1 Processor -- start 2024-09-13T17:25:26.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.686+0000 7f1e8d400700 1 -- start start 2024-09-13T17:25:26.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8d400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1e8815ef90 0x7f1e88143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8d400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880b6370 con 0x7f1e8815ebb0 2024-09-13T17:25:26.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8d400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880b6650 con 0x7f1e8815f5c0 2024-09-13T17:25:26.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8d400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880b6930 con 0x7f1e8815ef90 2024-09-13T17:25:26.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e87e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1e8815ebb0 0x7f1e881434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38152/0 (socket says 172.21.15.139:38152) 2024-09-13T17:25:26.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e87e00700 1 -- 172.21.15.139:0/1742897683 learned_addr learned my addr 172.21.15.139:0/1742897683 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:26.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8ca00700 1 --2- 172.21.15.139:0/1742897683 >> v2:172.21.15.176:3300/0 conn(0x7f1e8815ef90 0x7f1e88143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e87400700 1 -- 172.21.15.139:0/1742897683 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371767109 0 0) 0x7f1e880b6370 con 0x7f1e8815ebb0 2024-09-13T17:25:26.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e87400700 1 -- 172.21.15.139:0/1742897683 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e680035d0 con 0x7f1e8815ebb0 2024-09-13T17:25:26.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8ca00700 1 -- 172.21.15.139:0/1742897683 >> v1:172.21.15.176:6789/0 conn(0x7f1e8815f5c0 legacy=0x7f1e880b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8ca00700 1 -- 172.21.15.139:0/1742897683 >> v1:172.21.15.139:6789/0 conn(0x7f1e8815ebb0 legacy=0x7f1e881434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8ca00700 1 -- 172.21.15.139:0/1742897683 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880b6c10 con 0x7f1e8815ef90 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e8ca00700 1 --2- 172.21.15.139:0/1742897683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815ef90 0x7f1e88143be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce6cadc8485b39b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e87400700 1 -- 172.21.15.139:0/1742897683 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e8815ef90 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.690+0000 7f1e87400700 1 -- 172.21.15.139:0/1742897683 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000bb20 con 0x7f1e8815ef90 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e87400700 1 -- 172.21.15.139:0/1742897683 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000be90 con 0x7f1e8815ef90 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- 172.21.15.139:0/1742897683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815ef90 msgr2=0x7f1e88143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 --2- 172.21.15.139:0/1742897683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815ef90 0x7f1e88143be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- 172.21.15.139:0/1742897683 shutdown_connections 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 --2- 172.21.15.139:0/1742897683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815ef90 0x7f1e88143be0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- 172.21.15.139:0/1742897683 >> 172.21.15.139:0/1742897683 conn(0x7f1e88071fa0 msgr2=0x7f1e88072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:26.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- 172.21.15.139:0/1742897683 shutdown_connections 2024-09-13T17:25:26.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- 172.21.15.139:0/1742897683 wait complete. 2024-09-13T17:25:26.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 Processor -- start 2024-09-13T17:25:26.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- start start 2024-09-13T17:25:26.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 0x7f1e88159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e8815ef90 0x7f1e881f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815f5c0 0x7f1e88157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881f2bb0 con 0x7f1e8815ebb0 2024-09-13T17:25:26.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88157fc0 con 0x7f1e8815f5c0 2024-09-13T17:25:26.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.694+0000 7f1e8d400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881582a0 con 0x7f1e8815ef90 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 0x7f1e88159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 0x7f1e88159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57470/0 (socket says 172.21.15.139:57470) 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 -- 172.21.15.139:0/2205368285 learned_addr learned my addr 172.21.15.139:0/2205368285 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e7fe00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e8815ef90 0x7f1e881f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e8ca00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815f5c0 0x7f1e88157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 -- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e8815ef90 msgr2=0x7f1e881f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e8815ef90 0x7f1e881f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 -- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815f5c0 msgr2=0x7f1e88157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815f5c0 0x7f1e88157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 -- 172.21.15.139:0/2205368285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009a70 con 0x7f1e8815ebb0 2024-09-13T17:25:26.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e87e00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 0x7f1e88159060 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c700 tx=0x7f1e7800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:26.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78005d90 con 0x7f1e8815ebb0 2024-09-13T17:25:26.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e780070d0 con 0x7f1e8815ebb0 2024-09-13T17:25:26.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78007480 con 0x7f1e8815ebb0 2024-09-13T17:25:26.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e88158580 con 0x7f1e8815ebb0 2024-09-13T17:25:26.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e88158b40 con 0x7f1e8815ebb0 2024-09-13T17:25:26.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.698+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e880677e0 con 0x7f1e8815ebb0 2024-09-13T17:25:26.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.702+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e780075e0 con 0x7f1e8815ebb0 2024-09-13T17:25:26.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.702+0000 7f1e84c00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e64066730 0x7f1e64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:26.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.702+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e78083a70 con 0x7f1e8815ebb0 2024-09-13T17:25:26.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.702+0000 7f1e7fe00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e64066730 0x7f1e64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:26.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.706+0000 7f1e7fe00700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e64066730 0x7f1e64068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e88141360 tx=0x7f1e70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:26.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.706+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e78050a10 con 0x7f1e8815ebb0 2024-09-13T17:25:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e881434d0 con 0x7f1e8815ebb0 2024-09-13T17:25:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e84c00700 1 -- 172.21.15.139:0/2205368285 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e78054030 con 0x7f1e8815ebb0 2024-09-13T17:25:26.898 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e64066730 msgr2=0x7f1e64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e64066730 0x7f1e64068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e88141360 tx=0x7f1e70009040 comp rx=0 tx=0).stop 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 msgr2=0x7f1e88159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 0x7f1e88159060 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c700 tx=0x7f1e7800ca10 comp rx=0 tx=0).stop 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 shutdown_connections 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1e64066730 0x7f1e64068bf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8815f5c0 0x7f1e88157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e8815ef90 0x7f1e881f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 --2- 172.21.15.139:0/2205368285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e8815ebb0 0x7f1e88159060 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 >> 172.21.15.139:0/2205368285 conn(0x7f1e88071fa0 msgr2=0x7f1e8813f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 shutdown_connections 2024-09-13T17:25:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:26.894+0000 7f1e8d400700 1 -- 172.21.15.139:0/2205368285 wait complete. 2024-09-13T17:25:26.920 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:25:27.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 Processor -- start 2024-09-13T17:25:27.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 -- start start 2024-09-13T17:25:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd234144770 0x7fd2340ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd23415b1c0 0x7fd23406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23415c160 con 0x7fd23406d7e0 2024-09-13T17:25:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23406dc90 con 0x7fd23415b1c0 2024-09-13T17:25:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.098+0000 7fd23ac00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23415c540 con 0x7fd234144770 2024-09-13T17:25:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd238c00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd23406d7e0 0x7fd23415e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38162/0 (socket says 172.21.15.139:38162) 2024-09-13T17:25:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd238c00700 1 -- 172.21.15.139:0/2777906002 learned_addr learned my addr 172.21.15.139:0/2777906002 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233400700 1 --2- 172.21.15.139:0/2777906002 >> v2:172.21.15.176:3300/0 conn(0x7fd23415b1c0 0x7fd23406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233e00700 1 --2- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd234144770 0x7fd2340ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd232a00700 1 -- 172.21.15.139:0/2777906002 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045474388 0 0) 0x7fd23415c160 con 0x7fd23406d7e0 2024-09-13T17:25:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd232a00700 1 -- 172.21.15.139:0/2777906002 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2180035d0 con 0x7fd23406d7e0 2024-09-13T17:25:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233400700 1 -- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd234144770 msgr2=0x7fd2340ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233400700 1 --2- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd234144770 0x7fd2340ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233400700 1 -- 172.21.15.139:0/2777906002 >> v1:172.21.15.139:6789/0 conn(0x7fd23406d7e0 legacy=0x7fd23415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233400700 1 -- 172.21.15.139:0/2777906002 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234144b50 con 0x7fd23415b1c0 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd233400700 1 --2- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd23415b1c0 0x7fd23406d2a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd220009850 tx=0x7fd220009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25380bef704fab35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd232a00700 1 -- 172.21.15.139:0/2777906002 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011830 con 0x7fd23415b1c0 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd232a00700 1 -- 172.21.15.139:0/2777906002 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220011990 con 0x7fd23415b1c0 2024-09-13T17:25:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd232a00700 1 -- 172.21.15.139:0/2777906002 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011d40 con 0x7fd23415b1c0 2024-09-13T17:25:27.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 -- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd23415b1c0 msgr2=0x7fd23406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 --2- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd23415b1c0 0x7fd23406d2a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd220009850 tx=0x7fd220009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:27.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 -- 172.21.15.139:0/2777906002 shutdown_connections 2024-09-13T17:25:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 --2- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd23415b1c0 0x7fd23406d2a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 --2- 172.21.15.139:0/2777906002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd234144770 0x7fd2340ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 -- 172.21.15.139:0/2777906002 >> 172.21.15.139:0/2777906002 conn(0x7fd23406b1e0 msgr2=0x7fd23406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.102+0000 7fd23ac00700 1 -- 172.21.15.139:0/2777906002 shutdown_connections 2024-09-13T17:25:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.106+0000 7fd23ac00700 1 -- 172.21.15.139:0/2777906002 wait complete. 2024-09-13T17:25:27.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.106+0000 7fd23ac00700 1 Processor -- start 2024-09-13T17:25:27.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.106+0000 7fd23ac00700 1 -- start start 2024-09-13T17:25:27.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd23ac00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406d7e0 0x7fd234142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd23ac00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234144770 0x7fd2340c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd23ac00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 0x7fd2340c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd23ac00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340ac020 con 0x7fd23415b1c0 2024-09-13T17:25:27.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd23ac00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340ac270 con 0x7fd234144770 2024-09-13T17:25:27.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd23ac00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340ac550 con 0x7fd23406d7e0 2024-09-13T17:25:27.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd238c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 0x7fd2340c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234144770 0x7fd2340c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd238c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 0x7fd2340c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57480/0 (socket says 172.21.15.139:57480) 2024-09-13T17:25:27.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd238c00700 1 -- 172.21.15.139:0/881948672 learned_addr learned my addr 172.21.15.139:0/881948672 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:27.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233e00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406d7e0 0x7fd234142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 -- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406d7e0 msgr2=0x7fd234142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406d7e0 0x7fd234142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 -- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 msgr2=0x7fd2340c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 0x7fd2340c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 -- 172.21.15.139:0/881948672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200094b0 con 0x7fd234144770 2024-09-13T17:25:27.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233e00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406d7e0 0x7fd234142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:27.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd238c00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 0x7fd2340c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:27.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.110+0000 7fd233400700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234144770 0x7fd2340c7fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd220016000 tx=0x7fd220004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.114+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220004510 con 0x7fd234144770 2024-09-13T17:25:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.114+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22001e070 con 0x7fd234144770 2024-09-13T17:25:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.114+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003900 con 0x7fd234144770 2024-09-13T17:25:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.114+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2340ac830 con 0x7fd234144770 2024-09-13T17:25:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.114+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234142c80 con 0x7fd234144770 2024-09-13T17:25:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.114+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2340acd50 con 0x7fd234144770 2024-09-13T17:25:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.118+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd220003a60 con 0x7fd234144770 2024-09-13T17:25:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.118+0000 7fd22be00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd214066730 0x7fd214068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.118+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd2200858a0 con 0x7fd234144770 2024-09-13T17:25:27.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.118+0000 7fd233e00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd214066730 0x7fd214068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.118+0000 7fd233e00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd214066730 0x7fd214068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd224009550 tx=0x7fd224012040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.126+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd220052840 con 0x7fd234144770 2024-09-13T17:25:27.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.306+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2340acd50 con 0x7fd234144770 2024-09-13T17:25:27.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.306+0000 7fd22be00700 1 -- 172.21.15.139:0/881948672 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2340acd50 con 0x7fd234144770 2024-09-13T17:25:27.312 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd214066730 msgr2=0x7fd214068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd214066730 0x7fd214068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd224009550 tx=0x7fd224012040 comp rx=0 tx=0).stop 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234144770 msgr2=0x7fd2340c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234144770 0x7fd2340c7fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd220016000 tx=0x7fd220004770 comp rx=0 tx=0).stop 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 shutdown_connections 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd214066730 0x7fd214068bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd23415b1c0 0x7fd2340c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234144770 0x7fd2340c7fb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 --2- 172.21.15.139:0/881948672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406d7e0 0x7fd234142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 >> 172.21.15.139:0/881948672 conn(0x7fd23406b1e0 msgr2=0x7fd2340b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:27.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.310+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 shutdown_connections 2024-09-13T17:25:27.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.314+0000 7fd23ac00700 1 -- 172.21.15.139:0/881948672 wait complete. 2024-09-13T17:25:27.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:25:27.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.506+0000 7f60da000700 1 Processor -- start 2024-09-13T17:25:27.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.506+0000 7f60da000700 1 -- start start 2024-09-13T17:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60da000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f60d40cf760 0x7f60d406c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60da000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f60d40b2e40 0x7f60d415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60da000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d40b48a0 con 0x7f60d415db60 2024-09-13T17:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60da000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d415df80 con 0x7f60d40b2e40 2024-09-13T17:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60da000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d40b5d30 con 0x7f60d40cf760 2024-09-13T17:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60d3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f60d40b2e40 0x7f60d415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60d9600700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f60d415db60 0x7f60d415a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:60368/0 (socket says 172.21.15.139:60368) 2024-09-13T17:25:27.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60d8c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f60d40cf760 0x7f60d406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.510+0000 7f60d9600700 1 -- 172.21.15.139:0/1836963327 learned_addr learned my addr 172.21.15.139:0/1836963327 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:27.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d8c00700 1 -- 172.21.15.139:0/1836963327 >> v2:172.21.15.139:3300/0 conn(0x7f60d40b2e40 msgr2=0x7f60d415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:27.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d8c00700 1 --2- 172.21.15.139:0/1836963327 >> v2:172.21.15.139:3300/0 conn(0x7f60d40b2e40 0x7f60d415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d8c00700 1 -- 172.21.15.139:0/1836963327 >> v1:172.21.15.176:6789/0 conn(0x7f60d415db60 legacy=0x7f60d415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d3400700 1 -- 172.21.15.139:0/1836963327 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624636478 0 0) 0x7f60d40b48a0 con 0x7f60d415db60 2024-09-13T17:25:27.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d8c00700 1 -- 172.21.15.139:0/1836963327 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d406c7e0 con 0x7f60d40cf760 2024-09-13T17:25:27.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d3e00700 1 --2- 172.21.15.139:0/1836963327 >> v2:172.21.15.139:3300/0 conn(0x7f60d40b2e40 0x7f60d415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:27.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d8c00700 1 --2- 172.21.15.139:0/1836963327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d406c200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60d4074850 tx=0x7f60c8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7896eed2180c515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d3400700 1 -- 172.21.15.139:0/1836963327 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011830 con 0x7f60d40cf760 2024-09-13T17:25:27.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d3400700 1 -- 172.21.15.139:0/1836963327 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8011990 con 0x7f60d40cf760 2024-09-13T17:25:27.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60d3400700 1 -- 172.21.15.139:0/1836963327 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011d20 con 0x7f60d40cf760 2024-09-13T17:25:27.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 -- 172.21.15.139:0/1836963327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 msgr2=0x7f60d406c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 --2- 172.21.15.139:0/1836963327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d406c200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60d4074850 tx=0x7f60c8009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:27.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 -- 172.21.15.139:0/1836963327 shutdown_connections 2024-09-13T17:25:27.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 --2- 172.21.15.139:0/1836963327 >> v2:172.21.15.139:3300/0 conn(0x7f60d40b2e40 0x7f60d415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 --2- 172.21.15.139:0/1836963327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d406c200 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 -- 172.21.15.139:0/1836963327 >> 172.21.15.139:0/1836963327 conn(0x7f60d40cc890 msgr2=0x7f60d40ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:27.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 -- 172.21.15.139:0/1836963327 shutdown_connections 2024-09-13T17:25:27.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.514+0000 7f60da000700 1 -- 172.21.15.139:0/1836963327 wait complete. 2024-09-13T17:25:27.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 Processor -- start 2024-09-13T17:25:27.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 -- start start 2024-09-13T17:25:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 0x7f60d41493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60d415db60 0x7f60d415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d414d520 con 0x7f60d40b2e40 2024-09-13T17:25:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d414c480 con 0x7f60d40cf760 2024-09-13T17:25:27.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.518+0000 7f60da000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d414c760 con 0x7f60d415db60 2024-09-13T17:25:27.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 0x7f60d41493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 0x7f60d41493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57492/0 (socket says 172.21.15.139:57492) 2024-09-13T17:25:27.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 -- 172.21.15.139:0/2725281142 learned_addr learned my addr 172.21.15.139:0/2725281142 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:27.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d3e00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d9600700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60d415db60 0x7f60d415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 -- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60d415db60 msgr2=0x7f60d415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60d415db60 0x7f60d415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 -- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 msgr2=0x7f60d415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 -- 172.21.15.139:0/2725281142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0009450 con 0x7f60d40b2e40 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d8c00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 0x7f60d41493c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f60c8014040 tx=0x7f60c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8004610 con 0x7f60d40b2e40 2024-09-13T17:25:27.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c801e070 con 0x7f60d40b2e40 2024-09-13T17:25:27.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c80094b0 con 0x7f60d40b2e40 2024-09-13T17:25:27.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8003900 con 0x7f60d40b2e40 2024-09-13T17:25:27.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d414cd20 con 0x7f60d40b2e40 2024-09-13T17:25:27.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.522+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d40677e0 con 0x7f60d40b2e40 2024-09-13T17:25:27.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.526+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60c8003a60 con 0x7f60d40b2e40 2024-09-13T17:25:27.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.526+0000 7f60d0c00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60b4066730 0x7f60b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.526+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f60c8085310 con 0x7f60d40b2e40 2024-09-13T17:25:27.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.526+0000 7f60d3e00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60b4066730 0x7f60b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.526+0000 7f60d3e00700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60b4066730 0x7f60b4068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60d40cf170 tx=0x7f60c0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.534+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60c80522b0 con 0x7f60d40b2e40 2024-09-13T17:25:27.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.714+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f60d41544b0 con 0x7f60d40b2e40 2024-09-13T17:25:27.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.714+0000 7f60d0c00700 1 -- 172.21.15.139:0/2725281142 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f60c80558d0 con 0x7f60d40b2e40 2024-09-13T17:25:27.720 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:25:27.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60b4066730 msgr2=0x7f60b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60b4066730 0x7f60b4068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60d40cf170 tx=0x7f60c0009240 comp rx=0 tx=0).stop 2024-09-13T17:25:27.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 msgr2=0x7f60d41493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 0x7f60d41493c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f60c8014040 tx=0x7f60c8004770 comp rx=0 tx=0).stop 2024-09-13T17:25:27.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 shutdown_connections 2024-09-13T17:25:27.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60b4066730 0x7f60b4068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60d415db60 0x7f60d415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60d40cf760 0x7f60d415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 --2- 172.21.15.139:0/2725281142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60d40b2e40 0x7f60d41493c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 >> 172.21.15.139:0/2725281142 conn(0x7f60d40cc890 msgr2=0x7f60d41532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:27.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 shutdown_connections 2024-09-13T17:25:27.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.718+0000 7f60da000700 1 -- 172.21.15.139:0/2725281142 wait complete. 2024-09-13T17:25:27.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:25:27.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5eb200700 1 Processor -- start 2024-09-13T17:25:27.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5eb200700 1 -- start start 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5eb200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd5e40717b0 0x7fd5e406b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5eb200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e4071bc0 con 0x7fd5e415a150 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5eb200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e415a740 con 0x7fd5e4070750 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5eb200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e415aa20 con 0x7fd5e40717b0 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5e9400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd5e415a150 0x7fd5e415b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38170/0 (socket says 172.21.15.139:38170) 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5e9400700 1 -- 172.21.15.139:0/1358412403 learned_addr learned my addr 172.21.15.139:0/1358412403 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:27.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.910+0000 7fd5ea800700 1 --2- 172.21.15.139:0/1358412403 >> v2:172.21.15.139:3300/0 conn(0x7fd5e40717b0 0x7fd5e406b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042112131 0 0) 0x7fd5e4071bc0 con 0x7fd5e415a150 2024-09-13T17:25:27.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5cc0035d0 con 0x7fd5e415a150 2024-09-13T17:25:27.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2078207132 0 0) 0x7fd5cc0035d0 con 0x7fd5e415a150 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 >> v2:172.21.15.139:3300/0 conn(0x7fd5e40717b0 msgr2=0x7fd5e406b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 --2- 172.21.15.139:0/1358412403 >> v2:172.21.15.139:3300/0 conn(0x7fd5e40717b0 0x7fd5e406b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 >> v1:172.21.15.176:6789/0 conn(0x7fd5e4070750 legacy=0x7fd5e4070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e415ad00 con 0x7fd5e415a150 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7fd5d40017f0 con 0x7fd5e415a150 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 >> v1:172.21.15.139:6789/0 conn(0x7fd5e415a150 legacy=0x7fd5e415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc003a20 0x7fd5cc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5cc004870 0x7fd5cc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc005230 0x7fd5cc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e415aa20 con 0x7fd5cc004870 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc00c0d0 con 0x7fd5cc005230 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc00c290 con 0x7fd5cc003a20 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5cc004870 0x7fd5cc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5ea800700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc005230 0x7fd5cc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9e00700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc003a20 0x7fd5cc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 -- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc003a20 msgr2=0x7fd5cc003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc003a20 0x7fd5cc003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 -- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc005230 msgr2=0x7fd5cc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc005230 0x7fd5cc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 -- 172.21.15.139:0/1358412403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0035d0 con 0x7fd5cc004870 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5ea800700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc005230 0x7fd5cc00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5ea800700 1 -- 172.21.15.139:0/1358412403 reap_dead start 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9e00700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc003a20 0x7fd5cc003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e9400700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5cc004870 0x7fd5cc004cf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c240 tx=0x7fd5cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97cb7550fe3f09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400cda0 con 0x7fd5cc004870 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d4007ba0 con 0x7fd5cc004870 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5e8a00700 1 -- 172.21.15.139:0/1358412403 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40072f0 con 0x7fd5cc004870 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5eb200700 1 -- 172.21.15.139:0/1358412403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5cc004870 msgr2=0x7fd5cc004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.914+0000 7fd5eb200700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5cc004870 0x7fd5cc004cf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c240 tx=0x7fd5cc0058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 -- 172.21.15.139:0/1358412403 shutdown_connections 2024-09-13T17:25:27.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 --2- 172.21.15.139:0/1358412403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5cc004870 0x7fd5cc004cf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 -- 172.21.15.139:0/1358412403 >> 172.21.15.139:0/1358412403 conn(0x7fd5e406de90 msgr2=0x7fd5e406e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:27.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 -- 172.21.15.139:0/1358412403 shutdown_connections 2024-09-13T17:25:27.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 -- 172.21.15.139:0/1358412403 wait complete. 2024-09-13T17:25:27.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 Processor -- start 2024-09-13T17:25:27.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.918+0000 7fd5eb200700 1 -- start start 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc004870 0x7fd5e41ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e41f13d0 0x7fd5e4151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 0x7fd5e41eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e4152270 con 0x7fd5e4151dc0 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e41474e0 con 0x7fd5e41f13d0 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e41468d0 con 0x7fd5cc004870 2024-09-13T17:25:27.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 0x7fd5e41eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 0x7fd5e41eb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57510/0 (socket says 172.21.15.139:57510) 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 -- 172.21.15.139:0/329224426 learned_addr learned my addr 172.21.15.139:0/329224426 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5e9400700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e41f13d0 0x7fd5e4151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5e9e00700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc004870 0x7fd5e41ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 -- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc004870 msgr2=0x7fd5e41ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc004870 0x7fd5e41ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 -- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e41f13d0 msgr2=0x7fd5e4151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e41f13d0 0x7fd5e4151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:27.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 -- 172.21.15.139:0/329224426 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4146bb0 con 0x7fd5e4151dc0 2024-09-13T17:25:27.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5ea800700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 0x7fd5e41eb230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd5e415a530 tx=0x7fd5e000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0010050 con 0x7fd5e4151dc0 2024-09-13T17:25:27.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e0011040 con 0x7fd5e4151dc0 2024-09-13T17:25:27.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e4146e90 con 0x7fd5e4151dc0 2024-09-13T17:25:27.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0009e60 con 0x7fd5e4151dc0 2024-09-13T17:25:27.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.922+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e41f1850 con 0x7fd5e4151dc0 2024-09-13T17:25:27.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.926+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e40b1740 con 0x7fd5e4151dc0 2024-09-13T17:25:27.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.926+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5e001e410 con 0x7fd5e4151dc0 2024-09-13T17:25:27.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.926+0000 7fd5de000700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5c8066760 0x7fd5c8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:27.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.926+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd5e0084930 con 0x7fd5e4151dc0 2024-09-13T17:25:27.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.926+0000 7fd5e9e00700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5c8066760 0x7fd5c8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:27.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.926+0000 7fd5e9e00700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5c8066760 0x7fd5c8068c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8007fd0 tx=0x7fd5d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:27.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:27.934+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5e00518e0 con 0x7fd5e4151dc0 2024-09-13T17:25:28.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.162+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5e4070b30 con 0x7fd5e4151dc0 2024-09-13T17:25:28.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.162+0000 7fd5de000700 1 -- 172.21.15.139:0/329224426 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7fd5e0054f00 con 0x7fd5e4151dc0 2024-09-13T17:25:28.168 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:28.169 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.166+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5c8066760 msgr2=0x7fd5c8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.166+0000 7fd5eb200700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5c8066760 0x7fd5c8068c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8007fd0 tx=0x7fd5d8009040 comp rx=0 tx=0).stop 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 msgr2=0x7fd5e41eb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 0x7fd5e41eb230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd5e415a530 tx=0x7fd5e000af90 comp rx=0 tx=0).stop 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 shutdown_connections 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fd5c8066760 0x7fd5c8068c20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5e4151dc0 0x7fd5e41eb230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e41f13d0 0x7fd5e4151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 --2- 172.21.15.139:0/329224426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc004870 0x7fd5e41ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 >> 172.21.15.139:0/329224426 conn(0x7fd5e406de90 msgr2=0x7fd5e406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:28.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 shutdown_connections 2024-09-13T17:25:28.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.170+0000 7fd5eb200700 1 -- 172.21.15.139:0/329224426 wait complete. 2024-09-13T17:25:28.176 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:25:28.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:28.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.354+0000 7f969d200700 1 Processor -- start 2024-09-13T17:25:28.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.354+0000 7f969d200700 1 -- start start 2024-09-13T17:25:28.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.354+0000 7f969d200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f969815cdb0 0x7f96980cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.354+0000 7f969d200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f96980cde80 0x7f969806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f969d200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969815d190 con 0x7f969806a8d0 2024-09-13T17:25:28.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f969d200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969806acf0 con 0x7f96980cde80 2024-09-13T17:25:28.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f969d200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980ce4b0 con 0x7f969815cdb0 2024-09-13T17:25:28.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f969815cdb0 0x7f96980cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f969806a8d0 0x7f96980d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38180/0 (socket says 172.21.15.139:38180) 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697e00700 1 -- 172.21.15.139:0/2529512337 learned_addr learned my addr 172.21.15.139:0/2529512337 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9696a00700 1 --2- 172.21.15.139:0/2529512337 >> v2:172.21.15.139:3300/0 conn(0x7f96980cde80 0x7f969806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9696000700 1 -- 172.21.15.139:0/2529512337 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280390869 0 0) 0x7f969815d190 con 0x7f969806a8d0 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697400700 1 -- 172.21.15.139:0/2529512337 >> v2:172.21.15.139:3300/0 conn(0x7f96980cde80 msgr2=0x7f969806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697400700 1 --2- 172.21.15.139:0/2529512337 >> v2:172.21.15.139:3300/0 conn(0x7f96980cde80 0x7f969806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697400700 1 -- 172.21.15.139:0/2529512337 >> v1:172.21.15.139:6789/0 conn(0x7f969806a8d0 legacy=0x7f96980d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697400700 1 -- 172.21.15.139:0/2529512337 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980ce790 con 0x7f969815cdb0 2024-09-13T17:25:28.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9697400700 1 --2- 172.21.15.139:0/2529512337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980cd940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f96980d3e70 tx=0x7f9688009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=501b0b7e7eb466d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:28.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9696000700 1 -- 172.21.15.139:0/2529512337 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688011830 con 0x7f969815cdb0 2024-09-13T17:25:28.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9696000700 1 -- 172.21.15.139:0/2529512337 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688011990 con 0x7f969815cdb0 2024-09-13T17:25:28.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.358+0000 7f9696000700 1 -- 172.21.15.139:0/2529512337 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688011d20 con 0x7f969815cdb0 2024-09-13T17:25:28.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- 172.21.15.139:0/2529512337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 msgr2=0x7f96980cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 --2- 172.21.15.139:0/2529512337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980cd940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f96980d3e70 tx=0x7f9688009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:28.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- 172.21.15.139:0/2529512337 shutdown_connections 2024-09-13T17:25:28.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 --2- 172.21.15.139:0/2529512337 >> v2:172.21.15.139:3300/0 conn(0x7f96980cde80 0x7f969806a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 --2- 172.21.15.139:0/2529512337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980cd940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- 172.21.15.139:0/2529512337 >> 172.21.15.139:0/2529512337 conn(0x7f96980d2d70 msgr2=0x7f96980d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:28.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- 172.21.15.139:0/2529512337 shutdown_connections 2024-09-13T17:25:28.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- 172.21.15.139:0/2529512337 wait complete. 2024-09-13T17:25:28.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 Processor -- start 2024-09-13T17:25:28.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- start start 2024-09-13T17:25:28.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969806a8d0 0x7f9698153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96980cde80 0x7f969815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96980c6880 con 0x7f96980cde80 2024-09-13T17:25:28.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96981f2d60 con 0x7f969815cdb0 2024-09-13T17:25:28.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.362+0000 7f969d200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96981f3040 con 0x7f969806a8d0 2024-09-13T17:25:28.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9696a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96980cde80 0x7f969815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9696a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96980cde80 0x7f969815f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57528/0 (socket says 172.21.15.139:57528) 2024-09-13T17:25:28.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9696a00700 1 -- 172.21.15.139:0/3811054581 learned_addr learned my addr 172.21.15.139:0/3811054581 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:28.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969806a8d0 0x7f9698153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697e00700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 -- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 msgr2=0x7f96980c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 -- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96980cde80 msgr2=0x7f969815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96980cde80 0x7f969815f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 -- 172.21.15.139:0/3811054581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96880094b0 con 0x7f969806a8d0 2024-09-13T17:25:28.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f9697400700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969806a8d0 0x7f9698153d30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9688016000 tx=0x7f9688004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:28.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880036c0 con 0x7f969806a8d0 2024-09-13T17:25:28.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968801f070 con 0x7f969806a8d0 2024-09-13T17:25:28.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96981f3320 con 0x7f969806a8d0 2024-09-13T17:25:28.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688003a60 con 0x7f969806a8d0 2024-09-13T17:25:28.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96981538d0 con 0x7f969806a8d0 2024-09-13T17:25:28.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.366+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96980677e0 con 0x7f969806a8d0 2024-09-13T17:25:28.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.370+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9688003bc0 con 0x7f969806a8d0 2024-09-13T17:25:28.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.370+0000 7f968f400700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9678066730 0x7f9678068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.370+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9688021070 con 0x7f969806a8d0 2024-09-13T17:25:28.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.370+0000 7f9696a00700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9678066730 0x7f9678068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.370+0000 7f9696a00700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9678066730 0x7f9678068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96980c9510 tx=0x7f9684009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:28.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.378+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9688052920 con 0x7f969806a8d0 2024-09-13T17:25:28.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.570+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f969806a390 con 0x7f969806a8d0 2024-09-13T17:25:28.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.570+0000 7f968f400700 1 -- 172.21.15.139:0/3811054581 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7f968802ee60 con 0x7f969806a8d0 2024-09-13T17:25:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:28.577 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:28.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9678066730 msgr2=0x7f9678068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9678066730 0x7f9678068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96980c9510 tx=0x7f9684009240 comp rx=0 tx=0).stop 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969806a8d0 msgr2=0x7f9698153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969806a8d0 0x7f9698153d30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9688016000 tx=0x7f9688004770 comp rx=0 tx=0).stop 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 shutdown_connections 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9678066730 0x7f9678068bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969815cdb0 0x7f96980c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96980cde80 0x7f969815f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 --2- 172.21.15.139:0/3811054581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969806a8d0 0x7f9698153d30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 >> 172.21.15.139:0/3811054581 conn(0x7f96980d2d70 msgr2=0x7f96980d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 shutdown_connections 2024-09-13T17:25:28.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.578+0000 7f969d200700 1 -- 172.21.15.139:0/3811054581 wait complete. 2024-09-13T17:25:28.607 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:25:28.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:25:28.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 Processor -- start 2024-09-13T17:25:28.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 -- start start 2024-09-13T17:25:28.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1a8146690 0x7ff1a80d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a80d1740 0x7ff1a80b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80b1740 con 0x7ff1a815e030 2024-09-13T17:25:28.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80d08c0 con 0x7ff1a8146690 2024-09-13T17:25:28.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ae000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a815e4c0 con 0x7ff1a80d1740 2024-09-13T17:25:28.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1acc00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1a8146690 0x7ff1a80d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1ad600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a80d1740 0x7ff1a80b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1a7e00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff1a815e030 0x7ff1a80d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:60380/0 (socket says 172.21.15.139:60380) 2024-09-13T17:25:28.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.774+0000 7ff1a7e00700 1 -- 172.21.15.139:0/3644015873 learned_addr learned my addr 172.21.15.139:0/3644015873 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:28.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ad600700 1 -- 172.21.15.139:0/3644015873 >> v2:172.21.15.176:3300/0 conn(0x7ff1a8146690 msgr2=0x7ff1a80d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:28.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ad600700 1 --2- 172.21.15.139:0/3644015873 >> v2:172.21.15.176:3300/0 conn(0x7ff1a8146690 0x7ff1a80d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1a7400700 1 -- 172.21.15.139:0/3644015873 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032287785 0 0) 0x7ff1a80b1740 con 0x7ff1a815e030 2024-09-13T17:25:28.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ad600700 1 -- 172.21.15.139:0/3644015873 >> v1:172.21.15.176:6789/0 conn(0x7ff1a815e030 legacy=0x7ff1a80d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ad600700 1 -- 172.21.15.139:0/3644015873 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80b1990 con 0x7ff1a80d1740 2024-09-13T17:25:28.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1acc00700 1 --2- 172.21.15.139:0/3644015873 >> v2:172.21.15.176:3300/0 conn(0x7ff1a8146690 0x7ff1a80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:28.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ad600700 1 --2- 172.21.15.139:0/3644015873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a80d1740 0x7ff1a80b2750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d90 tx=0x7ff1a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef346354f41038c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:28.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1a7400700 1 -- 172.21.15.139:0/3644015873 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000e070 con 0x7ff1a80d1740 2024-09-13T17:25:28.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1a7400700 1 -- 172.21.15.139:0/3644015873 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a000bb20 con 0x7ff1a80d1740 2024-09-13T17:25:28.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1a7400700 1 -- 172.21.15.139:0/3644015873 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0012430 con 0x7ff1a80d1740 2024-09-13T17:25:28.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 -- 172.21.15.139:0/3644015873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a80d1740 msgr2=0x7ff1a80b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3644015873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a80d1740 0x7ff1a80b2750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d90 tx=0x7ff1a000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:28.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 -- 172.21.15.139:0/3644015873 shutdown_connections 2024-09-13T17:25:28.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3644015873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a80d1740 0x7ff1a80b2750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3644015873 >> v2:172.21.15.176:3300/0 conn(0x7ff1a8146690 0x7ff1a80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 -- 172.21.15.139:0/3644015873 >> 172.21.15.139:0/3644015873 conn(0x7ff1a8071fa0 msgr2=0x7ff1a8072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:28.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 -- 172.21.15.139:0/3644015873 shutdown_connections 2024-09-13T17:25:28.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.778+0000 7ff1ae000700 1 -- 172.21.15.139:0/3644015873 wait complete. 2024-09-13T17:25:28.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 Processor -- start 2024-09-13T17:25:28.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 -- start start 2024-09-13T17:25:28.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 0x7ff1a8143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a8146690 0x7ff1a813df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a815e030 0x7ff1a813f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b5ce0 con 0x7ff1a80d1740 2024-09-13T17:25:28.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b3e70 con 0x7ff1a8146690 2024-09-13T17:25:28.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1ae000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a813e4d0 con 0x7ff1a815e030 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.782+0000 7ff1acc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 0x7ff1a8143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 0x7ff1a8143cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57540/0 (socket says 172.21.15.139:57540) 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 -- 172.21.15.139:0/3677125790 learned_addr learned my addr 172.21.15.139:0/3677125790 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1ad600700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a815e030 0x7ff1a813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1a7e00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a8146690 0x7ff1a813df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 -- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a815e030 msgr2=0x7ff1a813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a815e030 0x7ff1a813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 -- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a8146690 msgr2=0x7ff1a813df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:28.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a8146690 0x7ff1a813df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:28.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 -- 172.21.15.139:0/3677125790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0094b0 con 0x7ff1a80d1740 2024-09-13T17:25:28.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1ad600700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a815e030 0x7ff1a813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:28.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1acc00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 0x7ff1a8143cd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00ec10 tx=0x7ff19c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:28.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00c940 con 0x7ff1a80d1740 2024-09-13T17:25:28.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00caa0 con 0x7ff1a80d1740 2024-09-13T17:25:28.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a0009a70 con 0x7ff1a80d1740 2024-09-13T17:25:28.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00ce30 con 0x7ff1a80d1740 2024-09-13T17:25:28.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80b5a00 con 0x7ff1a80d1740 2024-09-13T17:25:28.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.786+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a80677e0 con 0x7ff1a80d1740 2024-09-13T17:25:28.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.790+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff19c013470 con 0x7ff1a80d1740 2024-09-13T17:25:28.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.790+0000 7ff1a4c00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff188066760 0x7ff188068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:28.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.790+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff19c084730 con 0x7ff1a80d1740 2024-09-13T17:25:28.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.790+0000 7ff1a7e00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff188066760 0x7ff188068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:28.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.794+0000 7ff1a7e00700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff188066760 0x7ff188068c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff1a81f5da0 tx=0x7ff194007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:28.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:28.798+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff19c0516d0 con 0x7ff1a80d1740 2024-09-13T17:25:29.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.026+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1a8146a70 con 0x7ff1a80d1740 2024-09-13T17:25:29.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.026+0000 7ff1a4c00700 1 -- 172.21.15.139:0/3677125790 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7ff19c054cf0 con 0x7ff1a80d1740 2024-09-13T17:25:29.033 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:29.033 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:25:29.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff188066760 msgr2=0x7ff188068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff188066760 0x7ff188068c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff1a81f5da0 tx=0x7ff194007cb0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 msgr2=0x7ff1a8143cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 0x7ff1a8143cd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00ec10 tx=0x7ff19c009ed0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 shutdown_connections 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff188066760 0x7ff188068c20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a815e030 0x7ff1a813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a8146690 0x7ff1a813df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 --2- 172.21.15.139:0/3677125790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a80d1740 0x7ff1a8143cd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.030+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 >> 172.21.15.139:0/3677125790 conn(0x7ff1a8071fa0 msgr2=0x7ff1a815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:29.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.034+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 shutdown_connections 2024-09-13T17:25:29.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.034+0000 7ff1ae000700 1 -- 172.21.15.139:0/3677125790 wait complete. 2024-09-13T17:25:29.041 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:25:29.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:25:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.214+0000 7f4aa8400700 1 Processor -- start 2024-09-13T17:25:29.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.218+0000 7f4aa8400700 1 -- start start 2024-09-13T17:25:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.218+0000 7f4aa8400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4aa01592a0 0x7f4aa015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.218+0000 7f4aa8400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00cd570 con 0x7f4aa00719c0 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.218+0000 7f4aa8400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00b41c0 con 0x7f4aa00ce410 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.218+0000 7f4aa8400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa015a8a0 con 0x7f4aa01592a0 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.218+0000 7f4aa5a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4aa01592a0 0x7f4aa015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa5a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4aa01592a0 0x7f4aa015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57544/0 (socket says 172.21.15.139:57544) 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa5a00700 1 -- 172.21.15.139:0/2335600229 learned_addr learned my addr 172.21.15.139:0/2335600229 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa6400700 1 --1- 172.21.15.139:0/2335600229 >> v1:172.21.15.139:6789/0 conn(0x7f4aa00719c0 0x7f4aa0070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38194/0 (socket says 172.21.15.139:38194) 2024-09-13T17:25:29.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa5a00700 1 -- 172.21.15.139:0/2335600229 >> v1:172.21.15.176:6789/0 conn(0x7f4aa00ce410 legacy=0x7f4aa00cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa5a00700 1 -- 172.21.15.139:0/2335600229 >> v1:172.21.15.139:6789/0 conn(0x7f4aa00719c0 legacy=0x7f4aa0070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa5a00700 1 -- 172.21.15.139:0/2335600229 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00ce960 con 0x7f4aa01592a0 2024-09-13T17:25:29.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa5a00700 1 --2- 172.21.15.139:0/2335600229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa01592a0 0x7f4aa015a360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009940 tx=0x7f4a94009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdcbafc49800412 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4a9fe00700 1 -- 172.21.15.139:0/2335600229 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400ba20 con 0x7f4aa01592a0 2024-09-13T17:25:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4a9fe00700 1 -- 172.21.15.139:0/2335600229 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94009e90 con 0x7f4aa01592a0 2024-09-13T17:25:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4a9fe00700 1 -- 172.21.15.139:0/2335600229 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400bda0 con 0x7f4aa01592a0 2024-09-13T17:25:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 -- 172.21.15.139:0/2335600229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa01592a0 msgr2=0x7f4aa015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 --2- 172.21.15.139:0/2335600229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa01592a0 0x7f4aa015a360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009940 tx=0x7f4a94009c50 comp rx=0 tx=0).stop 2024-09-13T17:25:29.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 -- 172.21.15.139:0/2335600229 shutdown_connections 2024-09-13T17:25:29.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 --2- 172.21.15.139:0/2335600229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa01592a0 0x7f4aa015a360 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 -- 172.21.15.139:0/2335600229 >> 172.21.15.139:0/2335600229 conn(0x7f4aa006b1e0 msgr2=0x7f4aa006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:29.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 -- 172.21.15.139:0/2335600229 shutdown_connections 2024-09-13T17:25:29.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.222+0000 7f4aa8400700 1 -- 172.21.15.139:0/2335600229 wait complete. 2024-09-13T17:25:29.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 Processor -- start 2024-09-13T17:25:29.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 -- start start 2024-09-13T17:25:29.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 0x7f4aa01496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa00ce410 0x7f4aa00707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa01592a0 0x7f4aa00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa014a3a0 con 0x7f4aa00719c0 2024-09-13T17:25:29.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0070050 con 0x7f4aa01592a0 2024-09-13T17:25:29.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa8400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0070330 con 0x7f4aa00ce410 2024-09-13T17:25:29.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 0x7f4aa01496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 0x7f4aa01496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57554/0 (socket says 172.21.15.139:57554) 2024-09-13T17:25:29.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa5a00700 1 -- 172.21.15.139:0/516856031 learned_addr learned my addr 172.21.15.139:0/516856031 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:29.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa6400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa01592a0 0x7f4aa00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.226+0000 7f4aa5000700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa00ce410 0x7f4aa00707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa5a00700 1 -- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa00ce410 msgr2=0x7f4aa00707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa5a00700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa00ce410 0x7f4aa00707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa5a00700 1 -- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa01592a0 msgr2=0x7f4aa00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa5a00700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa01592a0 0x7f4aa00b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa5a00700 1 -- 172.21.15.139:0/516856031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009570 con 0x7f4aa00719c0 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa5a00700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 0x7f4aa01496a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4a94000c00 tx=0x7f4a94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940036c0 con 0x7f4aa00719c0 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9401f070 con 0x7f4aa00719c0 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94003a80 con 0x7f4aa00719c0 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa00c94f0 con 0x7f4aa00719c0 2024-09-13T17:25:29.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa00c9ab0 con 0x7f4aa00719c0 2024-09-13T17:25:29.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.230+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa006dc70 con 0x7f4aa00719c0 2024-09-13T17:25:29.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.234+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a94003be0 con 0x7f4aa00719c0 2024-09-13T17:25:29.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.234+0000 7f4a9d600700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4a80066730 0x7f4a80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.234+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a94021070 con 0x7f4aa00719c0 2024-09-13T17:25:29.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.234+0000 7f4aa5000700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4a80066730 0x7f4a80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.234+0000 7f4aa5000700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4a80066730 0x7f4a80068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0071030 tx=0x7f4a8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:29.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.242+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a94052f60 con 0x7f4aa00719c0 2024-09-13T17:25:29.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.470+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4aa015a340 con 0x7f4aa00719c0 2024-09-13T17:25:29.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.474+0000 7f4a9d600700 1 -- 172.21.15.139:0/516856031 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f4a9402b020 con 0x7f4aa00719c0 2024-09-13T17:25:29.478 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:29.478 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/3059794457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":3059794457},{"type":"v1","addr":"172.21.15.139:6835","nonce":3059794457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/826645295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":826645295},{"type":"v1","addr":"172.21.15.139:6837","nonce":826645295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1092335802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1092335802},{"type":"v1","addr":"172.21.15.176:6835","nonce":1092335802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:24:15.421146+0000","modified":"2024-09-13T17:24:40.558647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6834/4065509262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":4065509262},{"type":"v1","addr":"172.21.15.176:6834","nonce":4065509262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:25:29.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.474+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4a80066730 msgr2=0x7f4a80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.474+0000 7f4aa8400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4a80066730 0x7f4a80068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0071030 tx=0x7f4a8c009040 comp rx=0 tx=0).stop 2024-09-13T17:25:29.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.474+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 msgr2=0x7f4aa01496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.474+0000 7f4aa8400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 0x7f4aa01496a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4a94000c00 tx=0x7f4a94004770 comp rx=0 tx=0).stop 2024-09-13T17:25:29.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 shutdown_connections 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4a80066730 0x7f4a80068bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa01592a0 0x7f4aa00b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa00ce410 0x7f4aa00707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 --2- 172.21.15.139:0/516856031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aa00719c0 0x7f4aa01496a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 >> 172.21.15.139:0/516856031 conn(0x7f4aa006b1e0 msgr2=0x7f4aa01598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 shutdown_connections 2024-09-13T17:25:29.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.478+0000 7f4aa8400700 1 -- 172.21.15.139:0/516856031 wait complete. 2024-09-13T17:25:29.483 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2024-09-13T17:25:29.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:29.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.666+0000 7f94a2800700 1 Processor -- start 2024-09-13T17:25:29.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.666+0000 7f94a2800700 1 -- start start 2024-09-13T17:25:29.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a2800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f949c144300 0x7f949c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a2800700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c070140 con 0x7f949c15aff0 2024-09-13T17:25:29.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a2800700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c070420 con 0x7f949c0cddd0 2024-09-13T17:25:29.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a2800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c070700 con 0x7f949c144300 2024-09-13T17:25:29.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a0a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f949c15aff0 0x7f949c0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38206/0 (socket says 172.21.15.139:38206) 2024-09-13T17:25:29.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a0a00700 1 -- 172.21.15.139:0/3842448998 learned_addr learned my addr 172.21.15.139:0/3842448998 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:29.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a1400700 1 --2- 172.21.15.139:0/3842448998 >> v2:172.21.15.176:3300/0 conn(0x7f949c144300 0x7f949c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f949be00700 1 -- 172.21.15.139:0/3842448998 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082511358 0 0) 0x7f949c070140 con 0x7f949c15aff0 2024-09-13T17:25:29.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f949be00700 1 -- 172.21.15.139:0/3842448998 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94840035d0 con 0x7f949c15aff0 2024-09-13T17:25:29.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a1400700 1 -- 172.21.15.139:0/3842448998 >> v1:172.21.15.176:6789/0 conn(0x7f949c0cddd0 legacy=0x7f949c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a1400700 1 -- 172.21.15.139:0/3842448998 >> v1:172.21.15.139:6789/0 conn(0x7f949c15aff0 legacy=0x7f949c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a1400700 1 -- 172.21.15.139:0/3842448998 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0709e0 con 0x7f949c144300 2024-09-13T17:25:29.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.670+0000 7f94a1400700 1 --2- 172.21.15.139:0/3842448998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c06d620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9490009880 tx=0x7f9490009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a420fa91d1c3981a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:29.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f949be00700 1 -- 172.21.15.139:0/3842448998 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490011830 con 0x7f949c144300 2024-09-13T17:25:29.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f949be00700 1 -- 172.21.15.139:0/3842448998 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490011990 con 0x7f949c144300 2024-09-13T17:25:29.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f949be00700 1 -- 172.21.15.139:0/3842448998 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490011d20 con 0x7f949c144300 2024-09-13T17:25:29.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 -- 172.21.15.139:0/3842448998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 msgr2=0x7f949c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 --2- 172.21.15.139:0/3842448998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c06d620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9490009880 tx=0x7f9490009b90 comp rx=0 tx=0).stop 2024-09-13T17:25:29.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 -- 172.21.15.139:0/3842448998 shutdown_connections 2024-09-13T17:25:29.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 --2- 172.21.15.139:0/3842448998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c06d620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 -- 172.21.15.139:0/3842448998 >> 172.21.15.139:0/3842448998 conn(0x7f949c0ce9d0 msgr2=0x7f949c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:29.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 -- 172.21.15.139:0/3842448998 shutdown_connections 2024-09-13T17:25:29.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 -- 172.21.15.139:0/3842448998 wait complete. 2024-09-13T17:25:29.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 Processor -- start 2024-09-13T17:25:29.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.674+0000 7f94a2800700 1 -- start start 2024-09-13T17:25:29.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f949c0cddd0 0x7f949c137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 0x7f949c1f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c13f000 con 0x7f949c15aff0 2024-09-13T17:25:29.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c13d930 con 0x7f949c144300 2024-09-13T17:25:29.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0aca10 con 0x7f949c0cddd0 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 0x7f949c1f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 0x7f949c1f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57558/0 (socket says 172.21.15.139:57558) 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 -- 172.21.15.139:0/630314208 learned_addr learned my addr 172.21.15.139:0/630314208 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a0a00700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1400700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f949c0cddd0 0x7f949c137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 -- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f949c0cddd0 msgr2=0x7f949c137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f949c0cddd0 0x7f949c137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 -- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 msgr2=0x7f949c13d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c13d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 -- 172.21.15.139:0/630314208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900094b0 con 0x7f949c15aff0 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a0a00700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a1e00700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 0x7f949c1f5460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f949400cc50 tx=0x7f949400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400ad80 con 0x7f949c15aff0 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949400ce50 con 0x7f949c15aff0 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494003c60 con 0x7f949c15aff0 2024-09-13T17:25:29.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c1f59a0 con 0x7f949c15aff0 2024-09-13T17:25:29.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.678+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c0accd0 con 0x7f949c15aff0 2024-09-13T17:25:29.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.682+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0af280 con 0x7f949c15aff0 2024-09-13T17:25:29.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.682+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94940050d0 con 0x7f949c15aff0 2024-09-13T17:25:29.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.686+0000 7f9499600700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f947c066730 0x7f947c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:29.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.686+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9494084640 con 0x7f949c15aff0 2024-09-13T17:25:29.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.686+0000 7f94a1400700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f947c066730 0x7f947c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:29.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.686+0000 7f94a1400700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f947c066730 0x7f947c068bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94900090b0 tx=0x7f9490008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:29.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.690+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94940515e0 con 0x7f949c15aff0 2024-09-13T17:25:29.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.878+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f949c0aefa0 con 0x7f949c15aff0 2024-09-13T17:25:29.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.882+0000 7f9499600700 1 -- 172.21.15.139:0/630314208 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18726 (secure 0 0 0) 0x7f9494054c00 con 0x7f949c15aff0 2024-09-13T17:25:29.888 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:29.888 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":27,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:24:59.687047+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:24:13.832183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:24:14.432049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:24:17.495991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:29.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f947c066730 msgr2=0x7f947c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f947c066730 0x7f947c068bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94900090b0 tx=0x7f9490008030 comp rx=0 tx=0).stop 2024-09-13T17:25:29.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 msgr2=0x7f949c1f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:29.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 0x7f949c1f5460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f949400cc50 tx=0x7f949400a340 comp rx=0 tx=0).stop 2024-09-13T17:25:29.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 shutdown_connections 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f947c066730 0x7f947c068bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f949c15aff0 0x7f949c1f5460 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f949c144300 0x7f949c13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 --2- 172.21.15.139:0/630314208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f949c0cddd0 0x7f949c137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 >> 172.21.15.139:0/630314208 conn(0x7f949c0ce9d0 msgr2=0x7f949c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 shutdown_connections 2024-09-13T17:25:29.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:29.886+0000 7f94a2800700 1 -- 172.21.15.139:0/630314208 wait complete. 2024-09-13T17:25:29.912 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:25:30.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.074+0000 7fa50ca00700 1 Processor -- start 2024-09-13T17:25:30.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.078+0000 7fa50ca00700 1 -- start start 2024-09-13T17:25:30.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.078+0000 7fa50ca00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5080b3e70 0x7fa5080705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.078+0000 7fa50ca00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa50806ca00 0x7fa50806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.078+0000 7fa50ca00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50806d3b0 con 0x7fa5080b4250 2024-09-13T17:25:30.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.078+0000 7fa50ca00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50806c220 con 0x7fa5080b3e70 2024-09-13T17:25:30.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.078+0000 7fa50ca00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa508070f50 con 0x7fa50806ca00 2024-09-13T17:25:30.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5080b3e70 0x7fa5080705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa506a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa5080b4250 0x7fa5080ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38214/0 (socket says 172.21.15.139:38214) 2024-09-13T17:25:30.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5080b3e70 0x7fa5080705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57570/0 (socket says 172.21.15.139:57570) 2024-09-13T17:25:30.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa506a00700 1 -- 172.21.15.139:0/830700310 learned_addr learned my addr 172.21.15.139:0/830700310 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:30.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507e00700 1 --2- 172.21.15.139:0/830700310 >> v2:172.21.15.176:3300/0 conn(0x7fa50806ca00 0x7fa50806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 -- 172.21.15.139:0/830700310 >> v2:172.21.15.176:3300/0 conn(0x7fa50806ca00 msgr2=0x7fa50806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:30.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 --2- 172.21.15.139:0/830700310 >> v2:172.21.15.176:3300/0 conn(0x7fa50806ca00 0x7fa50806ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 -- 172.21.15.139:0/830700310 >> v1:172.21.15.139:6789/0 conn(0x7fa5080b4250 legacy=0x7fa5080ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 -- 172.21.15.139:0/830700310 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508071230 con 0x7fa5080b3e70 2024-09-13T17:25:30.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507e00700 1 --2- 172.21.15.139:0/830700310 >> v2:172.21.15.176:3300/0 conn(0x7fa50806ca00 0x7fa50806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:30.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa506000700 1 -- 172.21.15.139:0/830700310 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914070467 0 0) 0x7fa50806d3b0 con 0x7fa5080b4250 2024-09-13T17:25:30.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa507400700 1 --2- 172.21.15.139:0/830700310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa5080705e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5080cc760 tx=0x7fa4f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e4abf32619cff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:30.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa506000700 1 -- 172.21.15.139:0/830700310 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011830 con 0x7fa5080b3e70 2024-09-13T17:25:30.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa506000700 1 -- 172.21.15.139:0/830700310 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8011990 con 0x7fa5080b3e70 2024-09-13T17:25:30.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa506000700 1 -- 172.21.15.139:0/830700310 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011d40 con 0x7fa5080b3e70 2024-09-13T17:25:30.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 -- 172.21.15.139:0/830700310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 msgr2=0x7fa5080705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 --2- 172.21.15.139:0/830700310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa5080705e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5080cc760 tx=0x7fa4f8009b30 comp rx=0 tx=0).stop 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 -- 172.21.15.139:0/830700310 shutdown_connections 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 --2- 172.21.15.139:0/830700310 >> v2:172.21.15.176:3300/0 conn(0x7fa50806ca00 0x7fa50806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 --2- 172.21.15.139:0/830700310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa5080705e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 -- 172.21.15.139:0/830700310 >> 172.21.15.139:0/830700310 conn(0x7fa50806ece0 msgr2=0x7fa5080b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 -- 172.21.15.139:0/830700310 shutdown_connections 2024-09-13T17:25:30.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.082+0000 7fa50ca00700 1 -- 172.21.15.139:0/830700310 wait complete. 2024-09-13T17:25:30.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 Processor -- start 2024-09-13T17:25:30.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 -- start start 2024-09-13T17:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50806ca00 0x7fa508136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa508166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5080b4250 0x7fa50814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50814de90 con 0x7fa5080b3e70 2024-09-13T17:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50814cfe0 con 0x7fa50806ca00 2024-09-13T17:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa50ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50814d210 con 0x7fa5080b4250 2024-09-13T17:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa508166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa508166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57584/0 (socket says 172.21.15.139:57584) 2024-09-13T17:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 -- 172.21.15.139:0/1828436413 learned_addr learned my addr 172.21.15.139:0/1828436413 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa507400700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50806ca00 0x7fa508136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa507e00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5080b4250 0x7fa50814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 -- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5080b4250 msgr2=0x7fa50814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5080b4250 0x7fa50814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 -- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50806ca00 msgr2=0x7fa508136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50806ca00 0x7fa508136b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa506a00700 1 -- 172.21.15.139:0/1828436413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094b0 con 0x7fa5080b3e70 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.086+0000 7fa507e00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5080b4250 0x7fa50814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa506a00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa508166ee0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c4e0 tx=0x7fa4f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4004ca0 con 0x7fa5080b3e70 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4004e20 con 0x7fa5080b3e70 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4007310 con 0x7fa5080b3e70 2024-09-13T17:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50814d4f0 con 0x7fa5080b3e70 2024-09-13T17:25:30.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50814dab0 con 0x7fa5080b3e70 2024-09-13T17:25:30.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50815d930 con 0x7fa5080b3e70 2024-09-13T17:25:30.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.090+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4f4007470 con 0x7fa5080b3e70 2024-09-13T17:25:30.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.094+0000 7fa4ff400700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa4e8066730 0x7fa4e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.094+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4f4084170 con 0x7fa5080b3e70 2024-09-13T17:25:30.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.094+0000 7fa507400700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa4e8066730 0x7fa4e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.094+0000 7fa507400700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa4e8066730 0x7fa4e8068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80090b0 tx=0x7fa4f8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:30.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.098+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4f4051110 con 0x7fa5080b3e70 2024-09-13T17:25:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.318+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5080aef90 con 0x7fa5080b3e70 2024-09-13T17:25:30.325 INFO:tasks.ceph.mon.a.smithi139.stderr:2024-09-13T17:25:30.322+0000 7fc23b800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:25:30.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.334+0000 7fa4ff400700 1 -- 172.21.15.139:0/1828436413 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa4f4007720 con 0x7fa5080b3e70 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa4e8066730 msgr2=0x7fa4e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa4e8066730 0x7fa4e8068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80090b0 tx=0x7fa4f8008030 comp rx=0 tx=0).stop 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 msgr2=0x7fa508166ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa508166ee0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c4e0 tx=0x7fa4f400c7f0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 shutdown_connections 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa4e8066730 0x7fa4e8068bf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5080b4250 0x7fa50814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080b3e70 0x7fa508166ee0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 --2- 172.21.15.139:0/1828436413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa50806ca00 0x7fa508136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 >> 172.21.15.139:0/1828436413 conn(0x7fa50806ece0 msgr2=0x7fa5080ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 shutdown_connections 2024-09-13T17:25:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.338+0000 7fa50ca00700 1 -- 172.21.15.139:0/1828436413 wait complete. 2024-09-13T17:25:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:25:30.352 INFO:tasks.ceph.mds.b.smithi176.stderr: -5465> 2024-09-13T17:24:16.932+0000 7f07d0800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:25:30.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:25:30.406 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-13T17:25:30.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 Processor -- start 2024-09-13T17:25:30.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 -- start start 2024-09-13T17:25:30.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 0x7fb8400ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb8400b2b70 0x7fb8400b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400cd160 con 0x7fb84006fe10 2024-09-13T17:25:30.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400b3520 con 0x7fb8400b2b70 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb84006fe10 0x7fb8400adbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38226/0 (socket says 172.21.15.139:38226) 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 -- 172.21.15.139:0/83225192 learned_addr learned my addr 172.21.15.139:0/83225192 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83f400700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 0x7fb8400ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.534+0000 7fb845000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400aceb0 con 0x7fb84015cc00 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83fe00700 1 --2- 172.21.15.139:0/83225192 >> v2:172.21.15.139:3300/0 conn(0x7fb8400b2b70 0x7fb8400b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431204366 0 0) 0x7fb8400cd160 con 0x7fb84006fe10 2024-09-13T17:25:30.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8240035d0 con 0x7fb84006fe10 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520116605 0 0) 0x7fb8240035d0 con 0x7fb84006fe10 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 msgr2=0x7fb8400ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 0x7fb8400ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 >> v2:172.21.15.139:3300/0 conn(0x7fb8400b2b70 msgr2=0x7fb8400b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 --2- 172.21.15.139:0/83225192 >> v2:172.21.15.139:3300/0 conn(0x7fb8400b2b70 0x7fb8400b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400ad190 con 0x7fb84006fe10 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7fb828001670 con 0x7fb84006fe10 2024-09-13T17:25:30.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 >> v1:172.21.15.139:6789/0 conn(0x7fb84006fe10 legacy=0x7fb8400adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 0x7fb824003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb824003fd0 0x7fb824004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb824004db0 0x7fb824005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b3520 con 0x7fb824003fd0 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400aceb0 con 0x7fb824004db0 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82400bb60 con 0x7fb84015cc00 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb824003fd0 0x7fb824004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83f400700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 0x7fb824003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 -- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 msgr2=0x7fb824003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84015cc00 0x7fb824003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 -- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb824004db0 msgr2=0x7fb824005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:30.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb824004db0 0x7fb824005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 -- 172.21.15.139:0/83225192 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240035d0 con 0x7fb824003fd0 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb836a00700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb824003fd0 0x7fb824004870 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c2f0 tx=0x7fb8240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d741ad96d6755c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828007c30 con 0x7fb824003fd0 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800ce50 con 0x7fb824003fd0 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.538+0000 7fb83ea00700 1 -- 172.21.15.139:0/83225192 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828005bc0 con 0x7fb824003fd0 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 -- 172.21.15.139:0/83225192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb824003fd0 msgr2=0x7fb824004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 --2- 172.21.15.139:0/83225192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb824003fd0 0x7fb824004870 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c2f0 tx=0x7fb8240058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb83fe00700 1 -- 172.21.15.139:0/83225192 reap_dead start 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 -- 172.21.15.139:0/83225192 shutdown_connections 2024-09-13T17:25:30.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 -- 172.21.15.139:0/83225192 >> 172.21.15.139:0/83225192 conn(0x7fb8400ce9d0 msgr2=0x7fb8400cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:30.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 -- 172.21.15.139:0/83225192 shutdown_connections 2024-09-13T17:25:30.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 -- 172.21.15.139:0/83225192 wait complete. 2024-09-13T17:25:30.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.542+0000 7fb845000700 1 Processor -- start 2024-09-13T17:25:30.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 -- start start 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb824003fd0 0x7fb840153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 0x7fb840156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb84015e030 0x7fb84015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84015ea00 con 0x7fb840152c80 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84006b500 con 0x7fb84015e030 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb840153100 con 0x7fb824003fd0 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 0x7fb840156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 0x7fb840156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57610/0 (socket says 172.21.15.139:57610) 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 -- 172.21.15.139:0/2562021685 learned_addr learned my addr 172.21.15.139:0/2562021685 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:30.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb83f400700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb824003fd0 0x7fb840153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb83fe00700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb84015e030 0x7fb84015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 -- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb824003fd0 msgr2=0x7fb840153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb824003fd0 0x7fb840153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 -- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb84015e030 msgr2=0x7fb84015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb84015e030 0x7fb84015e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 -- 172.21.15.139:0/2562021685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8401f29f0 con 0x7fb840152c80 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb836a00700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 0x7fb840156700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c8e0 tx=0x7fb828001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828001630 con 0x7fb840152c80 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8280070d0 con 0x7fb840152c80 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb840157070 con 0x7fb840152c80 2024-09-13T17:25:30.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828007480 con 0x7fb840152c80 2024-09-13T17:25:30.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.546+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84006ba30 con 0x7fb840152c80 2024-09-13T17:25:30.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.550+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8400714c0 con 0x7fb840152c80 2024-09-13T17:25:30.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.550+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8280075e0 con 0x7fb840152c80 2024-09-13T17:25:30.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.550+0000 7fb837e00700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb81c066730 0x7fb81c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:30.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.554+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fb828085550 con 0x7fb840152c80 2024-09-13T17:25:30.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.554+0000 7fb83f400700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb81c066730 0x7fb81c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:30.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.554+0000 7fb83f400700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb81c066730 0x7fb81c068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8400b05d0 tx=0x7fb83000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:30.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.558+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb828052540 con 0x7fb840152c80 2024-09-13T17:25:30.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:30.774+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb8400b2fe0 con 0x7fb840152c80 2024-09-13T17:25:31.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.338+0000 7fb837e00700 1 -- 172.21.15.139:0/2562021685 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb828055b60 con 0x7fb840152c80 2024-09-13T17:25:31.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.342+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb81c066730 msgr2=0x7fb81c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.342+0000 7fb845000700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb81c066730 0x7fb81c068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8400b05d0 tx=0x7fb83000b040 comp rx=0 tx=0).stop 2024-09-13T17:25:31.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.342+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 msgr2=0x7fb840156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.342+0000 7fb845000700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 0x7fb840156700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c8e0 tx=0x7fb828001a00 comp rx=0 tx=0).stop 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 shutdown_connections 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fb81c066730 0x7fb81c068bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb84015e030 0x7fb84015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb840152c80 0x7fb840156700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 --2- 172.21.15.139:0/2562021685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb824003fd0 0x7fb840153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 >> 172.21.15.139:0/2562021685 conn(0x7fb8400ce9d0 msgr2=0x7fb84015a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 shutdown_connections 2024-09-13T17:25:31.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.346+0000 7fb845000700 1 -- 172.21.15.139:0/2562021685 wait complete. 2024-09-13T17:25:31.374 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:25:31.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.562+0000 7fa6f3e00700 1 Processor -- start 2024-09-13T17:25:31.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.562+0000 7fa6f3e00700 1 -- start start 2024-09-13T17:25:31.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.562+0000 7fa6f3e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa6f414ab50 0x7fa6f406fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:31.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.562+0000 7fa6f3e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f4070480 con 0x7fa6f40ce0d0 2024-09-13T17:25:31.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.562+0000 7fa6f3e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f4070760 con 0x7fa6f40b3960 2024-09-13T17:25:31.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.562+0000 7fa6f3e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f4070a40 con 0x7fa6f414ab50 2024-09-13T17:25:31.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f2a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa6f414ab50 0x7fa6f406fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:31.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa6f40ce0d0 0x7fa6f406b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38234/0 (socket says 172.21.15.139:38234) 2024-09-13T17:25:31.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3400700 1 -- 172.21.15.139:0/2029854286 learned_addr learned my addr 172.21.15.139:0/2029854286 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:31.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f2a00700 1 -- 172.21.15.139:0/2029854286 >> v1:172.21.15.176:6789/0 conn(0x7fa6f40b3960 legacy=0x7fa6f40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f2a00700 1 -- 172.21.15.139:0/2029854286 >> v1:172.21.15.139:6789/0 conn(0x7fa6f40ce0d0 legacy=0x7fa6f406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f2a00700 1 -- 172.21.15.139:0/2029854286 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4070d20 con 0x7fa6f414ab50 2024-09-13T17:25:31.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f2a00700 1 --2- 172.21.15.139:0/2029854286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f406fe10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009850 tx=0x7fa6e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20918e1065c5e554 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:31.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f1600700 1 -- 172.21.15.139:0/2029854286 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4011830 con 0x7fa6f414ab50 2024-09-13T17:25:31.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f1600700 1 -- 172.21.15.139:0/2029854286 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4011990 con 0x7fa6f414ab50 2024-09-13T17:25:31.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f1600700 1 -- 172.21.15.139:0/2029854286 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4011d20 con 0x7fa6f414ab50 2024-09-13T17:25:31.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3e00700 1 -- 172.21.15.139:0/2029854286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 msgr2=0x7fa6f406fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/2029854286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f406fe10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009850 tx=0x7fa6e4009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:31.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3e00700 1 -- 172.21.15.139:0/2029854286 shutdown_connections 2024-09-13T17:25:31.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/2029854286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f406fe10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3e00700 1 -- 172.21.15.139:0/2029854286 >> 172.21.15.139:0/2029854286 conn(0x7fa6f40cb5b0 msgr2=0x7fa6f40cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:31.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.566+0000 7fa6f3e00700 1 -- 172.21.15.139:0/2029854286 shutdown_connections 2024-09-13T17:25:31.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.570+0000 7fa6f3e00700 1 -- 172.21.15.139:0/2029854286 wait complete. 2024-09-13T17:25:31.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 Processor -- start 2024-09-13T17:25:31.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 -- start start 2024-09-13T17:25:31.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 0x7fa6f4141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:31.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f40ce0d0 0x7fa6f4164130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:31.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:31.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f41fae90 con 0x7fa6f40b3960 2024-09-13T17:25:31.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4164670 con 0x7fa6f414ab50 2024-09-13T17:25:31.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f41fa280 con 0x7fa6f40ce0d0 2024-09-13T17:25:31.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 0x7fa6f4141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:31.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 0x7fa6f4141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57626/0 (socket says 172.21.15.139:57626) 2024-09-13T17:25:31.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 -- 172.21.15.139:0/3253831069 learned_addr learned my addr 172.21.15.139:0/3253831069 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2000700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f40ce0d0 0x7fa6f4164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f3400700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 -- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f40ce0d0 msgr2=0x7fa6f4164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f40ce0d0 0x7fa6f4164130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 -- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 msgr2=0x7fa6f415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:31.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.574+0000 7fa6f2a00700 1 -- 172.21.15.139:0/3253831069 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e40094b0 con 0x7fa6f40b3960 2024-09-13T17:25:31.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6f2a00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 0x7fa6f4141c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009fd0 tx=0x7fa6e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:31.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40036c0 con 0x7fa6f40b3960 2024-09-13T17:25:31.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e401e070 con 0x7fa6f40b3960 2024-09-13T17:25:31.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4003a80 con 0x7fa6f40b3960 2024-09-13T17:25:31.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f41fa560 con 0x7fa6f40b3960 2024-09-13T17:25:31.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f41fab20 con 0x7fa6f40b3960 2024-09-13T17:25:31.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.578+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f406fe10 con 0x7fa6f40b3960 2024-09-13T17:25:31.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.582+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6e4003be0 con 0x7fa6f40b3960 2024-09-13T17:25:31.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.582+0000 7fa6eaa00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa6d4066730 0x7fa6d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:31.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.582+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa6e4020070 con 0x7fa6f40b3960 2024-09-13T17:25:31.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.582+0000 7fa6f2000700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa6d4066730 0x7fa6d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:31.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.582+0000 7fa6f2000700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa6d4066730 0x7fa6d4068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406ce40 tx=0x7fa6e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:31.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.590+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6e4052aa0 con 0x7fa6f40b3960 2024-09-13T17:25:31.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:31.770+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6f415d010 con 0x7fa6f40b3960 2024-09-13T17:25:32.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.346+0000 7fa6eaa00700 1 -- 172.21.15.139:0/3253831069 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa6e402a0d0 con 0x7fa6f40b3960 2024-09-13T17:25:32.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa6d4066730 msgr2=0x7fa6d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa6d4066730 0x7fa6d4068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406ce40 tx=0x7fa6e0009040 comp rx=0 tx=0).stop 2024-09-13T17:25:32.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 msgr2=0x7fa6f4141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 0x7fa6f4141c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009fd0 tx=0x7fa6e4004770 comp rx=0 tx=0).stop 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 shutdown_connections 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa6d4066730 0x7fa6d4068bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f414ab50 0x7fa6f415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f40ce0d0 0x7fa6f4164130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 --2- 172.21.15.139:0/3253831069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6f40b3960 0x7fa6f4141c70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 >> 172.21.15.139:0/3253831069 conn(0x7fa6f40cb5b0 msgr2=0x7fa6f40b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:32.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 shutdown_connections 2024-09-13T17:25:32.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.350+0000 7fa6f3e00700 1 -- 172.21.15.139:0/3253831069 wait complete. 2024-09-13T17:25:32.358 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:25:32.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:25:32.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.550+0000 7f63a1000700 1 Processor -- start 2024-09-13T17:25:32.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.550+0000 7f63a1000700 1 -- start start 2024-09-13T17:25:32.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f63a1000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f639c163690 0x7f639c165a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f63a1000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639c151e50 con 0x7f639c0cd3b0 2024-09-13T17:25:32.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f63a1000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639c0b4750 con 0x7f639c0d0570 2024-09-13T17:25:32.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f63a1000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639c0d09d0 con 0x7f639c163690 2024-09-13T17:25:32.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639b400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f639c0cd3b0 0x7f639c15af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38248/0 (socket says 172.21.15.139:38248) 2024-09-13T17:25:32.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639b400700 1 -- 172.21.15.139:0/2934213455 learned_addr learned my addr 172.21.15.139:0/2934213455 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:32.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639be00700 1 --2- 172.21.15.139:0/2934213455 >> v2:172.21.15.176:3300/0 conn(0x7f639c163690 0x7f639c165a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711797715 0 0) 0x7f639c151e50 con 0x7f639c0cd3b0 2024-09-13T17:25:32.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63800035d0 con 0x7f639c0cd3b0 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979334756 0 0) 0x7f63800035d0 con 0x7f639c0cd3b0 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 >> v2:172.21.15.176:3300/0 conn(0x7f639c163690 msgr2=0x7f639c165a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 --2- 172.21.15.139:0/2934213455 >> v2:172.21.15.176:3300/0 conn(0x7f639c163690 0x7f639c165a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 >> v1:172.21.15.176:6789/0 conn(0x7f639c0d0570 legacy=0x7f639c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c0b5ed0 con 0x7f639c0cd3b0 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f638c001670 con 0x7f639c0cd3b0 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 >> v1:172.21.15.139:6789/0 conn(0x7f639c0cd3b0 legacy=0x7f639c15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6380003a20 0x7f6380003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6380004870 0x7f6380004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380005230 0x7f638000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c0d09d0 con 0x7f6380004870 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638000c0d0 con 0x7f6380003a20 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638000c290 con 0x7f6380005230 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.554+0000 7f639aa00700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6380004870 0x7f6380004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639b400700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6380003a20 0x7f6380003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639be00700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380005230 0x7f638000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639aa00700 1 -- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380005230 msgr2=0x7f638000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639aa00700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380005230 0x7f638000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639aa00700 1 -- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6380003a20 msgr2=0x7f6380003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:32.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639aa00700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6380003a20 0x7f6380003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639aa00700 1 -- 172.21.15.139:0/2934213455 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63800035d0 con 0x7f6380004870 2024-09-13T17:25:32.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639be00700 1 -- 172.21.15.139:0/2934213455 reap_dead start 2024-09-13T17:25:32.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639b400700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6380003a20 0x7f6380003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:32.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639aa00700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6380004870 0x7f6380004cf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f63880017e0 tx=0x7f63800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e1ade4d93b3bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880052d0 con 0x7f6380004870 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388005450 con 0x7f6380004870 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f639a000700 1 -- 172.21.15.139:0/2934213455 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880038e0 con 0x7f6380004870 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 -- 172.21.15.139:0/2934213455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6380004870 msgr2=0x7f6380004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6380004870 0x7f6380004cf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f63880017e0 tx=0x7f63800058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 -- 172.21.15.139:0/2934213455 shutdown_connections 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 --2- 172.21.15.139:0/2934213455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6380004870 0x7f6380004cf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 -- 172.21.15.139:0/2934213455 >> 172.21.15.139:0/2934213455 conn(0x7f639c072030 msgr2=0x7f639c072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 -- 172.21.15.139:0/2934213455 shutdown_connections 2024-09-13T17:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.558+0000 7f63a1000700 1 -- 172.21.15.139:0/2934213455 wait complete. 2024-09-13T17:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 Processor -- start 2024-09-13T17:25:32.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 -- start start 2024-09-13T17:25:32.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380004870 0x7f639c14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639c06cf10 0x7f639c1f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 0x7f639c0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c1f5c10 con 0x7f639c1f6380 2024-09-13T17:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c14c000 con 0x7f639c06cf10 2024-09-13T17:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f63a1000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c06d4b0 con 0x7f6380004870 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.562+0000 7f639be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 0x7f639c0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 0x7f639c0b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57648/0 (socket says 172.21.15.139:57648) 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 -- 172.21.15.139:0/68408829 learned_addr learned my addr 172.21.15.139:0/68408829 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639aa00700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639c06cf10 0x7f639c1f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639b400700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380004870 0x7f639c14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 -- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380004870 msgr2=0x7f639c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380004870 0x7f639c14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 -- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639c06cf10 msgr2=0x7f639c1f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639c06cf10 0x7f639c1f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 -- 172.21.15.139:0/68408829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c06d790 con 0x7f639c1f6380 2024-09-13T17:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f639be00700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 0x7f639c0b28d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f639c0b4030 tx=0x7f6394009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639400e070 con 0x7f639c1f6380 2024-09-13T17:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394003d10 con 0x7f639c1f6380 2024-09-13T17:25:32.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c06da70 con 0x7f639c1f6380 2024-09-13T17:25:32.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394011730 con 0x7f639c1f6380 2024-09-13T17:25:32.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c1f2380 con 0x7f639c1f6380 2024-09-13T17:25:32.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.566+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c15bfd0 con 0x7f639c1f6380 2024-09-13T17:25:32.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.570+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6394011890 con 0x7f639c1f6380 2024-09-13T17:25:32.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.570+0000 7f6393400700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f637c066760 0x7f637c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:32.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.570+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f63940846d0 con 0x7f639c1f6380 2024-09-13T17:25:32.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.574+0000 7f639b400700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f637c066760 0x7f637c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:32.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.574+0000 7f639b400700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f637c066760 0x7f637c068c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f638c001c80 tx=0x7f638c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:32.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.578+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6394051740 con 0x7f639c1f6380 2024-09-13T17:25:32.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:32.762+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f639c0cc700 con 0x7f639c1f6380 2024-09-13T17:25:33.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.350+0000 7f6393400700 1 -- 172.21.15.139:0/68408829 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6394054d60 con 0x7f639c1f6380 2024-09-13T17:25:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f637c066760 msgr2=0x7f637c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f637c066760 0x7f637c068c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f638c001c80 tx=0x7f638c007040 comp rx=0 tx=0).stop 2024-09-13T17:25:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 msgr2=0x7f639c0b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 0x7f639c0b28d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f639c0b4030 tx=0x7f6394009f70 comp rx=0 tx=0).stop 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 shutdown_connections 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f637c066760 0x7f637c068c20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f639c1f6380 0x7f639c0b28d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639c06cf10 0x7f639c1f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 --2- 172.21.15.139:0/68408829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6380004870 0x7f639c14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 >> 172.21.15.139:0/68408829 conn(0x7f639c072030 msgr2=0x7f639c06f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:33.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 shutdown_connections 2024-09-13T17:25:33.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.358+0000 7f63a1000700 1 -- 172.21.15.139:0/68408829 wait complete. 2024-09-13T17:25:33.365 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' removed 2024-09-13T17:25:33.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T17:25:33.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.566+0000 7fa242200700 1 Processor -- start 2024-09-13T17:25:33.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.566+0000 7fa242200700 1 -- start start 2024-09-13T17:25:33.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa242200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 0x7fa23c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa242200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c0b2760 con 0x7fa23c15c8f0 2024-09-13T17:25:33.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa242200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c0b2a40 con 0x7fa23c071620 2024-09-13T17:25:33.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa242200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0b2d20 con 0x7fa23c15ccd0 2024-09-13T17:25:33.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa240e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa23c15c8f0 0x7fa23c0ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38264/0 (socket says 172.21.15.139:38264) 2024-09-13T17:25:33.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa240e00700 1 -- 172.21.15.139:0/2183268781 learned_addr learned my addr 172.21.15.139:0/2183268781 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:33.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23be00700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 0x7fa23c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865077389 0 0) 0x7fa23c0b2760 con 0x7fa23c15c8f0 2024-09-13T17:25:33.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2240035d0 con 0x7fa23c15c8f0 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465860898 0 0) 0x7fa23c0b2a40 con 0x7fa23c071620 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c0b2760 con 0x7fa23c071620 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263573298 0 0) 0x7fa2240035d0 con 0x7fa23c15c8f0 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 msgr2=0x7fa23c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 0x7fa23c06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 >> v1:172.21.15.176:6789/0 conn(0x7fa23c071620 legacy=0x7fa23c0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0b3000 con 0x7fa23c15c8f0 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7fa230001670 con 0x7fa23c15c8f0 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 >> v1:172.21.15.139:6789/0 conn(0x7fa23c15c8f0 legacy=0x7fa23c0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa224003be0 0x7fa224003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224004870 0x7fa224004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 0x7fa224005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0b2d20 con 0x7fa224003be0 2024-09-13T17:25:33.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22400bb40 con 0x7fa224004870 2024-09-13T17:25:33.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.570+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22400bd00 con 0x7fa23c15ccd0 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa224003be0 0x7fa224003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa23be00700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224004870 0x7fa224004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa241800700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 0x7fa224005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 -- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 msgr2=0x7fa224005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c15ccd0 0x7fa224005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 -- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224004870 msgr2=0x7fa224004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:33.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224004870 0x7fa224004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 -- 172.21.15.139:0/2183268781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2240035d0 con 0x7fa224003be0 2024-09-13T17:25:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa240e00700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa224003be0 0x7fa224003fe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa23000c210 tx=0x7fa2240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701b15be43f67fce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000cdb0 con 0x7fa224003be0 2024-09-13T17:25:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230005980 con 0x7fa224003be0 2024-09-13T17:25:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa23b400700 1 -- 172.21.15.139:0/2183268781 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230005d30 con 0x7fa224003be0 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa242200700 1 -- 172.21.15.139:0/2183268781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa224003be0 msgr2=0x7fa224003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa242200700 1 --2- 172.21.15.139:0/2183268781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa224003be0 0x7fa224003fe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa23000c210 tx=0x7fa2240058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa241800700 1 -- 172.21.15.139:0/2183268781 reap_dead start 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa242200700 1 -- 172.21.15.139:0/2183268781 shutdown_connections 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa242200700 1 -- 172.21.15.139:0/2183268781 >> 172.21.15.139:0/2183268781 conn(0x7fa23c06e250 msgr2=0x7fa23c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa242200700 1 -- 172.21.15.139:0/2183268781 shutdown_connections 2024-09-13T17:25:33.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.574+0000 7fa242200700 1 -- 172.21.15.139:0/2183268781 wait complete. 2024-09-13T17:25:33.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.578+0000 7fa242200700 1 Processor -- start 2024-09-13T17:25:33.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.578+0000 7fa242200700 1 -- start start 2024-09-13T17:25:33.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa242200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224003be0 0x7fa23c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa242200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 0x7fa23c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa242200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa23c0ce630 0x7fa23c13d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa242200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c15bc60 con 0x7fa23c0ce630 2024-09-13T17:25:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa242200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c15bf40 con 0x7fa224003be0 2024-09-13T17:25:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa242200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0cd8f0 con 0x7fa23c0af820 2024-09-13T17:25:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 0x7fa23c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa241800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa23c0ce630 0x7fa23c13d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa240e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224003be0 0x7fa23c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 0x7fa23c0ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:49702/0 (socket says 172.21.15.139:49702) 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 -- 172.21.15.139:0/2421047141 learned_addr learned my addr 172.21.15.139:0/2421047141 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 -- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224003be0 msgr2=0x7fa23c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224003be0 0x7fa23c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 -- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa23c0ce630 msgr2=0x7fa23c13d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa23c0ce630 0x7fa23c13d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 -- 172.21.15.139:0/2421047141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0cdbd0 con 0x7fa23c0af820 2024-09-13T17:25:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.582+0000 7fa23be00700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 0x7fa23c0ce0f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2280119b0 tx=0x7fa228011cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228011e50 con 0x7fa23c0af820 2024-09-13T17:25:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800f940 con 0x7fa23c0af820 2024-09-13T17:25:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c0cd510 con 0x7fa23c0af820 2024-09-13T17:25:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800fcd0 con 0x7fa23c0af820 2024-09-13T17:25:33.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c13e010 con 0x7fa23c0af820 2024-09-13T17:25:33.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0cde10 con 0x7fa23c0af820 2024-09-13T17:25:33.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.586+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa228014440 con 0x7fa23c0af820 2024-09-13T17:25:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.590+0000 7fa238c00700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa21c066760 0x7fa21c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.590+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fa228084880 con 0x7fa23c0af820 2024-09-13T17:25:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.590+0000 7fa240e00700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa21c066760 0x7fa21c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:33.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.590+0000 7fa240e00700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa21c066760 0x7fa21c068c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2300018b0 tx=0x7fa23000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.598+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa23c0cde10 con 0x7fa23c0af820 2024-09-13T17:25:33.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:33.798+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa23c0b2a40 con 0x7fa23c0af820 2024-09-13T17:25:34.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.374+0000 7fa238c00700 1 -- 172.21.15.139:0/2421047141 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa228055500 con 0x7fa23c0af820 2024-09-13T17:25:34.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa21c066760 msgr2=0x7fa21c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:34.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa21c066760 0x7fa21c068c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2300018b0 tx=0x7fa23000a000 comp rx=0 tx=0).stop 2024-09-13T17:25:34.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 msgr2=0x7fa23c0ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:34.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 0x7fa23c0ce0f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2280119b0 tx=0x7fa228011cc0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 shutdown_connections 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa21c066760 0x7fa21c068c20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa23c0ce630 0x7fa23c13d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23c0af820 0x7fa23c0ce0f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 --2- 172.21.15.139:0/2421047141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa224003be0 0x7fa23c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 >> 172.21.15.139:0/2421047141 conn(0x7fa23c06e250 msgr2=0x7fa23c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 shutdown_connections 2024-09-13T17:25:34.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.382+0000 7fa242200700 1 -- 172.21.15.139:0/2421047141 wait complete. 2024-09-13T17:25:34.387 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data_ec' removed 2024-09-13T17:25:34.407 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:25:34.407 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:25:34.407 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:25:34.407 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:25:34.408 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:25:34.408 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:25:34.408 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:25:34.408 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:25:34.408 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:25:34.408 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:25:34.408 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:25:34.409 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:25:34.409 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:25:34.409 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:25:34.409 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:25:34.409 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:25:34.434 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:25:34.435 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:25:34.437 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:25:34.438 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:25:34.439 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:25:34.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:25:34.441 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:25:34.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:25:34.486 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:25:34.486 DEBUG:teuthology.parallel:result is None 2024-09-13T17:25:34.488 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:25:34.489 DEBUG:teuthology.parallel:result is None 2024-09-13T17:25:34.490 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:25:34.491 DEBUG:teuthology.parallel:result is None 2024-09-13T17:25:34.491 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:25:34.492 DEBUG:teuthology.parallel:result is None 2024-09-13T17:25:34.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:25:34.602 INFO:tasks.ceph.mds.a.smithi139.stdout:starting mds.a at 2024-09-13T17:25:34.602 INFO:tasks.ceph.mds.c.smithi139.stdout:starting mds.c at 2024-09-13T17:25:34.608 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-13T17:25:34.615 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-13T17:25:34.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 Processor -- start 2024-09-13T17:25:34.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 -- start start 2024-09-13T17:25:34.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac157620 0x7fa3ac0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:34.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3ac06f740 0x7fa3ac15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:34.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0ccd10 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac0cc750 con 0x7fa3ac06f740 2024-09-13T17:25:34.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3b0c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0cd6e0 con 0x7fa3ac157620 2024-09-13T17:25:34.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3aa800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3ac06f740 0x7fa3ac15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a9400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa3ac15d3c0 0x7fa3ac06f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52542/0 (socket says 172.21.15.139:52542) 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a9400700 1 -- 172.21.15.139:0/1932655956 learned_addr learned my addr 172.21.15.139:0/1932655956 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a9e00700 1 --2- 172.21.15.139:0/1932655956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac157620 0x7fa3ac0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a8a00700 1 -- 172.21.15.139:0/1932655956 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548416249 0 0) 0x7fa3ac0ccd10 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a8a00700 1 -- 172.21.15.139:0/1932655956 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3900035d0 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3aa800700 1 -- 172.21.15.139:0/1932655956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac157620 msgr2=0x7fa3ac0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3aa800700 1 --2- 172.21.15.139:0/1932655956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac157620 0x7fa3ac0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3aa800700 1 -- 172.21.15.139:0/1932655956 >> v1:172.21.15.139:6789/0 conn(0x7fa3ac15d3c0 legacy=0x7fa3ac06f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3aa800700 1 -- 172.21.15.139:0/1932655956 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac15df00 con 0x7fa3ac06f740 2024-09-13T17:25:34.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3aa800700 1 --2- 172.21.15.139:0/1932655956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac06f740 0x7fa3ac15d820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009d90 tx=0x7fa3a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bba171ebddbebd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a8a00700 1 -- 172.21.15.139:0/1932655956 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400e070 con 0x7fa3ac06f740 2024-09-13T17:25:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a8a00700 1 -- 172.21.15.139:0/1932655956 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400bb20 con 0x7fa3ac06f740 2024-09-13T17:25:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.670+0000 7fa3a8a00700 1 -- 172.21.15.139:0/1932655956 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400be90 con 0x7fa3ac06f740 2024-09-13T17:25:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 -- 172.21.15.139:0/1932655956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac06f740 msgr2=0x7fa3ac15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/1932655956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac06f740 0x7fa3ac15d820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009d90 tx=0x7fa3a400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 -- 172.21.15.139:0/1932655956 shutdown_connections 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/1932655956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac06f740 0x7fa3ac15d820 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/1932655956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac157620 0x7fa3ac0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 -- 172.21.15.139:0/1932655956 >> 172.21.15.139:0/1932655956 conn(0x7fa3ac0b1ad0 msgr2=0x7fa3ac0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 -- 172.21.15.139:0/1932655956 shutdown_connections 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 -- 172.21.15.139:0/1932655956 wait complete. 2024-09-13T17:25:34.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 Processor -- start 2024-09-13T17:25:34.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.674+0000 7fa3b0c00700 1 -- start start 2024-09-13T17:25:34.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06f740 0x7fa3ac1f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:34.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac157620 0x7fa3ac153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:34.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 0x7fa3ac0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:34.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1f2e70 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac153e70 con 0x7fa3ac157620 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac158910 con 0x7fa3ac06f740 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 0x7fa3ac0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 0x7fa3ac0a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46640/0 (socket says 172.21.15.139:46640) 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 -- 172.21.15.139:0/3896221073 learned_addr learned my addr 172.21.15.139:0/3896221073 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3a9e00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06f740 0x7fa3ac1f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3a9400700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac157620 0x7fa3ac153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 -- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06f740 msgr2=0x7fa3ac1f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06f740 0x7fa3ac1f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 -- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac157620 msgr2=0x7fa3ac153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac157620 0x7fa3ac153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 -- 172.21.15.139:0/3896221073 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009a70 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3a9e00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06f740 0x7fa3ac1f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:34.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3aa800700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 0x7fa3ac0a9770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4014040 tx=0x7fa3a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:34.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4004960 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4020070 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40276c0 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac158bf0 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac1591b0 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.678+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac0cd1a0 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.682+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3a4012430 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.682+0000 7fa3a2000700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:34.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.682+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa3a4022070 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.682+0000 7fa3a9e00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:34.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.686+0000 7fa3a9e00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0aed00 tx=0x7fa39c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:34.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.690+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3a40535f0 con 0x7fa3ac15d3c0 2024-09-13T17:25:34.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:34.882+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa3ac0b05a0 con 0x7fa3ac15d3c0 2024-09-13T17:25:35.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.650+0000 7fa3a2000700 1 -- 172.21.15.139:0/3896221073 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa3a4056c10 con 0x7fa3ac15d3c0 2024-09-13T17:25:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 msgr2=0x7fa38c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0aed00 tx=0x7fa39c008040 comp rx=0 tx=0).stop 2024-09-13T17:25:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 msgr2=0x7fa3ac0a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 0x7fa3ac0a9770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4014040 tx=0x7fa3a4004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 shutdown_connections 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fa38c066730 0x7fa38c068bf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac15d3c0 0x7fa3ac0a9770 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3ac157620 0x7fa3ac153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 --2- 172.21.15.139:0/3896221073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3ac06f740 0x7fa3ac1f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 >> 172.21.15.139:0/3896221073 conn(0x7fa3ac0b1ad0 msgr2=0x7fa3ac0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 shutdown_connections 2024-09-13T17:25:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.654+0000 7fa3b0c00700 1 -- 172.21.15.139:0/3896221073 wait complete. 2024-09-13T17:25:35.661 INFO:teuthology.orchestra.run.smithi139.stderr: removed all blocklist entries 2024-09-13T17:25:35.683 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:25:35.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.846+0000 7f832be00700 1 Processor -- start 2024-09-13T17:25:35.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.846+0000 7f832be00700 1 -- start start 2024-09-13T17:25:35.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.846+0000 7f832be00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f832c15aff0 0x7f832c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:35.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.846+0000 7f832be00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c070140 con 0x7f832c144300 2024-09-13T17:25:35.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.846+0000 7f832be00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c070420 con 0x7f832c0cdc00 2024-09-13T17:25:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.846+0000 7f832be00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0ce0b0 con 0x7f832c15aff0 2024-09-13T17:25:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832aa00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f832c144300 0x7f832c06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52558/0 (socket says 172.21.15.139:52558) 2024-09-13T17:25:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832aa00700 1 -- 172.21.15.139:0/198788604 learned_addr learned my addr 172.21.15.139:0/198788604 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f8322000700 1 --2- 172.21.15.139:0/198788604 >> v2:172.21.15.176:3300/0 conn(0x7f832c15aff0 0x7f832c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832a000700 1 -- 172.21.15.139:0/198788604 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067227241 0 0) 0x7f832c070140 con 0x7f832c144300 2024-09-13T17:25:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832a000700 1 -- 172.21.15.139:0/198788604 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83100035d0 con 0x7f832c144300 2024-09-13T17:25:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f8322000700 1 -- 172.21.15.139:0/198788604 >> v1:172.21.15.176:6789/0 conn(0x7f832c0cdc00 legacy=0x7f832c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832a000700 1 -- 172.21.15.139:0/198788604 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833466985 0 0) 0x7f832c070420 con 0x7f832c0cdc00 2024-09-13T17:25:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f8322000700 1 -- 172.21.15.139:0/198788604 >> v1:172.21.15.139:6789/0 conn(0x7f832c144300 legacy=0x7f832c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f8322000700 1 -- 172.21.15.139:0/198788604 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c070700 con 0x7f832c15aff0 2024-09-13T17:25:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f8322000700 1 --2- 172.21.15.139:0/198788604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c15aff0 0x7f832c0cd6c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8314009880 tx=0x7f8314009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122e4b0ef1cab3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832a000700 1 -- 172.21.15.139:0/198788604 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011830 con 0x7f832c15aff0 2024-09-13T17:25:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832a000700 1 -- 172.21.15.139:0/198788604 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314011990 con 0x7f832c15aff0 2024-09-13T17:25:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.850+0000 7f832a000700 1 -- 172.21.15.139:0/198788604 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011d20 con 0x7f832c15aff0 2024-09-13T17:25:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 -- 172.21.15.139:0/198788604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c15aff0 msgr2=0x7f832c0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 --2- 172.21.15.139:0/198788604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c15aff0 0x7f832c0cd6c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8314009880 tx=0x7f8314009b90 comp rx=0 tx=0).stop 2024-09-13T17:25:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 -- 172.21.15.139:0/198788604 shutdown_connections 2024-09-13T17:25:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 --2- 172.21.15.139:0/198788604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c15aff0 0x7f832c0cd6c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 -- 172.21.15.139:0/198788604 >> 172.21.15.139:0/198788604 conn(0x7f832c0ce9d0 msgr2=0x7f832c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 -- 172.21.15.139:0/198788604 shutdown_connections 2024-09-13T17:25:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 -- 172.21.15.139:0/198788604 wait complete. 2024-09-13T17:25:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 Processor -- start 2024-09-13T17:25:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.854+0000 7f832be00700 1 -- start start 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 0x7f832c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c144300 0x7f832c13e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832c15aff0 0x7f832c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c13df60 con 0x7f832c0cdc00 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c13d350 con 0x7f832c144300 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c13d630 con 0x7f832c15aff0 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 0x7f832c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 0x7f832c154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46652/0 (socket says 172.21.15.139:46652) 2024-09-13T17:25:35.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 -- 172.21.15.139:0/2998089609 learned_addr learned my addr 172.21.15.139:0/2998089609 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f8322000700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c144300 0x7f832c13e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832b400700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832c15aff0 0x7f832c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 -- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832c15aff0 msgr2=0x7f832c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832c15aff0 0x7f832c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 -- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c144300 msgr2=0x7f832c13e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c144300 0x7f832c13e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 -- 172.21.15.139:0/2998089609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140094b0 con 0x7f832c0cdc00 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832aa00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 0x7f832c154d50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f831c00c700 tx=0x7f831c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:35.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c005d90 con 0x7f832c0cdc00 2024-09-13T17:25:35.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c0070d0 con 0x7f832c0cdc00 2024-09-13T17:25:35.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c13d910 con 0x7f832c0cdc00 2024-09-13T17:25:35.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c007480 con 0x7f832c0cdc00 2024-09-13T17:25:35.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.858+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c155290 con 0x7f832c0cdc00 2024-09-13T17:25:35.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.862+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c0cedb0 con 0x7f832c0cdc00 2024-09-13T17:25:35.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.862+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f831c0075e0 con 0x7f832c0cdc00 2024-09-13T17:25:35.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.866+0000 7f8323400700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8308066730 0x7f8308068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:35.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.866+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f831c0833d0 con 0x7f832c0cdc00 2024-09-13T17:25:35.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.866+0000 7f8322000700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8308066730 0x7f8308068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:35.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.866+0000 7f8322000700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8308066730 0x7f8308068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8314000c00 tx=0x7f8314008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:35.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:35.870+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f831c050940 con 0x7f832c0cdc00 2024-09-13T17:25:36.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.218+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f832c1446e0 con 0x7f832c0cdc00 2024-09-13T17:25:36.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.218+0000 7f8323400700 1 -- 172.21.15.139:0/2998089609 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f831c053f60 con 0x7f832c0cdc00 2024-09-13T17:25:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:36.225 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:25:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: "auth_dump": [ 2024-09-13T17:25:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "mds.a", 2024-09-13T17:25:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRmdOWfERAAyhpOow7qplI6Bxgch9MGPQ==", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow *", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow *", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "mds.b", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRmYi2+JBAAB+vmJElMfVLbLYxNDuKhYQ==", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.226 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow *", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow *", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "mds.c", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRmmc1tHBAAHwemx+1QjSg+Op9OzzJaUA==", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow *", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow *", 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "mds.d", 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRmk69qLxAA5swhp2q2a9P4bqO6PY8mXA==", 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow *", 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow *", 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.0", 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAGdeRm/oUnHBAA+2zsuZpm9UqYzVejEITiAQ==", 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.1", 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAJdeRm4nVTLBAAzilrc5cH75EoI2QCW1zn4Q==", 2024-09-13T17:25:36.229 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.2", 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQANdeRm6dxMABAAQQ61mLSrFZwLTJ2mx/7jpA==", 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.3", 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAQdeRmtPMFEBAAiHsBV8RND4X17wBahgOi0w==", 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.4", 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAWdeRmKLeMJBAA7mzaA4rfcGjWXt8tm7/7wA==", 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.231 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.5", 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAZdeRmXfYEMxAA8tlgIdirlWCznRgJ0Dybyg==", 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.6", 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAddeRmfGZ1EBAAlrePafDoL2vr8pQXoVfUDg==", 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "osd.7", 2024-09-13T17:25:36.233 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAgdeRmPS/zIBAASms2uvvAsBcnrL3gDs5/4A==", 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow profile osd", 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile osd", 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.0", 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRmbiwnNhAAh3aNnIynrEu4YvbqINN2gg==", 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.234 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow r", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow rw", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow rwx" 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.1", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQADdeRmyhpKBhAAFX7reIfFLnR9R40is1zNEg==", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow r", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow rw", 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow rwx" 2024-09-13T17:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.2", 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRmsSKaOxAAhADsLSIYCa52g/d4zedsJA==", 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow r", 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow rw", 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow rwx" 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.3", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQADdeRmeTgIDBAAH5kdeKK4O/pGLodaEj1nQQ==", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow r", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow rw", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow rwx" 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.admin", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQABdeRm+l3gJBAAxTf9dBsnERWKEWDYvZaAsQ==", 2024-09-13T17:25:36.237 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow *", 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr": "allow *", 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow *", 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.bootstrap-mds", 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAndeRmXVSjJRAAi4pltg1tSDJyUl1rNQ6k+A==", 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T17:25:36.238 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAndeRmf16jJRAAnFHlOOIyd1iNPJvrpux9Pg==", 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.bootstrap-osd", 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAndeRmrWijJRAAJhT6T5NcNSUfRrew61hiWA==", 2024-09-13T17:25:36.239 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAndeRmLnGjJRAAyp5oHcJ1BMAiXOLgpSEleg==", 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAndeRm7XmjJRAAcdIpDRKSD7lWZXK5laKRUg==", 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQAndeRmk4KjJRAAPcyb/uvVVFsxKwgLEIUxUg==", 2024-09-13T17:25:36.241 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "mgr.x", 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRma/eBChAAuz690AoAtsDoQp2Y4/VTBA==", 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow *", 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile mgr", 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: "entity": "mgr.y", 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: "key": "AQACdeRm+gG2BBAAGYqsMaxu2yCriuAaJF5Nig==", 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": { 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": "allow *", 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: "mon": "allow profile mgr", 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: "osd": "allow *" 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T17:25:36.243 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:25:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8308066730 msgr2=0x7f8308068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8308066730 0x7f8308068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8314000c00 tx=0x7f8314008030 comp rx=0 tx=0).stop 2024-09-13T17:25:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 msgr2=0x7f832c154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 0x7f832c154d50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f831c00c700 tx=0x7f831c00ca10 comp rx=0 tx=0).stop 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 shutdown_connections 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8308066730 0x7f8308068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832c15aff0 0x7f832c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832c144300 0x7f832c13e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 --2- 172.21.15.139:0/2998089609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f832c0cdc00 0x7f832c154d50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 >> 172.21.15.139:0/2998089609 conn(0x7f832c0ce9d0 msgr2=0x7f832c0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 shutdown_connections 2024-09-13T17:25:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.222+0000 7f832be00700 1 -- 172.21.15.139:0/2998089609 wait complete. 2024-09-13T17:25:36.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T17:25:36.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 Processor -- start 2024-09-13T17:25:36.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 -- start start 2024-09-13T17:25:36.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87ac1612a0 0x7f87ac0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87ac0b34e0 0x7f87ac0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac070410 con 0x7f87ac0cc8b0 2024-09-13T17:25:36.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0706f0 con 0x7f87ac1612a0 2024-09-13T17:25:36.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87b0e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0709d0 con 0x7f87ac0b34e0 2024-09-13T17:25:36.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87aa800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f87ac0cc8b0 0x7f87ac06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52564/0 (socket says 172.21.15.139:52564) 2024-09-13T17:25:36.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87aa800700 1 -- 172.21.15.139:0/712815366 learned_addr learned my addr 172.21.15.139:0/712815366 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:36.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a9e00700 1 --2- 172.21.15.139:0/712815366 >> v2:172.21.15.176:3300/0 conn(0x7f87ac1612a0 0x7f87ac0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668934298 0 0) 0x7f87ac070410 con 0x7f87ac0cc8b0 2024-09-13T17:25:36.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a9400700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87ac0b34e0 0x7f87ac0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87900035d0 con 0x7f87ac0cc8b0 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56452780 0 0) 0x7f87900035d0 con 0x7f87ac0cc8b0 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87ac0b34e0 msgr2=0x7f87ac0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87ac0b34e0 0x7f87ac0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 >> v2:172.21.15.176:3300/0 conn(0x7f87ac1612a0 msgr2=0x7f87ac0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 --2- 172.21.15.139:0/712815366 >> v2:172.21.15.176:3300/0 conn(0x7f87ac1612a0 0x7f87ac0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac070cb0 con 0x7f87ac0cc8b0 2024-09-13T17:25:36.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.414+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f87a40019f0 con 0x7f87ac0cc8b0 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 >> v1:172.21.15.139:6789/0 conn(0x7f87ac0cc8b0 legacy=0x7f87ac06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8790003a20 0x7f8790003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790004870 0x7f8790004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8790005230 0x7f879000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0706f0 con 0x7f8790005230 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0709d0 con 0x7f8790003a20 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879000c070 con 0x7f8790004870 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a9e00700 1 --2- 172.21.15.139:0/712815366 >> v2:172.21.15.176:3300/0 conn(0x7f87ac1612a0 0x7f87ac0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8790005230 0x7f879000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a9400700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790004870 0x7f8790004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 -- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790004870 msgr2=0x7f8790004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790004870 0x7f8790004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 -- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8790003a20 msgr2=0x7f8790003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8790003a20 0x7f8790003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 -- 172.21.15.139:0/712815366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900035d0 con 0x7f8790005230 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8790005230 0x7f879000ba30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87a400a890 tx=0x7f87900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f782ae9e6b256556 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a40072d0 con 0x7f8790005230 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4007450 con 0x7f8790005230 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87a8a00700 1 -- 172.21.15.139:0/712815366 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4007800 con 0x7f8790005230 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87b0e00700 1 -- 172.21.15.139:0/712815366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8790005230 msgr2=0x7f879000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87b0e00700 1 --2- 172.21.15.139:0/712815366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8790005230 0x7f879000ba30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87a400a890 tx=0x7f87900058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87aa800700 1 -- 172.21.15.139:0/712815366 reap_dead start 2024-09-13T17:25:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87b0e00700 1 -- 172.21.15.139:0/712815366 shutdown_connections 2024-09-13T17:25:36.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87b0e00700 1 -- 172.21.15.139:0/712815366 >> 172.21.15.139:0/712815366 conn(0x7f87ac06b1e0 msgr2=0x7f87ac06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:36.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87b0e00700 1 -- 172.21.15.139:0/712815366 shutdown_connections 2024-09-13T17:25:36.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.418+0000 7f87b0e00700 1 -- 172.21.15.139:0/712815366 wait complete. 2024-09-13T17:25:36.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 Processor -- start 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 -- start start 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790005230 0x7f87ac163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 0x7f87ac0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87ac071710 0x7f87ac1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac071b90 con 0x7f87ac14ff70 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac151a60 con 0x7f87ac071710 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87b0e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac150e50 con 0x7f8790005230 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87a9400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 0x7f87ac0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87a9400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 0x7f87ac0711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46666/0 (socket says 172.21.15.139:46666) 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87a9400700 1 -- 172.21.15.139:0/4252752045 learned_addr learned my addr 172.21.15.139:0/4252752045 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87aa800700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87ac071710 0x7f87ac1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.422+0000 7f87a9e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790005230 0x7f87ac163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9400700 1 -- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790005230 msgr2=0x7f87ac163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9400700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790005230 0x7f87ac163260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9400700 1 -- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87ac071710 msgr2=0x7f87ac1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9400700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87ac071710 0x7f87ac1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9400700 1 -- 172.21.15.139:0/4252752045 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac151130 con 0x7f87ac14ff70 2024-09-13T17:25:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790005230 0x7f87ac163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:36.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a9400700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 0x7f87ac0711d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8798010840 tx=0x7f8798010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:36.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798015880 con 0x7f87ac14ff70 2024-09-13T17:25:36.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879800c050 con 0x7f87ac14ff70 2024-09-13T17:25:36.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac151410 con 0x7f87ac14ff70 2024-09-13T17:25:36.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798015c20 con 0x7f87ac14ff70 2024-09-13T17:25:36.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac1640c0 con 0x7f87ac14ff70 2024-09-13T17:25:36.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.426+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac154a20 con 0x7f87ac14ff70 2024-09-13T17:25:36.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.430+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f879801e400 con 0x7f87ac14ff70 2024-09-13T17:25:36.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.430+0000 7f87a2000700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f878c066760 0x7f878c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.430+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8798084990 con 0x7f87ac14ff70 2024-09-13T17:25:36.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.434+0000 7f87a9e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f878c066760 0x7f878c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.434+0000 7f87a9e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f878c066760 0x7f878c068c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f879c009a10 tx=0x7f879c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:36.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.438+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8798051ef0 con 0x7f87ac14ff70 2024-09-13T17:25:36.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.678+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f87ac15b0d0 con 0x7f87ac14ff70 2024-09-13T17:25:36.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.682+0000 7f87a2000700 1 -- 172.21.15.139:0/4252752045 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8798055510 con 0x7f87ac14ff70 2024-09-13T17:25:36.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f878c066760 msgr2=0x7f878c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f878c066760 0x7f878c068c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f879c009a10 tx=0x7f879c008040 comp rx=0 tx=0).stop 2024-09-13T17:25:36.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 msgr2=0x7f87ac0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 0x7f87ac0711d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8798010840 tx=0x7f8798010b50 comp rx=0 tx=0).stop 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 shutdown_connections 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f878c066760 0x7f878c068c20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87ac071710 0x7f87ac1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87ac14ff70 0x7f87ac0711d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 --2- 172.21.15.139:0/4252752045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8790005230 0x7f87ac163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 >> 172.21.15.139:0/4252752045 conn(0x7f87ac06b1e0 msgr2=0x7f87ac0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 shutdown_connections 2024-09-13T17:25:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.686+0000 7f87b0e00700 1 -- 172.21.15.139:0/4252752045 wait complete. 2024-09-13T17:25:36.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T17:25:36.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.870+0000 7f7c6da00700 1 Processor -- start 2024-09-13T17:25:36.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.870+0000 7f7c6da00700 1 -- start start 2024-09-13T17:25:36.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c6da00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c680717d0 0x7f7c6806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c6da00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6806b520 con 0x7f7c68158f00 2024-09-13T17:25:36.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c6da00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6806b800 con 0x7f7c680b3400 2024-09-13T17:25:36.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c6da00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6806bae0 con 0x7f7c680717d0 2024-09-13T17:25:36.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c67e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7c68158f00 0x7f7c681592e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52574/0 (socket says 172.21.15.139:52574) 2024-09-13T17:25:36.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c67e00700 1 -- 172.21.15.139:0/2795500188 learned_addr learned my addr 172.21.15.139:0/2795500188 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:36.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c67400700 1 --2- 172.21.15.139:0/2795500188 >> v2:172.21.15.176:3300/0 conn(0x7f7c680717d0 0x7f7c6806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004425151 0 0) 0x7f7c6806b520 con 0x7f7c68158f00 2024-09-13T17:25:36.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4c0035d0 con 0x7f7c68158f00 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907205599 0 0) 0x7f7c6806b800 con 0x7f7c680b3400 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c6806b520 con 0x7f7c680b3400 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235301722 0 0) 0x7f7c4c0035d0 con 0x7f7c68158f00 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 >> v2:172.21.15.176:3300/0 conn(0x7f7c680717d0 msgr2=0x7f7c6806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 --2- 172.21.15.139:0/2795500188 >> v2:172.21.15.176:3300/0 conn(0x7f7c680717d0 0x7f7c6806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 >> v1:172.21.15.176:6789/0 conn(0x7f7c680b3400 legacy=0x7f7c6806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6806bdc0 con 0x7f7c68158f00 2024-09-13T17:25:36.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f7c58001670 con 0x7f7c68158f00 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 >> v1:172.21.15.139:6789/0 conn(0x7f7c68158f00 legacy=0x7f7c681592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c4c003bb0 0x7f7c4c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c4c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c4c005230 0x7f7c4c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6806bae0 con 0x7f7c4c004870 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c00e2c0 con 0x7f7c4c005230 2024-09-13T17:25:36.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c00e480 con 0x7f7c4c003bb0 2024-09-13T17:25:36.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c67400700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c4c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c6d000700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c4c005230 0x7f7c4c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.874+0000 7f7c67e00700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c4c003bb0 0x7f7c4c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c67400700 1 -- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c4c003bb0 msgr2=0x7f7c4c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c67400700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c4c003bb0 0x7f7c4c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c67400700 1 -- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c4c005230 msgr2=0x7f7c4c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c67400700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c4c005230 0x7f7c4c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c67400700 1 -- 172.21.15.139:0/2795500188 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0035d0 con 0x7f7c4c004870 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6d000700 1 -- 172.21.15.139:0/2795500188 reap_dead start 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c67400700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c4c004cf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b70 tx=0x7f7c4c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3039127224f05fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400e6c0 con 0x7f7c4c004870 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5400e820 con 0x7f7c4c004870 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c66a00700 1 -- 172.21.15.139:0/2795500188 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400eb90 con 0x7f7c4c004870 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 -- 172.21.15.139:0/2795500188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 msgr2=0x7f7c4c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c4c004cf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b70 tx=0x7f7c4c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 -- 172.21.15.139:0/2795500188 shutdown_connections 2024-09-13T17:25:36.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 --2- 172.21.15.139:0/2795500188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c4c004cf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 -- 172.21.15.139:0/2795500188 >> 172.21.15.139:0/2795500188 conn(0x7f7c680ce9d0 msgr2=0x7f7c680cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:36.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 -- 172.21.15.139:0/2795500188 shutdown_connections 2024-09-13T17:25:36.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.878+0000 7f7c6da00700 1 -- 172.21.15.139:0/2795500188 wait complete. 2024-09-13T17:25:36.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.882+0000 7f7c6da00700 1 Processor -- start 2024-09-13T17:25:36.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.882+0000 7f7c6da00700 1 -- start start 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c68151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c68152180 0x7f7c680acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c680ad100 0x7f7c681e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c681f2b60 con 0x7f7c4c004870 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6815a690 con 0x7f7c680ad100 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6815a970 con 0x7f7c68152180 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c68151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c68151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46678/0 (socket says 172.21.15.139:46678) 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 -- 172.21.15.139:0/1442124285 learned_addr learned my addr 172.21.15.139:0/1442124285 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:36.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67400700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c68152180 0x7f7c680acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6d000700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c680ad100 0x7f7c681e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 -- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c68152180 msgr2=0x7f7c680acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c68152180 0x7f7c680acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 -- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c680ad100 msgr2=0x7f7c681e5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c680ad100 0x7f7c681e5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 -- 172.21.15.139:0/1442124285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6815ac50 con 0x7f7c4c004870 2024-09-13T17:25:36.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67400700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c68152180 0x7f7c680acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c67e00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c68151c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e780 tx=0x7f7c5800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58012650 con 0x7f7c4c004870 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c580127d0 con 0x7f7c4c004870 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6815af30 con 0x7f7c4c004870 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58012b80 con 0x7f7c4c004870 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c681f25b0 con 0x7f7c4c004870 2024-09-13T17:25:36.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.886+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6815b450 con 0x7f7c4c004870 2024-09-13T17:25:36.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.890+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c58012ce0 con 0x7f7c4c004870 2024-09-13T17:25:36.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.890+0000 7f7c5fe00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c48066730 0x7f7c48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:36.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.890+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7c58083df0 con 0x7f7c4c004870 2024-09-13T17:25:36.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.890+0000 7f7c67400700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c48066730 0x7f7c48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:36.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.894+0000 7f7c67400700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c48066730 0x7f7c48068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c540090b0 tx=0x7f7c54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:36.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:36.898+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c6815b450 con 0x7f7c4c004870 2024-09-13T17:25:37.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.142+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7c6815b450 con 0x7f7c4c004870 2024-09-13T17:25:37.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.154+0000 7f7c5fe00700 1 -- 172.21.15.139:0/1442124285 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c6815b450 con 0x7f7c4c004870 2024-09-13T17:25:37.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c48066730 msgr2=0x7f7c48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c48066730 0x7f7c48068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c540090b0 tx=0x7f7c54008030 comp rx=0 tx=0).stop 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 msgr2=0x7f7c68151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c68151c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e780 tx=0x7f7c5800eb40 comp rx=0 tx=0).stop 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 shutdown_connections 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f7c48066730 0x7f7c48068bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c680ad100 0x7f7c681e5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c68152180 0x7f7c680acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 --2- 172.21.15.139:0/1442124285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c004870 0x7f7c68151c40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 >> 172.21.15.139:0/1442124285 conn(0x7f7c680ce9d0 msgr2=0x7f7c68158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 shutdown_connections 2024-09-13T17:25:37.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.158+0000 7f7c6da00700 1 -- 172.21.15.139:0/1442124285 wait complete. 2024-09-13T17:25:37.182 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T17:25:37.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.346+0000 7f2b75800700 1 Processor -- start 2024-09-13T17:25:37.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.346+0000 7f2b75800700 1 -- start start 2024-09-13T17:25:37.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b7015cc80 0x7f2b701607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b700cb160 0x7f2b700b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2b70160d00 0x7f2b700b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b700ced70 con 0x7f2b7015cc80 2024-09-13T17:25:37.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7015d060 con 0x7f2b70160d00 2024-09-13T17:25:37.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70161260 con 0x7f2b700cb160 2024-09-13T17:25:37.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b7015cc80 0x7f2b701607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b7015cc80 0x7f2b701607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46680/0 (socket says 172.21.15.139:46680) 2024-09-13T17:25:37.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 -- 172.21.15.139:0/2453461521 learned_addr learned my addr 172.21.15.139:0/2453461521 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:37.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6f400700 1 --2- 172.21.15.139:0/2453461521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b700cb160 0x7f2b700b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b74e00700 1 --2- 172.21.15.139:0/2453461521 >> v2:172.21.15.176:3300/0 conn(0x7f2b70160d00 0x7f2b700b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 -- 172.21.15.139:0/2453461521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b700cb160 msgr2=0x7f2b700b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 --2- 172.21.15.139:0/2453461521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b700cb160 0x7f2b700b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 -- 172.21.15.139:0/2453461521 >> v2:172.21.15.176:3300/0 conn(0x7f2b70160d00 msgr2=0x7f2b700b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 --2- 172.21.15.139:0/2453461521 >> v2:172.21.15.176:3300/0 conn(0x7f2b70160d00 0x7f2b700b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 -- 172.21.15.139:0/2453461521 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70161540 con 0x7f2b7015cc80 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b74e00700 1 --2- 172.21.15.139:0/2453461521 >> v2:172.21.15.176:3300/0 conn(0x7f2b70160d00 0x7f2b700b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6fe00700 1 --2- 172.21.15.139:0/2453461521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b7015cc80 0x7f2b701607c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b5ac0 tx=0x7f2b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e261599342b5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6ea00700 1 -- 172.21.15.139:0/2453461521 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000e070 con 0x7f2b7015cc80 2024-09-13T17:25:37.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6ea00700 1 -- 172.21.15.139:0/2453461521 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6000b910 con 0x7f2b7015cc80 2024-09-13T17:25:37.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b6ea00700 1 -- 172.21.15.139:0/2453461521 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000bcc0 con 0x7f2b7015cc80 2024-09-13T17:25:37.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 -- 172.21.15.139:0/2453461521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b7015cc80 msgr2=0x7f2b701607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.350+0000 7f2b75800700 1 --2- 172.21.15.139:0/2453461521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b7015cc80 0x7f2b701607c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b5ac0 tx=0x7f2b6000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 -- 172.21.15.139:0/2453461521 shutdown_connections 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 --2- 172.21.15.139:0/2453461521 >> v2:172.21.15.176:3300/0 conn(0x7f2b70160d00 0x7f2b700b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 --2- 172.21.15.139:0/2453461521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b700cb160 0x7f2b700b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 --2- 172.21.15.139:0/2453461521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b7015cc80 0x7f2b701607c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 -- 172.21.15.139:0/2453461521 >> 172.21.15.139:0/2453461521 conn(0x7f2b700b62f0 msgr2=0x7f2b700b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 -- 172.21.15.139:0/2453461521 shutdown_connections 2024-09-13T17:25:37.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 -- 172.21.15.139:0/2453461521 wait complete. 2024-09-13T17:25:37.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 Processor -- start 2024-09-13T17:25:37.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.354+0000 7f2b75800700 1 -- start start 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 0x7f2b7014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7015cc80 0x7f2b7014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b70160d00 0x7f2b7014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7014b9e0 con 0x7f2b700cb160 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7014ce40 con 0x7f2b70160d00 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7014f020 con 0x7f2b7015cc80 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 0x7f2b7014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 0x7f2b7014b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46692/0 (socket says 172.21.15.139:46692) 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 -- 172.21.15.139:0/3772404507 learned_addr learned my addr 172.21.15.139:0/3772404507 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:37.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6f400700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7015cc80 0x7f2b7014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b74e00700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b70160d00 0x7f2b7014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 -- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7015cc80 msgr2=0x7f2b7014e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7015cc80 0x7f2b7014e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 -- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b70160d00 msgr2=0x7f2b7014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b70160d00 0x7f2b7014dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 -- 172.21.15.139:0/3772404507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60009b30 con 0x7f2b700cb160 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b6fe00700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 0x7f2b7014b4a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000f80 tx=0x7f2b60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600099b0 con 0x7f2b700cb160 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b60004250 con 0x7f2b700cb160 2024-09-13T17:25:37.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7014d0e0 con 0x7f2b700cb160 2024-09-13T17:25:37.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600045e0 con 0x7f2b700cb160 2024-09-13T17:25:37.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.358+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7014d6a0 con 0x7f2b700cb160 2024-09-13T17:25:37.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.362+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b700cda90 con 0x7f2b700cb160 2024-09-13T17:25:37.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.362+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b60004740 con 0x7f2b700cb160 2024-09-13T17:25:37.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.362+0000 7f2b67e00700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2b50066730 0x7f2b50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.362+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2b600853d0 con 0x7f2b700cb160 2024-09-13T17:25:37.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.362+0000 7f2b6f400700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2b50066730 0x7f2b50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.366+0000 7f2b6f400700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2b50066730 0x7f2b50068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2b70152fc0 tx=0x7f2b5c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:37.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.370+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b60052970 con 0x7f2b700cb160 2024-09-13T17:25:37.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.606+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2b701607c0 con 0x7f2b700cb160 2024-09-13T17:25:37.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.614+0000 7f2b67e00700 1 -- 172.21.15.139:0/3772404507 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2b6001c440 con 0x7f2b700cb160 2024-09-13T17:25:37.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2b50066730 msgr2=0x7f2b50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2b50066730 0x7f2b50068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2b70152fc0 tx=0x7f2b5c009240 comp rx=0 tx=0).stop 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 msgr2=0x7f2b7014b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 0x7f2b7014b4a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000f80 tx=0x7f2b60004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 shutdown_connections 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2b50066730 0x7f2b50068bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b70160d00 0x7f2b7014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b7015cc80 0x7f2b7014e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 --2- 172.21.15.139:0/3772404507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b700cb160 0x7f2b7014b4a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 >> 172.21.15.139:0/3772404507 conn(0x7f2b700b62f0 msgr2=0x7f2b700b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 shutdown_connections 2024-09-13T17:25:37.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.618+0000 7f2b75800700 1 -- 172.21.15.139:0/3772404507 wait complete. 2024-09-13T17:25:37.643 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T17:25:37.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07be00700 1 Processor -- start 2024-09-13T17:25:37.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07be00700 1 -- start start 2024-09-13T17:25:37.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d0380 0x7ff07c15e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07be00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c0b1740 con 0x7ff07c0d1740 2024-09-13T17:25:37.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07be00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c0d0810 con 0x7ff07c146690 2024-09-13T17:25:37.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c15e570 con 0x7ff07c0d0380 2024-09-13T17:25:37.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07a000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff07c0d1740 0x7ff07c0b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52588/0 (socket says 172.21.15.139:52588) 2024-09-13T17:25:37.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07a000700 1 -- 172.21.15.139:0/1015691461 learned_addr learned my addr 172.21.15.139:0/1015691461 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:37.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.802+0000 7ff07b400700 1 --2- 172.21.15.139:0/1015691461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d0380 0x7ff07c15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07b400700 1 -- 172.21.15.139:0/1015691461 >> v1:172.21.15.176:6789/0 conn(0x7ff07c146690 legacy=0x7ff07c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07b400700 1 -- 172.21.15.139:0/1015691461 >> v1:172.21.15.139:6789/0 conn(0x7ff07c0d1740 legacy=0x7ff07c0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07b400700 1 -- 172.21.15.139:0/1015691461 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0b1990 con 0x7ff07c0d0380 2024-09-13T17:25:37.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff079600700 1 -- 172.21.15.139:0/1015691461 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438986961 0 0) 0x7ff07c0b1740 con 0x7ff07c0d1740 2024-09-13T17:25:37.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07b400700 1 --2- 172.21.15.139:0/1015691461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d0380 0x7ff07c15e030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff074009dc0 tx=0x7ff07400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513e7bf3757ec8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:37.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff079600700 1 -- 172.21.15.139:0/1015691461 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400e070 con 0x7ff07c0d0380 2024-09-13T17:25:37.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff079600700 1 -- 172.21.15.139:0/1015691461 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400bad0 con 0x7ff07c0d0380 2024-09-13T17:25:37.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff079600700 1 -- 172.21.15.139:0/1015691461 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400be80 con 0x7ff07c0d0380 2024-09-13T17:25:37.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 -- 172.21.15.139:0/1015691461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d0380 msgr2=0x7ff07c15e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 --2- 172.21.15.139:0/1015691461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d0380 0x7ff07c15e030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff074009dc0 tx=0x7ff07400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:37.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 -- 172.21.15.139:0/1015691461 shutdown_connections 2024-09-13T17:25:37.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 --2- 172.21.15.139:0/1015691461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d0380 0x7ff07c15e030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 -- 172.21.15.139:0/1015691461 >> 172.21.15.139:0/1015691461 conn(0x7ff07c071fa0 msgr2=0x7ff07c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:37.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 -- 172.21.15.139:0/1015691461 shutdown_connections 2024-09-13T17:25:37.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.806+0000 7ff07be00700 1 -- 172.21.15.139:0/1015691461 wait complete. 2024-09-13T17:25:37.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 Processor -- start 2024-09-13T17:25:37.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 -- start start 2024-09-13T17:25:37.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff07c0d0380 0x7ff07c13ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d1740 0x7ff07c1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 0x7ff07c144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c13f4a0 con 0x7ff07c146690 2024-09-13T17:25:37.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c1430a0 con 0x7ff07c0d0380 2024-09-13T17:25:37.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c140020 con 0x7ff07c0d1740 2024-09-13T17:25:37.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 0x7ff07c144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 0x7ff07c144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46708/0 (socket says 172.21.15.139:46708) 2024-09-13T17:25:37.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07b400700 1 -- 172.21.15.139:0/800652907 learned_addr learned my addr 172.21.15.139:0/800652907 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:37.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07aa00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff07c0d0380 0x7ff07c13ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.810+0000 7ff07a000700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d1740 0x7ff07c1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07b400700 1 -- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d1740 msgr2=0x7ff07c1446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07b400700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d1740 0x7ff07c1446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07b400700 1 -- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff07c0d0380 msgr2=0x7ff07c13ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07b400700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff07c0d0380 0x7ff07c13ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07b400700 1 -- 172.21.15.139:0/800652907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009a70 con 0x7ff07c146690 2024-09-13T17:25:37.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07aa00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff07c0d0380 0x7ff07c13ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:37.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07b400700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 0x7ff07c144bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff074009d90 tx=0x7ff074004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:37.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074012430 con 0x7ff07c146690 2024-09-13T17:25:37.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff074012590 con 0x7ff07c146690 2024-09-13T17:25:37.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c142800 con 0x7ff07c146690 2024-09-13T17:25:37.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074012920 con 0x7ff07c146690 2024-09-13T17:25:37.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c142dc0 con 0x7ff07c146690 2024-09-13T17:25:37.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.814+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c0677e0 con 0x7ff07c146690 2024-09-13T17:25:37.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.818+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff074012a80 con 0x7ff07c146690 2024-09-13T17:25:37.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.818+0000 7ff072a00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff05c066730 0x7ff05c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:37.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.818+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff074086870 con 0x7ff07c146690 2024-09-13T17:25:37.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.818+0000 7ff07aa00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff05c066730 0x7ff05c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:37.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.822+0000 7ff07aa00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff05c066730 0x7ff05c068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff06c000f60 tx=0x7ff06c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:37.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:37.826+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff074053e90 con 0x7ff07c146690 2024-09-13T17:25:38.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.070+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff07c146a70 con 0x7ff07c146690 2024-09-13T17:25:38.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.078+0000 7ff072a00700 1 -- 172.21.15.139:0/800652907 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff0740574b0 con 0x7ff07c146690 2024-09-13T17:25:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff05c066730 msgr2=0x7ff05c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff05c066730 0x7ff05c068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff06c000f60 tx=0x7ff06c009040 comp rx=0 tx=0).stop 2024-09-13T17:25:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 msgr2=0x7ff07c144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 0x7ff07c144bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff074009d90 tx=0x7ff074004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 shutdown_connections 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff05c066730 0x7ff05c068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff07c146690 0x7ff07c144bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff07c0d1740 0x7ff07c1446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 --2- 172.21.15.139:0/800652907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff07c0d0380 0x7ff07c13ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 >> 172.21.15.139:0/800652907 conn(0x7ff07c071fa0 msgr2=0x7ff07c06d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 shutdown_connections 2024-09-13T17:25:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.082+0000 7ff07be00700 1 -- 172.21.15.139:0/800652907 wait complete. 2024-09-13T17:25:38.110 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T17:25:38.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 Processor -- start 2024-09-13T17:25:38.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 -- start start 2024-09-13T17:25:38.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d6015cc00 0x7f8d600ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d600cd160 con 0x7f8d6006fe10 2024-09-13T17:25:38.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d600b34b0 con 0x7f8d6015cc00 2024-09-13T17:25:38.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.282+0000 7f8d66000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600aceb0 con 0x7f8d600b2b70 2024-09-13T17:25:38.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d65600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5fe00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8d6006fe10 0x7f8d600adbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:53900/0 (socket says 172.21.15.139:53900) 2024-09-13T17:25:38.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5fe00700 1 -- 172.21.15.139:0/3720799249 learned_addr learned my addr 172.21.15.139:0/3720799249 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:38.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d64c00700 1 --2- 172.21.15.139:0/3720799249 >> v2:172.21.15.176:3300/0 conn(0x7f8d6015cc00 0x7f8d600ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5f400700 1 -- 172.21.15.139:0/3720799249 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399681242 0 0) 0x7f8d600cd160 con 0x7f8d6006fe10 2024-09-13T17:25:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5f400700 1 -- 172.21.15.139:0/3720799249 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d480035d0 con 0x7f8d6006fe10 2024-09-13T17:25:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d65600700 1 -- 172.21.15.139:0/3720799249 >> v2:172.21.15.176:3300/0 conn(0x7f8d6015cc00 msgr2=0x7f8d600ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d65600700 1 --2- 172.21.15.139:0/3720799249 >> v2:172.21.15.176:3300/0 conn(0x7f8d6015cc00 0x7f8d600ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d65600700 1 -- 172.21.15.139:0/3720799249 >> v1:172.21.15.176:6789/0 conn(0x7f8d6006fe10 legacy=0x7f8d600adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d65600700 1 -- 172.21.15.139:0/3720799249 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600ad190 con 0x7f8d600b2b70 2024-09-13T17:25:38.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d65600700 1 --2- 172.21.15.139:0/3720799249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600b2f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009d90 tx=0x7f8d5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7a0e15727d45777 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:38.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5f400700 1 -- 172.21.15.139:0/3720799249 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800e070 con 0x7f8d600b2b70 2024-09-13T17:25:38.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5f400700 1 -- 172.21.15.139:0/3720799249 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5800bb20 con 0x7f8d600b2b70 2024-09-13T17:25:38.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d5f400700 1 -- 172.21.15.139:0/3720799249 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58012430 con 0x7f8d600b2b70 2024-09-13T17:25:38.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d66000700 1 -- 172.21.15.139:0/3720799249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 msgr2=0x7f8d600b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.286+0000 7f8d66000700 1 --2- 172.21.15.139:0/3720799249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600b2f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009d90 tx=0x7f8d5800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:38.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 -- 172.21.15.139:0/3720799249 shutdown_connections 2024-09-13T17:25:38.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 --2- 172.21.15.139:0/3720799249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600b2f70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 --2- 172.21.15.139:0/3720799249 >> v2:172.21.15.176:3300/0 conn(0x7f8d6015cc00 0x7f8d600ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 -- 172.21.15.139:0/3720799249 >> 172.21.15.139:0/3720799249 conn(0x7f8d600ce9d0 msgr2=0x7f8d600cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:38.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 -- 172.21.15.139:0/3720799249 shutdown_connections 2024-09-13T17:25:38.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 -- 172.21.15.139:0/3720799249 wait complete. 2024-09-13T17:25:38.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 Processor -- start 2024-09-13T17:25:38.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.290+0000 7f8d66000700 1 -- start start 2024-09-13T17:25:38.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6006fe10 0x7f8d600c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 0x7f8d601583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600c48a0 con 0x7f8d6015cc00 2024-09-13T17:25:38.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600c39d0 con 0x7f8d6006fe10 2024-09-13T17:25:38.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600c63e0 con 0x7f8d600b2b70 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 0x7f8d601583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 0x7f8d601583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46714/0 (socket says 172.21.15.139:46714) 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 -- 172.21.15.139:0/2259204594 learned_addr learned my addr 172.21.15.139:0/2259204594 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d5fe00700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d64c00700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6006fe10 0x7f8d600c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 -- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 msgr2=0x7f8d600ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 -- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6006fe10 msgr2=0x7f8d600c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6006fe10 0x7f8d600c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 -- 172.21.15.139:0/2259204594 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58009a70 con 0x7f8d6015cc00 2024-09-13T17:25:38.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d65600700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 0x7f8d601583e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8d58014040 tx=0x7f8d58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58012430 con 0x7f8d6015cc00 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58020070 con 0x7f8d6015cc00 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d600c3c20 con 0x7f8d6015cc00 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58004280 con 0x7f8d6015cc00 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.294+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d600c41e0 con 0x7f8d6015cc00 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.298+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d600c49e0 con 0x7f8d6015cc00 2024-09-13T17:25:38.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.298+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d580043e0 con 0x7f8d6015cc00 2024-09-13T17:25:38.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.298+0000 7f8d5cc00700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d40066730 0x7f8d40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.298+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8d58022070 con 0x7f8d6015cc00 2024-09-13T17:25:38.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.298+0000 7f8d64c00700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d40066730 0x7f8d40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.298+0000 7f8d64c00700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d40066730 0x7f8d40068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009ae0 tx=0x7f8d54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:38.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.306+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d600c49e0 con 0x7f8d6015cc00 2024-09-13T17:25:38.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.550+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8d600c49e0 con 0x7f8d6015cc00 2024-09-13T17:25:38.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.558+0000 7f8d5cc00700 1 -- 172.21.15.139:0/2259204594 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d600c49e0 con 0x7f8d6015cc00 2024-09-13T17:25:38.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d40066730 msgr2=0x7f8d40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d40066730 0x7f8d40068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009ae0 tx=0x7f8d54008040 comp rx=0 tx=0).stop 2024-09-13T17:25:38.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 msgr2=0x7f8d601583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 0x7f8d601583e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8d58014040 tx=0x7f8d58004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 shutdown_connections 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f8d40066730 0x7f8d40068bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6015cc00 0x7f8d601583e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d600b2b70 0x7f8d600ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 --2- 172.21.15.139:0/2259204594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6006fe10 0x7f8d600c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 >> 172.21.15.139:0/2259204594 conn(0x7f8d600ce9d0 msgr2=0x7f8d600701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 shutdown_connections 2024-09-13T17:25:38.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.562+0000 7f8d66000700 1 -- 172.21.15.139:0/2259204594 wait complete. 2024-09-13T17:25:38.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T17:25:38.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.822+0000 7f25a5000700 1 Processor -- start 2024-09-13T17:25:38.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.822+0000 7f25a5000700 1 -- start start 2024-09-13T17:25:38.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.822+0000 7f25a5000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25a01448e0 0x7f25a00b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00b42f0 con 0x7f25a006d2a0 2024-09-13T17:25:38.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00b2be0 con 0x7f25a015c4c0 2024-09-13T17:25:38.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a00cc3c0 con 0x7f25a01448e0 2024-09-13T17:25:38.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259d400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f25a006d2a0 0x7f25a00b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52600/0 (socket says 172.21.15.139:52600) 2024-09-13T17:25:38.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259d400700 1 -- 172.21.15.139:0/166825416 learned_addr learned my addr 172.21.15.139:0/166825416 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:38.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259de00700 1 --2- 172.21.15.139:0/166825416 >> v2:172.21.15.176:3300/0 conn(0x7f25a01448e0 0x7f25a00b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259ca00700 1 -- 172.21.15.139:0/166825416 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642624463 0 0) 0x7f258c001110 con 0x7f25a006d2a0 2024-09-13T17:25:38.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259ca00700 1 -- 172.21.15.139:0/166825416 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25840035d0 con 0x7f25a006d2a0 2024-09-13T17:25:38.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259de00700 1 -- 172.21.15.139:0/166825416 >> v1:172.21.15.176:6789/0 conn(0x7f25a015c4c0 legacy=0x7f25a00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259de00700 1 -- 172.21.15.139:0/166825416 >> v1:172.21.15.139:6789/0 conn(0x7f25a006d2a0 legacy=0x7f25a00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259de00700 1 -- 172.21.15.139:0/166825416 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00cc6a0 con 0x7f25a01448e0 2024-09-13T17:25:38.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259de00700 1 --2- 172.21.15.139:0/166825416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a01448e0 0x7f25a00b3db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2590009850 tx=0x7f2590009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90714b06ba266315 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:38.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259ca00700 1 -- 172.21.15.139:0/166825416 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011830 con 0x7f25a01448e0 2024-09-13T17:25:38.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259ca00700 1 -- 172.21.15.139:0/166825416 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590011990 con 0x7f25a01448e0 2024-09-13T17:25:38.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f259ca00700 1 -- 172.21.15.139:0/166825416 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011d40 con 0x7f25a01448e0 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- 172.21.15.139:0/166825416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a01448e0 msgr2=0x7f25a00b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 --2- 172.21.15.139:0/166825416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a01448e0 0x7f25a00b3db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2590009850 tx=0x7f2590009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- 172.21.15.139:0/166825416 shutdown_connections 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 --2- 172.21.15.139:0/166825416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a01448e0 0x7f25a00b3db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- 172.21.15.139:0/166825416 >> 172.21.15.139:0/166825416 conn(0x7f25a006b1e0 msgr2=0x7f25a006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- 172.21.15.139:0/166825416 shutdown_connections 2024-09-13T17:25:38.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.826+0000 7f25a5000700 1 -- 172.21.15.139:0/166825416 wait complete. 2024-09-13T17:25:38.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 Processor -- start 2024-09-13T17:25:38.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 -- start start 2024-09-13T17:25:38.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a006d2a0 0x7f25a015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 0x7f25a013a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25a015c4c0 0x7f25a01388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0139460 con 0x7f25a01448e0 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0139740 con 0x7f25a006d2a0 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f25a5000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0139a20 con 0x7f25a015c4c0 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f259d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 0x7f25a013a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f259d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 0x7f25a013a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46722/0 (socket says 172.21.15.139:46722) 2024-09-13T17:25:38.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.830+0000 7f259d400700 1 -- 172.21.15.139:0/3545382184 learned_addr learned my addr 172.21.15.139:0/3545382184 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:38.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259de00700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a006d2a0 0x7f25a015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259e800700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25a015c4c0 0x7f25a01388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259d400700 1 -- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25a015c4c0 msgr2=0x7f25a01388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259d400700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25a015c4c0 0x7f25a01388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259d400700 1 -- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a006d2a0 msgr2=0x7f25a015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259d400700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a006d2a0 0x7f25a015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259d400700 1 -- 172.21.15.139:0/3545382184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25900094b0 con 0x7f25a01448e0 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259e800700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25a015c4c0 0x7f25a01388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f259d400700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 0x7f25a013a500 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f258c001270 tx=0x7f258c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c005d90 con 0x7f25a01448e0 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c0070d0 con 0x7f25a01448e0 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a0139d00 con 0x7f25a01448e0 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c007480 con 0x7f25a01448e0 2024-09-13T17:25:38.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a00712c0 con 0x7f25a01448e0 2024-09-13T17:25:38.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.834+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a00ccc20 con 0x7f25a01448e0 2024-09-13T17:25:38.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.838+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f258c0075e0 con 0x7f25a01448e0 2024-09-13T17:25:38.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.838+0000 7f2596000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2580066730 0x7f2580068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:38.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.838+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f258c083300 con 0x7f25a01448e0 2024-09-13T17:25:38.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.838+0000 7f259de00700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2580066730 0x7f2580068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:38.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.842+0000 7f259de00700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2580066730 0x7f2580068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25900090b0 tx=0x7f2590008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:38.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:38.846+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f258c0507e0 con 0x7f25a01448e0 2024-09-13T17:25:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.090+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f25a00b42f0 con 0x7f25a01448e0 2024-09-13T17:25:39.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.094+0000 7f2596000700 1 -- 172.21.15.139:0/3545382184 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f25a00b42f0 con 0x7f25a01448e0 2024-09-13T17:25:39.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.098+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2580066730 msgr2=0x7f2580068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.098+0000 7f25a5000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2580066730 0x7f2580068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25900090b0 tx=0x7f2590008030 comp rx=0 tx=0).stop 2024-09-13T17:25:39.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.098+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 msgr2=0x7f25a013a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.098+0000 7f25a5000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 0x7f25a013a500 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f258c001270 tx=0x7f258c00c9e0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 shutdown_connections 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f2580066730 0x7f2580068bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25a015c4c0 0x7f25a01388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25a01448e0 0x7f25a013a500 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 --2- 172.21.15.139:0/3545382184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25a006d2a0 0x7f25a015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 >> 172.21.15.139:0/3545382184 conn(0x7f25a006b1e0 msgr2=0x7f25a00b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 shutdown_connections 2024-09-13T17:25:39.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.102+0000 7f25a5000700 1 -- 172.21.15.139:0/3545382184 wait complete. 2024-09-13T17:25:39.127 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:39.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 Processor -- start 2024-09-13T17:25:39.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 -- start start 2024-09-13T17:25:39.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9a181573a0 0x7f9a18160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9a1815e5c0 0x7f9a180cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a180cf620 con 0x7f9a18157780 2024-09-13T17:25:39.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180b4590 con 0x7f9a1815e5c0 2024-09-13T17:25:39.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1ec00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180b4870 con 0x7f9a181573a0 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1e200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9a1815e5c0 0x7f9a180cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1e200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9a1815e5c0 0x7f9a180cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46736/0 (socket says 172.21.15.139:46736) 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1e200700 1 -- 172.21.15.139:0/3878079481 learned_addr learned my addr 172.21.15.139:0/3878079481 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.298+0000 7f9a1d800700 1 --2- 172.21.15.139:0/3878079481 >> v2:172.21.15.176:3300/0 conn(0x7f9a181573a0 0x7f9a18160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1e200700 1 -- 172.21.15.139:0/3878079481 >> v2:172.21.15.176:3300/0 conn(0x7f9a181573a0 msgr2=0x7f9a18160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1e200700 1 --2- 172.21.15.139:0/3878079481 >> v2:172.21.15.176:3300/0 conn(0x7f9a181573a0 0x7f9a18160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1e200700 1 -- 172.21.15.139:0/3878079481 >> v1:172.21.15.176:6789/0 conn(0x7f9a18157780 legacy=0x7f9a180ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1e200700 1 -- 172.21.15.139:0/3878079481 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a180b4b50 con 0x7f9a1815e5c0 2024-09-13T17:25:39.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1e200700 1 --2- 172.21.15.139:0/3878079481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1815e5c0 0x7f9a180cefe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9a18066e80 tx=0x7f9a10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08f09793b346a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:39.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a17e00700 1 -- 172.21.15.139:0/3878079481 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000b8a0 con 0x7f9a1815e5c0 2024-09-13T17:25:39.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a17e00700 1 -- 172.21.15.139:0/3878079481 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000ba00 con 0x7f9a1815e5c0 2024-09-13T17:25:39.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a17e00700 1 -- 172.21.15.139:0/3878079481 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000bd90 con 0x7f9a1815e5c0 2024-09-13T17:25:39.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 -- 172.21.15.139:0/3878079481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1815e5c0 msgr2=0x7f9a180cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/3878079481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1815e5c0 0x7f9a180cefe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9a18066e80 tx=0x7f9a10009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 -- 172.21.15.139:0/3878079481 shutdown_connections 2024-09-13T17:25:39.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/3878079481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1815e5c0 0x7f9a180cefe0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/3878079481 >> v2:172.21.15.176:3300/0 conn(0x7f9a181573a0 0x7f9a18160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 -- 172.21.15.139:0/3878079481 >> 172.21.15.139:0/3878079481 conn(0x7f9a180cc890 msgr2=0x7f9a180ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:39.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 -- 172.21.15.139:0/3878079481 shutdown_connections 2024-09-13T17:25:39.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.302+0000 7f9a1ec00700 1 -- 172.21.15.139:0/3878079481 wait complete. 2024-09-13T17:25:39.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 Processor -- start 2024-09-13T17:25:39.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 -- start start 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a181573a0 0x7f9a1814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815e5c0 0x7f9a1814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 0x7f9a1814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a18155450 con 0x7f9a1814c140 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a18154840 con 0x7f9a181573a0 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a18154b20 con 0x7f9a1815e5c0 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 0x7f9a1814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 0x7f9a1814c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46746/0 (socket says 172.21.15.139:46746) 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 -- 172.21.15.139:0/917606234 learned_addr learned my addr 172.21.15.139:0/917606234 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:39.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1d800700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a181573a0 0x7f9a1814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ce00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815e5c0 0x7f9a1814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 -- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815e5c0 msgr2=0x7f9a1814d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815e5c0 0x7f9a1814d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 -- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a181573a0 msgr2=0x7f9a1814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a181573a0 0x7f9a1814d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 -- 172.21.15.139:0/917606234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009570 con 0x7f9a1814c140 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1d800700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a181573a0 0x7f9a1814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1e200700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 0x7f9a1814c5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9a180748b0 tx=0x7f9a10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100038c0 con 0x7f9a1814c140 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1001f070 con 0x7f9a1814c140 2024-09-13T17:25:39.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a18154e00 con 0x7f9a1814c140 2024-09-13T17:25:39.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10003c60 con 0x7f9a1814c140 2024-09-13T17:25:39.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.306+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1814cae0 con 0x7f9a1814c140 2024-09-13T17:25:39.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.310+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a180677e0 con 0x7f9a1814c140 2024-09-13T17:25:39.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.310+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a1001a430 con 0x7f9a1814c140 2024-09-13T17:25:39.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.314+0000 7f9a15600700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f99f8066760 0x7f99f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.314+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9a10021070 con 0x7f9a1814c140 2024-09-13T17:25:39.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.314+0000 7f9a1d800700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f99f8066760 0x7f99f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.314+0000 7f9a1d800700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f99f8066760 0x7f99f8068c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009b40 tx=0x7f9a0c003a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.318+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a10052fe0 con 0x7f9a1814c140 2024-09-13T17:25:39.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.502+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a18160aa0 con 0x7f9a1814c140 2024-09-13T17:25:39.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.502+0000 7f9a15600700 1 -- 172.21.15.139:0/917606234 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13110 (secure 0 0 0) 0x7f9a10056600 con 0x7f9a1814c140 2024-09-13T17:25:39.509 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:39.509 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":36,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:25:35.645528+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:39.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f99f8066760 msgr2=0x7f99f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f99f8066760 0x7f99f8068c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009b40 tx=0x7f9a0c003a80 comp rx=0 tx=0).stop 2024-09-13T17:25:39.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 msgr2=0x7f9a1814c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 0x7f9a1814c5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9a180748b0 tx=0x7f9a10004770 comp rx=0 tx=0).stop 2024-09-13T17:25:39.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 shutdown_connections 2024-09-13T17:25:39.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f99f8066760 0x7f99f8068c20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a1814c140 0x7f9a1814c5a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815e5c0 0x7f9a1814d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 --2- 172.21.15.139:0/917606234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a181573a0 0x7f9a1814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 >> 172.21.15.139:0/917606234 conn(0x7f9a180cc890 msgr2=0x7f9a181600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:39.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 shutdown_connections 2024-09-13T17:25:39.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.506+0000 7f9a1ec00700 1 -- 172.21.15.139:0/917606234 wait complete. 2024-09-13T17:25:39.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:25:39.532 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:25:39.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.710+0000 7fed16600700 1 Processor -- start 2024-09-13T17:25:39.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.710+0000 7fed16600700 1 -- start start 2024-09-13T17:25:39.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.710+0000 7fed16600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fed1015f5c0 0x7fed10143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.710+0000 7fed16600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed100b6370 con 0x7fed1015ebb0 2024-09-13T17:25:39.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.710+0000 7fed16600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed100b6650 con 0x7fed1015ef90 2024-09-13T17:25:39.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.710+0000 7fed16600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100b6930 con 0x7fed1015f5c0 2024-09-13T17:25:39.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed15200700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fed1015ebb0 0x7fed101434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52608/0 (socket says 172.21.15.139:52608) 2024-09-13T17:25:39.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed15200700 1 -- 172.21.15.139:0/4177423996 learned_addr learned my addr 172.21.15.139:0/4177423996 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:39.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0fe00700 1 --2- 172.21.15.139:0/4177423996 >> v2:172.21.15.139:3300/0 conn(0x7fed1015f5c0 0x7fed10143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0f400700 1 -- 172.21.15.139:0/4177423996 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650483324 0 0) 0x7fed100b6370 con 0x7fed1015ebb0 2024-09-13T17:25:39.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0f400700 1 -- 172.21.15.139:0/4177423996 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf80035d0 con 0x7fed1015ebb0 2024-09-13T17:25:39.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0fe00700 1 -- 172.21.15.139:0/4177423996 >> v1:172.21.15.176:6789/0 conn(0x7fed1015ef90 legacy=0x7fed100b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0f400700 1 -- 172.21.15.139:0/4177423996 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210219005 0 0) 0x7fed100b6650 con 0x7fed1015ef90 2024-09-13T17:25:39.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0fe00700 1 -- 172.21.15.139:0/4177423996 >> v1:172.21.15.139:6789/0 conn(0x7fed1015ebb0 legacy=0x7fed101434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0fe00700 1 -- 172.21.15.139:0/4177423996 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100b6c10 con 0x7fed1015f5c0 2024-09-13T17:25:39.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0fe00700 1 --2- 172.21.15.139:0/4177423996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed10143be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009850 tx=0x7fecfc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676837fab8c71039 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:39.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0f400700 1 -- 172.21.15.139:0/4177423996 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011830 con 0x7fed1015f5c0 2024-09-13T17:25:39.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0f400700 1 -- 172.21.15.139:0/4177423996 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc011990 con 0x7fed1015f5c0 2024-09-13T17:25:39.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed0f400700 1 -- 172.21.15.139:0/4177423996 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011d00 con 0x7fed1015f5c0 2024-09-13T17:25:39.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed16600700 1 -- 172.21.15.139:0/4177423996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 msgr2=0x7fed10143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed16600700 1 --2- 172.21.15.139:0/4177423996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed10143be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009850 tx=0x7fecfc009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:39.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed16600700 1 -- 172.21.15.139:0/4177423996 shutdown_connections 2024-09-13T17:25:39.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed16600700 1 --2- 172.21.15.139:0/4177423996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed10143be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.714+0000 7fed16600700 1 -- 172.21.15.139:0/4177423996 >> 172.21.15.139:0/4177423996 conn(0x7fed10071fa0 msgr2=0x7fed10072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:39.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 -- 172.21.15.139:0/4177423996 shutdown_connections 2024-09-13T17:25:39.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 -- 172.21.15.139:0/4177423996 wait complete. 2024-09-13T17:25:39.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 Processor -- start 2024-09-13T17:25:39.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 -- start start 2024-09-13T17:25:39.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed1015ebb0 0x7fed1014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed1015ef90 0x7fed1015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed101420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015b8c0 con 0x7fed1015f5c0 2024-09-13T17:25:39.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1006ccb0 con 0x7fed1015ef90 2024-09-13T17:25:39.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed16600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1006c0a0 con 0x7fed1015ebb0 2024-09-13T17:25:39.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed15c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed101420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed15c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed101420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46770/0 (socket says 172.21.15.139:46770) 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.718+0000 7fed15c00700 1 -- 172.21.15.139:0/806550468 learned_addr learned my addr 172.21.15.139:0/806550468 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed0fe00700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed1015ef90 0x7fed1015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15200700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed1015ebb0 0x7fed1014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15c00700 1 -- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed1015ebb0 msgr2=0x7fed1014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15c00700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed1015ebb0 0x7fed1014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15c00700 1 -- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed1015ef90 msgr2=0x7fed1015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15c00700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed1015ef90 0x7fed1015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15c00700 1 -- 172.21.15.139:0/806550468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0094b0 con 0x7fed1015f5c0 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15200700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed1015ebb0 0x7fed1014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:39.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed15c00700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed101420b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fed0800cc20 tx=0x7fed0800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:39.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08003e50 con 0x7fed1015f5c0 2024-09-13T17:25:39.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0800a740 con 0x7fed1015f5c0 2024-09-13T17:25:39.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1006c380 con 0x7fed1015f5c0 2024-09-13T17:25:39.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800aaf0 con 0x7fed1015f5c0 2024-09-13T17:25:39.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1006c940 con 0x7fed1015f5c0 2024-09-13T17:25:39.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.722+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed100677e0 con 0x7fed1015f5c0 2024-09-13T17:25:39.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.726+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed0800ac50 con 0x7fed1015f5c0 2024-09-13T17:25:39.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.726+0000 7fed0cc00700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fecf0066760 0x7fecf0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:39.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.726+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fed08084000 con 0x7fed1015f5c0 2024-09-13T17:25:39.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.726+0000 7fed15200700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fecf0066760 0x7fecf0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:39.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.726+0000 7fed15200700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fecf0066760 0x7fecf0068c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed04005930 tx=0x7fed04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:39.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.734+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed08051630 con 0x7fed1015f5c0 2024-09-13T17:25:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.914+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed1006ce20 con 0x7fed1015f5c0 2024-09-13T17:25:39.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.914+0000 7fed0cc00700 1 -- 172.21.15.139:0/806550468 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed08054c50 con 0x7fed1015f5c0 2024-09-13T17:25:39.918 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:25:39.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fecf0066760 msgr2=0x7fecf0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fecf0066760 0x7fecf0068c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed04005930 tx=0x7fed04009040 comp rx=0 tx=0).stop 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 msgr2=0x7fed101420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed101420b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fed0800cc20 tx=0x7fed0800cf30 comp rx=0 tx=0).stop 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 shutdown_connections 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fecf0066760 0x7fecf0068c20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed1015f5c0 0x7fed101420b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed1015ef90 0x7fed1015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 --2- 172.21.15.139:0/806550468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed1015ebb0 0x7fed1014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 >> 172.21.15.139:0/806550468 conn(0x7fed10071fa0 msgr2=0x7fed100b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 shutdown_connections 2024-09-13T17:25:39.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:39.918+0000 7fed16600700 1 -- 172.21.15.139:0/806550468 wait complete. 2024-09-13T17:25:39.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:25:40.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.110+0000 7f4bee600700 1 Processor -- start 2024-09-13T17:25:40.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.110+0000 7f4bee600700 1 -- start start 2024-09-13T17:25:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4bee600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4be81658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4bee600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be806ad70 con 0x7f4be806dd80 2024-09-13T17:25:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4bee600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be815bb70 con 0x7f4be81554d0 2024-09-13T17:25:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4bee600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80af210 con 0x7f4be806c540 2024-09-13T17:25:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f4be806dd80 0x7f4be80cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52618/0 (socket says 172.21.15.139:52618) 2024-09-13T17:25:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6a00700 1 -- 172.21.15.139:0/812559035 learned_addr learned my addr 172.21.15.139:0/812559035 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:40.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838232898 0 0) 0x7f4be806ad70 con 0x7f4be806dd80 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be7e00700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4be81658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bcc0035d0 con 0x7f4be806dd80 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 587403209 0 0) 0x7f4bcc0035d0 con 0x7f4be806dd80 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 msgr2=0x7f4be81658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4be81658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 >> v1:172.21.15.176:6789/0 conn(0x7f4be81554d0 legacy=0x7f4be815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be815be50 con 0x7f4be806dd80 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f4bd4001670 con 0x7f4be806dd80 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 >> v1:172.21.15.139:6789/0 conn(0x7f4be806dd80 legacy=0x7f4be80cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4bcc003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc003fd0 0x7f4bcc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bcc004db0 0x7f4bcc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80af210 con 0x7f4bcc004db0 2024-09-13T17:25:40.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc00bae0 con 0x7f4bcc003fd0 2024-09-13T17:25:40.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.114+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc00bca0 con 0x7f4be806c540 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4bcc003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7e00700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bcc004db0 0x7f4bcc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be6a00700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc003fd0 0x7f4bcc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 -- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc003fd0 msgr2=0x7f4bcc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc003fd0 0x7f4bcc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 -- 172.21.15.139:0/812559035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bcc004db0 msgr2=0x7f4bcc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bcc004db0 0x7f4bcc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 -- 172.21.15.139:0/812559035 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be815be50 con 0x7f4be806c540 2024-09-13T17:25:40.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7400700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4bcc003a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800c190 tx=0x7f4bcc0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc45400e7bf89b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:40.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8001db0 con 0x7f4be806c540 2024-09-13T17:25:40.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800ccd0 con 0x7f4be806c540 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be6000700 1 -- 172.21.15.139:0/812559035 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8003c60 con 0x7f4be806c540 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4bee600700 1 -- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 msgr2=0x7f4bcc003a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4bee600700 1 --2- 172.21.15.139:0/812559035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be806c540 0x7f4bcc003a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800c190 tx=0x7f4bcc0058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4be7e00700 1 -- 172.21.15.139:0/812559035 reap_dead start 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4bee600700 1 -- 172.21.15.139:0/812559035 shutdown_connections 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.118+0000 7f4bee600700 1 -- 172.21.15.139:0/812559035 >> 172.21.15.139:0/812559035 conn(0x7f4be8071170 msgr2=0x7f4be8071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:40.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.122+0000 7f4bee600700 1 -- 172.21.15.139:0/812559035 shutdown_connections 2024-09-13T17:25:40.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.122+0000 7f4bee600700 1 -- 172.21.15.139:0/812559035 wait complete. 2024-09-13T17:25:40.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.122+0000 7f4bee600700 1 Processor -- start 2024-09-13T17:25:40.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.122+0000 7f4bee600700 1 -- start start 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 0x7f4be80c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be814a970 0x7f4be80ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be80cd5f0 0x7f4be80cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be814adf0 con 0x7f4be806c540 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80cd160 con 0x7f4be814a970 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be81e2440 con 0x7f4be80cd5f0 2024-09-13T17:25:40.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 0x7f4be80c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 0x7f4be80c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46776/0 (socket says 172.21.15.139:46776) 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 -- 172.21.15.139:0/527666036 learned_addr learned my addr 172.21.15.139:0/527666036 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7e00700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be80cd5f0 0x7f4be80cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be6a00700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be814a970 0x7f4be80ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 -- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be80cd5f0 msgr2=0x7f4be80cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be80cd5f0 0x7f4be80cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 -- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be814a970 msgr2=0x7f4be80ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be814a970 0x7f4be80ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 -- 172.21.15.139:0/527666036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be80ae400 con 0x7f4be806c540 2024-09-13T17:25:40.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4be7400700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 0x7f4be80c4f00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005040 tx=0x7f4bd80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:40.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8003e90 con 0x7f4be806c540 2024-09-13T17:25:40.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd80052e0 con 0x7f4be806c540 2024-09-13T17:25:40.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be80ae120 con 0x7f4be806c540 2024-09-13T17:25:40.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8005490 con 0x7f4be806c540 2024-09-13T17:25:40.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.126+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be80ccdf0 con 0x7f4be806c540 2024-09-13T17:25:40.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.130+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be80cebf0 con 0x7f4be806c540 2024-09-13T17:25:40.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.130+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bd8019070 con 0x7f4be806c540 2024-09-13T17:25:40.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.130+0000 7f4bdf400700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4bc8066760 0x7f4bc8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.130+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4bd80850b0 con 0x7f4be806c540 2024-09-13T17:25:40.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.130+0000 7f4be6a00700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4bc8066760 0x7f4bc8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.134+0000 7f4be6a00700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4bc8066760 0x7f4bc8068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4be80acf40 tx=0x7f4bd40011c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:40.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.138+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bd80525a0 con 0x7f4be806c540 2024-09-13T17:25:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.326+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4be80b53d0 con 0x7f4be806c540 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.326+0000 7f4bdf400700 1 -- 172.21.15.139:0/527666036 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4bd8055bc0 con 0x7f4be806c540 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout: "poolnum": 1, 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout: "poolname": ".mgr" 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:40.331 INFO:teuthology.orchestra.run.smithi139.stdout:] 2024-09-13T17:25:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4bc8066760 msgr2=0x7f4bc8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4bc8066760 0x7f4bc8068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4be80acf40 tx=0x7f4bd40011c0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 msgr2=0x7f4be80c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 0x7f4be80c4f00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005040 tx=0x7f4bd80014a0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 shutdown_connections 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f4bc8066760 0x7f4bc8068c20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be80cd5f0 0x7f4be80cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be814a970 0x7f4be80ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 --2- 172.21.15.139:0/527666036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be806c540 0x7f4be80c4f00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 >> 172.21.15.139:0/527666036 conn(0x7f4be8071170 msgr2=0x7f4be80b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 shutdown_connections 2024-09-13T17:25:40.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.330+0000 7f4bee600700 1 -- 172.21.15.139:0/527666036 wait complete. 2024-09-13T17:25:40.357 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:25:40.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:25:40.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.522+0000 7f60f3e00700 1 Processor -- start 2024-09-13T17:25:40.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f3e00700 1 -- start start 2024-09-13T17:25:40.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40cd3b0 0x7f60f40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f3e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f4151e50 con 0x7f60f415af50 2024-09-13T17:25:40.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f3e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b4750 con 0x7f60f40b4ec0 2024-09-13T17:25:40.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415b730 con 0x7f60f40cd3b0 2024-09-13T17:25:40.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f2a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40cd3b0 0x7f60f40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f2000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f60f415af50 0x7f60f40cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52632/0 (socket says 172.21.15.139:52632) 2024-09-13T17:25:40.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.526+0000 7f60f2000700 1 -- 172.21.15.139:0/1140203209 learned_addr learned my addr 172.21.15.139:0/1140203209 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:40.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f2a00700 1 -- 172.21.15.139:0/1140203209 >> v1:172.21.15.176:6789/0 conn(0x7f60f40b4ec0 legacy=0x7f60f40b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f2a00700 1 -- 172.21.15.139:0/1140203209 >> v1:172.21.15.139:6789/0 conn(0x7f60f415af50 legacy=0x7f60f40cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f2a00700 1 -- 172.21.15.139:0/1140203209 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f415ba10 con 0x7f60f40cd3b0 2024-09-13T17:25:40.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f2a00700 1 --2- 172.21.15.139:0/1140203209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40cd3b0 0x7f60f40d0570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009880 tx=0x7f60e4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4281ca53240e3fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:40.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f1600700 1 -- 172.21.15.139:0/1140203209 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4011830 con 0x7f60f40cd3b0 2024-09-13T17:25:40.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f1600700 1 -- 172.21.15.139:0/1140203209 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4011990 con 0x7f60f40cd3b0 2024-09-13T17:25:40.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f1600700 1 -- 172.21.15.139:0/1140203209 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4011d20 con 0x7f60f40cd3b0 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 -- 172.21.15.139:0/1140203209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40cd3b0 msgr2=0x7f60f40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 --2- 172.21.15.139:0/1140203209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40cd3b0 0x7f60f40d0570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009880 tx=0x7f60e4009b90 comp rx=0 tx=0).stop 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 -- 172.21.15.139:0/1140203209 shutdown_connections 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 --2- 172.21.15.139:0/1140203209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40cd3b0 0x7f60f40d0570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 -- 172.21.15.139:0/1140203209 >> 172.21.15.139:0/1140203209 conn(0x7f60f4072030 msgr2=0x7f60f4072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 -- 172.21.15.139:0/1140203209 shutdown_connections 2024-09-13T17:25:40.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.530+0000 7f60f3e00700 1 -- 172.21.15.139:0/1140203209 wait complete. 2024-09-13T17:25:40.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 Processor -- start 2024-09-13T17:25:40.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 -- start start 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40b4ec0 0x7f60f41e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 0x7f60f414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f415af50 0x7f60f41f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f414a940 con 0x7f60f40cd3b0 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41f5ef0 con 0x7f60f415af50 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415c310 con 0x7f60f40b4ec0 2024-09-13T17:25:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 0x7f60f414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 0x7f60f414a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46786/0 (socket says 172.21.15.139:46786) 2024-09-13T17:25:40.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2000700 1 -- 172.21.15.139:0/2896204882 learned_addr learned my addr 172.21.15.139:0/2896204882 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:40.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40b4ec0 0x7f60f41e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f3400700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f415af50 0x7f60f41f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 -- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f415af50 msgr2=0x7f60f41f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f415af50 0x7f60f41f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 -- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 msgr2=0x7f60f414a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:40.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 0x7f60f414a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:40.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 -- 172.21.15.139:0/2896204882 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e40094b0 con 0x7f60f40b4ec0 2024-09-13T17:25:40.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2000700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 0x7f60f414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:40.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.534+0000 7f60f2a00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40b4ec0 0x7f60f41e7dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60e4016000 tx=0x7f60e4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:40.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.538+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4004480 con 0x7f60f40b4ec0 2024-09-13T17:25:40.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.538+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f41f6120 con 0x7f60f40b4ec0 2024-09-13T17:25:40.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.538+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e401f070 con 0x7f60f40b4ec0 2024-09-13T17:25:40.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.538+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4003900 con 0x7f60f40b4ec0 2024-09-13T17:25:40.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.538+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f41f66e0 con 0x7f60f40b4ec0 2024-09-13T17:25:40.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.538+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f40b2090 con 0x7f60f40b4ec0 2024-09-13T17:25:40.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.542+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60e4021030 con 0x7f60f40b4ec0 2024-09-13T17:25:40.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.542+0000 7f60eaa00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60d4066730 0x7f60d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:40.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.542+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f60e40857c0 con 0x7f60f40b4ec0 2024-09-13T17:25:40.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.542+0000 7f60f2000700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60d4066730 0x7f60d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:40.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.542+0000 7f60f2000700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60d4066730 0x7f60d4068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60f414e0d0 tx=0x7f60e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:40.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.550+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60e4052db0 con 0x7f60f40b4ec0 2024-09-13T17:25:40.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:40.730+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60f4067d60 con 0x7f60f40b4ec0 2024-09-13T17:25:41.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.690+0000 7f60eaa00700 1 -- 172.21.15.139:0/2896204882 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60e40150b0 con 0x7f60f40b4ec0 2024-09-13T17:25:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60d4066730 msgr2=0x7f60d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60d4066730 0x7f60d4068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60f414e0d0 tx=0x7f60e0009040 comp rx=0 tx=0).stop 2024-09-13T17:25:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40b4ec0 msgr2=0x7f60f41e7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40b4ec0 0x7f60f41e7dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60e4016000 tx=0x7f60e4004770 comp rx=0 tx=0).stop 2024-09-13T17:25:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 shutdown_connections 2024-09-13T17:25:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f60d4066730 0x7f60d4068bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f415af50 0x7f60f41f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60f40cd3b0 0x7f60f414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 --2- 172.21.15.139:0/2896204882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f40b4ec0 0x7f60f41e7dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 >> 172.21.15.139:0/2896204882 conn(0x7f60f4072030 msgr2=0x7f60f40b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 shutdown_connections 2024-09-13T17:25:41.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.698+0000 7f60f3e00700 1 -- 172.21.15.139:0/2896204882 wait complete. 2024-09-13T17:25:41.706 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' created 2024-09-13T17:25:41.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:25:41.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.902+0000 7f9922a00700 1 Processor -- start 2024-09-13T17:25:41.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.902+0000 7f9922a00700 1 -- start start 2024-09-13T17:25:41.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f991c06cef0 0x7f991c0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:41.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0d1a00 con 0x7f991c153b80 2024-09-13T17:25:41.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0cf4e0 con 0x7f991c153f60 2024-09-13T17:25:41.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922a00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0cf7c0 con 0x7f991c06cef0 2024-09-13T17:25:41.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9921600700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f991c153b80 0x7f991c06c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52646/0 (socket says 172.21.15.139:52646) 2024-09-13T17:25:41.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9921600700 1 -- 172.21.15.139:0/2808143576 learned_addr learned my addr 172.21.15.139:0/2808143576 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:41.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922000700 1 --2- 172.21.15.139:0/2808143576 >> v2:172.21.15.176:3300/0 conn(0x7f991c06cef0 0x7f991c0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f991be00700 1 -- 172.21.15.139:0/2808143576 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588658698 0 0) 0x7f991c0d1a00 con 0x7f991c153b80 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f991be00700 1 -- 172.21.15.139:0/2808143576 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99040035d0 con 0x7f991c153b80 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922000700 1 -- 172.21.15.139:0/2808143576 >> v1:172.21.15.176:6789/0 conn(0x7f991c153f60 legacy=0x7f991c0d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922000700 1 -- 172.21.15.139:0/2808143576 >> v1:172.21.15.139:6789/0 conn(0x7f991c153b80 legacy=0x7f991c06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.906+0000 7f9922000700 1 -- 172.21.15.139:0/2808143576 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0cfaa0 con 0x7f991c06cef0 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922000700 1 --2- 172.21.15.139:0/2808143576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c0d13a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9914009d90 tx=0x7f991400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d67364ed0b586e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f991be00700 1 -- 172.21.15.139:0/2808143576 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400e070 con 0x7f991c06cef0 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f991be00700 1 -- 172.21.15.139:0/2808143576 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400bb20 con 0x7f991c06cef0 2024-09-13T17:25:41.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f991be00700 1 -- 172.21.15.139:0/2808143576 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400be90 con 0x7f991c06cef0 2024-09-13T17:25:41.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 -- 172.21.15.139:0/2808143576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 msgr2=0x7f991c0d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 --2- 172.21.15.139:0/2808143576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c0d13a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9914009d90 tx=0x7f991400b330 comp rx=0 tx=0).stop 2024-09-13T17:25:41.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 -- 172.21.15.139:0/2808143576 shutdown_connections 2024-09-13T17:25:41.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 --2- 172.21.15.139:0/2808143576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c0d13a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 -- 172.21.15.139:0/2808143576 >> 172.21.15.139:0/2808143576 conn(0x7f991c0b6180 msgr2=0x7f991c0b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:41.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 -- 172.21.15.139:0/2808143576 shutdown_connections 2024-09-13T17:25:41.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.910+0000 7f9922a00700 1 -- 172.21.15.139:0/2808143576 wait complete. 2024-09-13T17:25:41.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 Processor -- start 2024-09-13T17:25:41.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 -- start start 2024-09-13T17:25:41.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c14b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:41.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f991c153b80 0x7f991c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:41.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 0x7f991c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:41.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1514a0 con 0x7f991c153f60 2024-09-13T17:25:41.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1f2570 con 0x7f991c06cef0 2024-09-13T17:25:41.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.914+0000 7f9922a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c14c120 con 0x7f991c153b80 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 0x7f991c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 0x7f991c0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46796/0 (socket says 172.21.15.139:46796) 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 -- 172.21.15.139:0/2104020394 learned_addr learned my addr 172.21.15.139:0/2104020394 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9921600700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c14b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9920c00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f991c153b80 0x7f991c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 -- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f991c153b80 msgr2=0x7f991c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f991c153b80 0x7f991c0b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 -- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 msgr2=0x7f991c14b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c14b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:41.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 -- 172.21.15.139:0/2104020394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009a70 con 0x7f991c153f60 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922000700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 0x7f991c0b45d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f991400b370 tx=0x7f9914004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914007000 con 0x7f991c153f60 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914012650 con 0x7f991c153f60 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c14c3c0 con 0x7f991c153f60 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914012a00 con 0x7f991c153f60 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.918+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c14c980 con 0x7f991c153f60 2024-09-13T17:25:41.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.922+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c06c7e0 con 0x7f991c153f60 2024-09-13T17:25:41.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.922+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9914012b60 con 0x7f991c153f60 2024-09-13T17:25:41.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.926+0000 7f9919600700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f98fc066730 0x7f98fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:41.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.926+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f99140863c0 con 0x7f991c153f60 2024-09-13T17:25:41.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.926+0000 7f9921600700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f98fc066730 0x7f98fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:41.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.926+0000 7f9921600700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f98fc066730 0x7f98fc068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9910007fd0 tx=0x7f9910007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:41.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:41.930+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9914053960 con 0x7f991c153f60 2024-09-13T17:25:42.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.106+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f991c15dc50 con 0x7f991c153f60 2024-09-13T17:25:42.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:42.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:25:42.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.702+0000 7f9919600700 1 -- 172.21.15.139:0/2104020394 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9914056f80 con 0x7f991c153f60 2024-09-13T17:25:42.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f98fc066730 msgr2=0x7f98fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f98fc066730 0x7f98fc068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9910007fd0 tx=0x7f9910007de0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 msgr2=0x7f991c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 0x7f991c0b45d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f991400b370 tx=0x7f9914004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 shutdown_connections 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f98fc066730 0x7f98fc068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f991c153f60 0x7f991c0b45d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f991c153b80 0x7f991c0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 --2- 172.21.15.139:0/2104020394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f991c06cef0 0x7f991c14b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.710+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 >> 172.21.15.139:0/2104020394 conn(0x7f991c0b6180 msgr2=0x7f991c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:42.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.714+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 shutdown_connections 2024-09-13T17:25:42.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.714+0000 7f9922a00700 1 -- 172.21.15.139:0/2104020394 wait complete. 2024-09-13T17:25:42.726 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' created 2024-09-13T17:25:42.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:25:42.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.930+0000 7f7070a00700 1 Processor -- start 2024-09-13T17:25:42.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.930+0000 7f7070a00700 1 -- start start 2024-09-13T17:25:42.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.930+0000 7f7070a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f706c15ce70 0x7f706c0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:42.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.930+0000 7f7070a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0cff70 con 0x7f706c0b3de0 2024-09-13T17:25:42.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.930+0000 7f7070a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0b42e0 con 0x7f706c0d1390 2024-09-13T17:25:42.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.930+0000 7f7070a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0b45c0 con 0x7f706c15ce70 2024-09-13T17:25:42.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f706c0b3de0 0x7f706c0d0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52662/0 (socket says 172.21.15.139:52662) 2024-09-13T17:25:42.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069400700 1 -- 172.21.15.139:0/272035072 learned_addr learned my addr 172.21.15.139:0/272035072 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:42.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069e00700 1 --2- 172.21.15.139:0/272035072 >> v2:172.21.15.139:3300/0 conn(0x7f706c15ce70 0x7f706c0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:42.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7068a00700 1 -- 172.21.15.139:0/272035072 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329426723 0 0) 0x7f706c0cff70 con 0x7f706c0b3de0 2024-09-13T17:25:42.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7068a00700 1 -- 172.21.15.139:0/272035072 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70500035d0 con 0x7f706c0b3de0 2024-09-13T17:25:42.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069e00700 1 -- 172.21.15.139:0/272035072 >> v1:172.21.15.176:6789/0 conn(0x7f706c0d1390 legacy=0x7f706c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069e00700 1 -- 172.21.15.139:0/272035072 >> v1:172.21.15.139:6789/0 conn(0x7f706c0b3de0 legacy=0x7f706c0d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069e00700 1 -- 172.21.15.139:0/272035072 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0b48a0 con 0x7f706c15ce70 2024-09-13T17:25:42.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7069e00700 1 --2- 172.21.15.139:0/272035072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c15ce70 0x7f706c0cfa30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f705c009850 tx=0x7f705c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1e8f970e537b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:42.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7068a00700 1 -- 172.21.15.139:0/272035072 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c011830 con 0x7f706c15ce70 2024-09-13T17:25:42.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7068a00700 1 -- 172.21.15.139:0/272035072 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c011990 con 0x7f706c15ce70 2024-09-13T17:25:42.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7068a00700 1 -- 172.21.15.139:0/272035072 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c011d00 con 0x7f706c15ce70 2024-09-13T17:25:42.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 -- 172.21.15.139:0/272035072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c15ce70 msgr2=0x7f706c0cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 --2- 172.21.15.139:0/272035072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c15ce70 0x7f706c0cfa30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f705c009850 tx=0x7f705c009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:42.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 -- 172.21.15.139:0/272035072 shutdown_connections 2024-09-13T17:25:42.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 --2- 172.21.15.139:0/272035072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c15ce70 0x7f706c0cfa30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 -- 172.21.15.139:0/272035072 >> 172.21.15.139:0/272035072 conn(0x7f706c06a390 msgr2=0x7f706c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:42.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 -- 172.21.15.139:0/272035072 shutdown_connections 2024-09-13T17:25:42.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.934+0000 7f7070a00700 1 -- 172.21.15.139:0/272035072 wait complete. 2024-09-13T17:25:42.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 Processor -- start 2024-09-13T17:25:42.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 -- start start 2024-09-13T17:25:42.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 0x7f706c14b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:42.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c0d1390 0x7f706c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:42.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706c15ce70 0x7f706c14fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:42.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c14bd50 con 0x7f706c0d1390 2024-09-13T17:25:42.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c14f060 con 0x7f706c15ce70 2024-09-13T17:25:42.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7070a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c14f340 con 0x7f706c0b3de0 2024-09-13T17:25:42.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7069400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c0d1390 0x7f706c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7069e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 0x7f706c14b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7069e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 0x7f706c14b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:43754/0 (socket says 172.21.15.139:43754) 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.938+0000 7f7069e00700 1 -- 172.21.15.139:0/3636284948 learned_addr learned my addr 172.21.15.139:0/3636284948 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f706a800700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706c15ce70 0x7f706c14fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7069e00700 1 -- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706c15ce70 msgr2=0x7f706c14fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7069e00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706c15ce70 0x7f706c14fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7069e00700 1 -- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c0d1390 msgr2=0x7f706c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7069e00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c0d1390 0x7f706c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:42.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7069e00700 1 -- 172.21.15.139:0/3636284948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0094b0 con 0x7f706c0b3de0 2024-09-13T17:25:42.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7069e00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 0x7f706c14b810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f705c009ba0 tx=0x7f705c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:42.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c004550 con 0x7f706c0b3de0 2024-09-13T17:25:42.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c14f620 con 0x7f706c0b3de0 2024-09-13T17:25:42.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c01e070 con 0x7f706c0b3de0 2024-09-13T17:25:42.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c003900 con 0x7f706c0b3de0 2024-09-13T17:25:42.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c151310 con 0x7f706c0b3de0 2024-09-13T17:25:42.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.942+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c0cfa30 con 0x7f706c0b3de0 2024-09-13T17:25:42.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.946+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f705c003a60 con 0x7f706c0b3de0 2024-09-13T17:25:42.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.946+0000 7f7062000700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f704c066730 0x7f704c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:42.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.946+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f705c0850e0 con 0x7f706c0b3de0 2024-09-13T17:25:42.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.946+0000 7f7069400700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f704c066730 0x7f704c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:42.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.946+0000 7f7069400700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f704c066730 0x7f704c068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f706c14c210 tx=0x7f7058007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:42.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:42.954+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f705c0523e0 con 0x7f706c0b3de0 2024-09-13T17:25:43.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.170+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f706c0ce340 con 0x7f706c0b3de0 2024-09-13T17:25:43.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.186+0000 7f7062000700 1 -- 172.21.15.139:0/3636284948 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f705c0200c0 con 0x7f706c0b3de0 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f704c066730 msgr2=0x7f704c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f704c066730 0x7f704c068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f706c14c210 tx=0x7f7058007de0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 msgr2=0x7f706c14b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 0x7f706c14b810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f705c009ba0 tx=0x7f705c004770 comp rx=0 tx=0).stop 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 shutdown_connections 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f704c066730 0x7f704c068bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f706c15ce70 0x7f706c14fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f706c0d1390 0x7f706c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 --2- 172.21.15.139:0/3636284948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f706c0b3de0 0x7f706c14b810 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 >> 172.21.15.139:0/3636284948 conn(0x7f706c06a390 msgr2=0x7f706c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:43.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 shutdown_connections 2024-09-13T17:25:43.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.198+0000 7f7070a00700 1 -- 172.21.15.139:0/3636284948 wait complete. 2024-09-13T17:25:43.212 INFO:teuthology.orchestra.run.smithi139.stderr:new fs with metadata pool 5 and data pool 6 2024-09-13T17:25:43.235 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:43.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.390+0000 7f9dd3e00700 1 Processor -- start 2024-09-13T17:25:43.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.390+0000 7f9dd3e00700 1 -- start start 2024-09-13T17:25:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.390+0000 7f9dd3e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9dd4146740 0x7f9dd40b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd406da70 0x7f9dd40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9dd40b5260 0x7f9dd406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd40b2420 con 0x7f9dd40b5260 2024-09-13T17:25:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd40b56d0 con 0x7f9dd4146740 2024-09-13T17:25:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd40ce1e0 con 0x7f9dd406da70 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9dd40b5260 0x7f9dd406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9dd40b5260 0x7f9dd406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46818/0 (socket says 172.21.15.139:46818) 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 -- 172.21.15.139:0/2950578823 learned_addr learned my addr 172.21.15.139:0/2950578823 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd2000700 1 --2- 172.21.15.139:0/2950578823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd406da70 0x7f9dd40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd2a00700 1 --2- 172.21.15.139:0/2950578823 >> v2:172.21.15.176:3300/0 conn(0x7f9dd4146740 0x7f9dd40b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 -- 172.21.15.139:0/2950578823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd406da70 msgr2=0x7f9dd40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:43.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 --2- 172.21.15.139:0/2950578823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd406da70 0x7f9dd40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 -- 172.21.15.139:0/2950578823 >> v2:172.21.15.176:3300/0 conn(0x7f9dd4146740 msgr2=0x7f9dd40b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 --2- 172.21.15.139:0/2950578823 >> v2:172.21.15.176:3300/0 conn(0x7f9dd4146740 0x7f9dd40b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 -- 172.21.15.139:0/2950578823 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4146b20 con 0x7f9dd40b5260 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3400700 1 --2- 172.21.15.139:0/2950578823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd40b5260 0x7f9dd406c400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40b2620 tx=0x7f9dcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b4f85ed56976f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd1600700 1 -- 172.21.15.139:0/2950578823 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00e070 con 0x7f9dd40b5260 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd1600700 1 -- 172.21.15.139:0/2950578823 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00b980 con 0x7f9dd40b5260 2024-09-13T17:25:43.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd1600700 1 -- 172.21.15.139:0/2950578823 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00bd30 con 0x7f9dd40b5260 2024-09-13T17:25:43.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2950578823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd40b5260 msgr2=0x7f9dd406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2950578823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd40b5260 0x7f9dd406c400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40b2620 tx=0x7f9dcc00b330 comp rx=0 tx=0).stop 2024-09-13T17:25:43.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2950578823 shutdown_connections 2024-09-13T17:25:43.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2950578823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd40b5260 0x7f9dd406c400 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2950578823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd406da70 0x7f9dd40b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2950578823 >> v2:172.21.15.176:3300/0 conn(0x7f9dd4146740 0x7f9dd40b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2950578823 >> 172.21.15.139:0/2950578823 conn(0x7f9dd406a390 msgr2=0x7f9dd406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:43.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2950578823 shutdown_connections 2024-09-13T17:25:43.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.394+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2950578823 wait complete. 2024-09-13T17:25:43.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 Processor -- start 2024-09-13T17:25:43.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 -- start start 2024-09-13T17:25:43.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd406da70 0x7f9dd41f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd40b5260 0x7f9dd41f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 0x7f9dd4142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4131110 con 0x7f9dd4146740 2024-09-13T17:25:43.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41430e0 con 0x7f9dd406da70 2024-09-13T17:25:43.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41433c0 con 0x7f9dd40b5260 2024-09-13T17:25:43.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.398+0000 7f9dd3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 0x7f9dd4142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd2000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd40b5260 0x7f9dd41f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd2a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd406da70 0x7f9dd41f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd2000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd40b5260 0x7f9dd41f5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:43776/0 (socket says 172.21.15.139:43776) 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd2000700 1 -- 172.21.15.139:0/2643606814 learned_addr learned my addr 172.21.15.139:0/2643606814 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 0x7f9dd4142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46822/0 (socket says 172.21.15.139:46822) 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 -- 172.21.15.139:0/2643606814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd40b5260 msgr2=0x7f9dd41f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd40b5260 0x7f9dd41f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 -- 172.21.15.139:0/2643606814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd406da70 msgr2=0x7f9dd41f5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd406da70 0x7f9dd41f5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 -- 172.21.15.139:0/2643606814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc009b30 con 0x7f9dd4146740 2024-09-13T17:25:43.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3400700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 0x7f9dd4142380 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc015000 tx=0x7f9dcc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0099b0 con 0x7f9dd4146740 2024-09-13T17:25:43.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc004250 con 0x7f9dd4146740 2024-09-13T17:25:43.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0045e0 con 0x7f9dd4146740 2024-09-13T17:25:43.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd41436a0 con 0x7f9dd4146740 2024-09-13T17:25:43.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd41f3160 con 0x7f9dd4146740 2024-09-13T17:25:43.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.402+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd4131280 con 0x7f9dd4146740 2024-09-13T17:25:43.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.406+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9dcc004740 con 0x7f9dd4146740 2024-09-13T17:25:43.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.406+0000 7f9dcaa00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9db4066730 0x7f9db4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.406+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9dcc085400 con 0x7f9dd4146740 2024-09-13T17:25:43.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.406+0000 7f9dd2a00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9db4066730 0x7f9db4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.406+0000 7f9dd2a00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9db4066730 0x7f9db4068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009a00 tx=0x7f9dc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.414+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9dcc052650 con 0x7f9dd4146740 2024-09-13T17:25:43.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.602+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dd40b4d20 con 0x7f9dd4146740 2024-09-13T17:25:43.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.606+0000 7f9dcaa00700 1 -- 172.21.15.139:0/2643606814 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16835 (secure 0 0 0) 0x7f9dcc055c70 con 0x7f9dd4146740 2024-09-13T17:25:43.612 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:43.612 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":39,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:25:43.177547+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9db4066730 msgr2=0x7f9db4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9db4066730 0x7f9db4068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009a00 tx=0x7f9dc4008040 comp rx=0 tx=0).stop 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 msgr2=0x7f9dd4142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 0x7f9dd4142380 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc015000 tx=0x7f9dcc004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 shutdown_connections 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9db4066730 0x7f9db4068bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dd4146740 0x7f9dd4142380 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dd40b5260 0x7f9dd41f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 --2- 172.21.15.139:0/2643606814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd406da70 0x7f9dd41f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.610+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 >> 172.21.15.139:0/2643606814 conn(0x7f9dd406a390 msgr2=0x7f9dd40ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:43.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.614+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 shutdown_connections 2024-09-13T17:25:43.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.614+0000 7f9dd3e00700 1 -- 172.21.15.139:0/2643606814 wait complete. 2024-09-13T17:25:43.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:43.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.806+0000 7fc035400700 1 Processor -- start 2024-09-13T17:25:43.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc035400700 1 -- start start 2024-09-13T17:25:43.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc035400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc0300ce410 0x7fc03015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc035400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc03006d2a0 0x7fc0300719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc035400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300cd570 con 0x7fc0301592a0 2024-09-13T17:25:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc035400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03015a8a0 con 0x7fc03006d2a0 2024-09-13T17:25:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc035400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300b41c0 con 0x7fc0300ce410 2024-09-13T17:25:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc02f200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc03006d2a0 0x7fc0300719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc02de00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc0301592a0 0x7fc0300cda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52676/0 (socket says 172.21.15.139:52676) 2024-09-13T17:25:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc02e800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc0300ce410 0x7fc03015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.810+0000 7fc02de00700 1 -- 172.21.15.139:0/1497141977 learned_addr learned my addr 172.21.15.139:0/1497141977 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02f200700 1 -- 172.21.15.139:0/1497141977 >> v2:172.21.15.176:3300/0 conn(0x7fc0300ce410 msgr2=0x7fc03015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02f200700 1 --2- 172.21.15.139:0/1497141977 >> v2:172.21.15.176:3300/0 conn(0x7fc0300ce410 0x7fc03015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02f200700 1 -- 172.21.15.139:0/1497141977 >> v1:172.21.15.139:6789/0 conn(0x7fc0301592a0 legacy=0x7fc0300cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02f200700 1 -- 172.21.15.139:0/1497141977 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300ce960 con 0x7fc03006d2a0 2024-09-13T17:25:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02d400700 1 -- 172.21.15.139:0/1497141977 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862788530 0 0) 0x7fc0300cd570 con 0x7fc0301592a0 2024-09-13T17:25:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02f200700 1 --2- 172.21.15.139:0/1497141977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc03006d2a0 0x7fc0300719c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc030067080 tx=0x7fc02800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be69bedb2755213 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02d400700 1 -- 172.21.15.139:0/1497141977 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800e070 con 0x7fc03006d2a0 2024-09-13T17:25:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02d400700 1 -- 172.21.15.139:0/1497141977 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800bb20 con 0x7fc03006d2a0 2024-09-13T17:25:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc02d400700 1 -- 172.21.15.139:0/1497141977 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028012430 con 0x7fc03006d2a0 2024-09-13T17:25:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 -- 172.21.15.139:0/1497141977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc03006d2a0 msgr2=0x7fc0300719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 --2- 172.21.15.139:0/1497141977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc03006d2a0 0x7fc0300719c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc030067080 tx=0x7fc02800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 -- 172.21.15.139:0/1497141977 shutdown_connections 2024-09-13T17:25:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 --2- 172.21.15.139:0/1497141977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc03006d2a0 0x7fc0300719c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 --2- 172.21.15.139:0/1497141977 >> v2:172.21.15.176:3300/0 conn(0x7fc0300ce410 0x7fc03015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 -- 172.21.15.139:0/1497141977 >> 172.21.15.139:0/1497141977 conn(0x7fc03006b1e0 msgr2=0x7fc03006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 -- 172.21.15.139:0/1497141977 shutdown_connections 2024-09-13T17:25:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.814+0000 7fc035400700 1 -- 172.21.15.139:0/1497141977 wait complete. 2024-09-13T17:25:43.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.818+0000 7fc035400700 1 Processor -- start 2024-09-13T17:25:43.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.818+0000 7fc035400700 1 -- start start 2024-09-13T17:25:43.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03006d2a0 0x7fc03014eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0300ce410 0x7fc03014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 0x7fc03014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03014f110 con 0x7fc0301592a0 2024-09-13T17:25:43.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03014f3f0 con 0x7fc03006d2a0 2024-09-13T17:25:43.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03014f6d0 con 0x7fc0300ce410 2024-09-13T17:25:43.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 0x7fc03014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 0x7fc03014a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46854/0 (socket says 172.21.15.139:46854) 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 -- 172.21.15.139:0/2599004619 learned_addr learned my addr 172.21.15.139:0/2599004619 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02e800700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03006d2a0 0x7fc03014eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02de00700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0300ce410 0x7fc03014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 -- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0300ce410 msgr2=0x7fc03014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0300ce410 0x7fc03014a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 -- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03006d2a0 msgr2=0x7fc03014eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03006d2a0 0x7fc03014eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 -- 172.21.15.139:0/2599004619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009a70 con 0x7fc0301592a0 2024-09-13T17:25:43.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02de00700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0300ce410 0x7fc03014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:43.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc02f200700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 0x7fc03014a140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc028014040 tx=0x7fc028004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028012430 con 0x7fc0301592a0 2024-09-13T17:25:43.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028020070 con 0x7fc0301592a0 2024-09-13T17:25:43.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03014f9b0 con 0x7fc0301592a0 2024-09-13T17:25:43.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028004280 con 0x7fc0301592a0 2024-09-13T17:25:43.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.822+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0301579c0 con 0x7fc0301592a0 2024-09-13T17:25:43.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.826+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03014fed0 con 0x7fc0301592a0 2024-09-13T17:25:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.826+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0280043e0 con 0x7fc0301592a0 2024-09-13T17:25:43.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.826+0000 7fc026a00700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc010066730 0x7fc010068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:43.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.826+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc028022070 con 0x7fc0301592a0 2024-09-13T17:25:43.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.826+0000 7fc02e800700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc010066730 0x7fc010068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.830+0000 7fc02e800700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc010066730 0x7fc010068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc030157170 tx=0x7fc020009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:43.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:43.834+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc03014fed0 con 0x7fc0301592a0 2024-09-13T17:25:44.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.022+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc03014fed0 con 0x7fc0301592a0 2024-09-13T17:25:44.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.022+0000 7fc026a00700 1 -- 172.21.15.139:0/2599004619 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16835 (secure 0 0 0) 0x7fc03014fed0 con 0x7fc0301592a0 2024-09-13T17:25:44.029 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:44.029 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":39,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:25:43.177547+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc010066730 msgr2=0x7fc010068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc010066730 0x7fc010068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc030157170 tx=0x7fc020009240 comp rx=0 tx=0).stop 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 msgr2=0x7fc03014a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 0x7fc03014a140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc028014040 tx=0x7fc028004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 shutdown_connections 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fc010066730 0x7fc010068bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0301592a0 0x7fc03014a140 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0300ce410 0x7fc03014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 --2- 172.21.15.139:0/2599004619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03006d2a0 0x7fc03014eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 >> 172.21.15.139:0/2599004619 conn(0x7fc03006b1e0 msgr2=0x7fc03006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 shutdown_connections 2024-09-13T17:25:44.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.026+0000 7fc035400700 1 -- 172.21.15.139:0/2599004619 wait complete. 2024-09-13T17:25:44.053 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:25:44.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.206+0000 7fef17e00700 1 Processor -- start 2024-09-13T17:25:44.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.206+0000 7fef17e00700 1 -- start start 2024-09-13T17:25:44.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef1813c860 0x7fef1813f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fef1813f5d0 0x7fef180ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1815d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1813fa40 con 0x7fef1813f5d0 2024-09-13T17:25:44.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180cfa80 con 0x7fef1813c860 2024-09-13T17:25:44.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180cef00 con 0x7fef180ce610 2024-09-13T17:25:44.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fef1813f5d0 0x7fef180ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fef1813f5d0 0x7fef180ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46864/0 (socket says 172.21.15.139:46864) 2024-09-13T17:25:44.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 -- 172.21.15.139:0/753456626 learned_addr learned my addr 172.21.15.139:0/753456626 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:44.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef16a00700 1 --2- 172.21.15.139:0/753456626 >> v2:172.21.15.176:3300/0 conn(0x7fef1813c860 0x7fef1813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17400700 1 --2- 172.21.15.139:0/753456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 -- 172.21.15.139:0/753456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 msgr2=0x7fef1815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:44.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 --2- 172.21.15.139:0/753456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1815d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 -- 172.21.15.139:0/753456626 >> v2:172.21.15.176:3300/0 conn(0x7fef1813c860 msgr2=0x7fef1813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:44.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 --2- 172.21.15.139:0/753456626 >> v2:172.21.15.176:3300/0 conn(0x7fef1813c860 0x7fef1813f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 -- 172.21.15.139:0/753456626 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180cf1e0 con 0x7fef1813f5d0 2024-09-13T17:25:44.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef0fe00700 1 --2- 172.21.15.139:0/753456626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef180ce0d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fef1806a810 tx=0x7fef00009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8924d7157eb801b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:44.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef16000700 1 -- 172.21.15.139:0/753456626 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00011830 con 0x7fef1813f5d0 2024-09-13T17:25:44.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef16000700 1 -- 172.21.15.139:0/753456626 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef00011990 con 0x7fef1813f5d0 2024-09-13T17:25:44.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef16000700 1 -- 172.21.15.139:0/753456626 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00011d20 con 0x7fef1813f5d0 2024-09-13T17:25:44.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 -- 172.21.15.139:0/753456626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 msgr2=0x7fef180ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:44.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.210+0000 7fef17e00700 1 --2- 172.21.15.139:0/753456626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef180ce0d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fef1806a810 tx=0x7fef00009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 -- 172.21.15.139:0/753456626 shutdown_connections 2024-09-13T17:25:44.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 --2- 172.21.15.139:0/753456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1815d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 --2- 172.21.15.139:0/753456626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef180ce0d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 --2- 172.21.15.139:0/753456626 >> v2:172.21.15.176:3300/0 conn(0x7fef1813c860 0x7fef1813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 -- 172.21.15.139:0/753456626 >> 172.21.15.139:0/753456626 conn(0x7fef18071f30 msgr2=0x7fef18072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:44.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 -- 172.21.15.139:0/753456626 shutdown_connections 2024-09-13T17:25:44.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 -- 172.21.15.139:0/753456626 wait complete. 2024-09-13T17:25:44.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 Processor -- start 2024-09-13T17:25:44.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.214+0000 7fef17e00700 1 -- start start 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1813a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef1813c860 0x7fef1813a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef1813ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180af800 con 0x7fef1813f5d0 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18157600 con 0x7fef1813c860 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1813b080 con 0x7fef180ce610 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef1813ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef1813ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46880/0 (socket says 172.21.15.139:46880) 2024-09-13T17:25:44.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 -- 172.21.15.139:0/2394617613 learned_addr learned my addr 172.21.15.139:0/2394617613 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef16a00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1813a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef0fe00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef1813c860 0x7fef1813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 -- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 msgr2=0x7fef1813a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1813a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 -- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef1813c860 msgr2=0x7fef1813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef1813c860 0x7fef1813a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 -- 172.21.15.139:0/2394617613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00009570 con 0x7fef1813f5d0 2024-09-13T17:25:44.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef0fe00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef1813c860 0x7fef1813a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:44.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17400700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef1813ab40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef10009dd0 tx=0x7fef1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:44.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1000cd40 con 0x7fef1813f5d0 2024-09-13T17:25:44.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1000f040 con 0x7fef1813f5d0 2024-09-13T17:25:44.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18137680 con 0x7fef1813f5d0 2024-09-13T17:25:44.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100146c0 con 0x7fef1813f5d0 2024-09-13T17:25:44.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.218+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef18137c40 con 0x7fef1813f5d0 2024-09-13T17:25:44.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.222+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180af940 con 0x7fef1813f5d0 2024-09-13T17:25:44.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.222+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef10014820 con 0x7fef1813f5d0 2024-09-13T17:25:44.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.222+0000 7fef0ea00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feef4066730 0x7feef4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:44.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.222+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fef10084c50 con 0x7fef1813f5d0 2024-09-13T17:25:44.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.222+0000 7fef16a00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feef4066730 0x7feef4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:44.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.226+0000 7fef16a00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feef4066730 0x7feef4068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef08009b00 tx=0x7fef08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:44.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.230+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef180af940 con 0x7fef1813f5d0 2024-09-13T17:25:44.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:44.446+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fef180af940 con 0x7fef1813f5d0 2024-09-13T17:25:45.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.198+0000 7fef0ea00700 1 -- 172.21.15.139:0/2394617613 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fef180af940 con 0x7fef1813f5d0 2024-09-13T17:25:45.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feef4066730 msgr2=0x7feef4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:45.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feef4066730 0x7feef4068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef08009b00 tx=0x7fef08008040 comp rx=0 tx=0).stop 2024-09-13T17:25:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 msgr2=0x7fef1813ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef1813ab40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef10009dd0 tx=0x7fef1000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 shutdown_connections 2024-09-13T17:25:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7feef4066730 0x7feef4068bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef1813f5d0 0x7fef1813ab40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef1813c860 0x7fef1813a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 --2- 172.21.15.139:0/2394617613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef180ce610 0x7fef1813a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 >> 172.21.15.139:0/2394617613 conn(0x7fef18071f30 msgr2=0x7fef18165a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 shutdown_connections 2024-09-13T17:25:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.202+0000 7fef17e00700 1 -- 172.21.15.139:0/2394617613 wait complete. 2024-09-13T17:25:45.233 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:25:45.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:25:45.396 INFO:tasks.ceph.mds.b.smithi176.stderr:2024-09-13T17:25:45.392+0000 7fe6d4200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:25:45.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.418+0000 7f1d29c00700 1 Processor -- start 2024-09-13T17:25:45.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.418+0000 7f1d29c00700 1 -- start start 2024-09-13T17:25:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.418+0000 7f1d29c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2415abb0 0x7f1d240cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.418+0000 7f1d29c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1d2406e200 0x7f1d2415af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1d2406ac20 0x7f1d2406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2406b610 con 0x7f1d2406ac20 2024-09-13T17:25:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d240cde30 con 0x7f1d2406e200 2024-09-13T17:25:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d240ce110 con 0x7f1d2415abb0 2024-09-13T17:25:45.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1d2406ac20 0x7f1d2406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1d2406ac20 0x7f1d2406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56108/0 (socket says 172.21.15.139:56108) 2024-09-13T17:25:45.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 -- 172.21.15.139:0/366070379 learned_addr learned my addr 172.21.15.139:0/366070379 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d23e00700 1 --2- 172.21.15.139:0/366070379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2415abb0 0x7f1d240cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d23400700 1 --2- 172.21.15.139:0/366070379 >> v2:172.21.15.176:3300/0 conn(0x7f1d2406e200 0x7f1d2415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 -- 172.21.15.139:0/366070379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2415abb0 msgr2=0x7f1d240cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 --2- 172.21.15.139:0/366070379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2415abb0 0x7f1d240cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 -- 172.21.15.139:0/366070379 >> v2:172.21.15.176:3300/0 conn(0x7f1d2406e200 msgr2=0x7f1d2415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 --2- 172.21.15.139:0/366070379 >> v2:172.21.15.176:3300/0 conn(0x7f1d2406e200 0x7f1d2415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 -- 172.21.15.139:0/366070379 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240ce3f0 con 0x7f1d2406ac20 2024-09-13T17:25:45.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29200700 1 --2- 172.21.15.139:0/366070379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2406ac20 0x7f1d2406b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1d24066ff0 tx=0x7f1d1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189628fe72626ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:45.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d22a00700 1 -- 172.21.15.139:0/366070379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00e070 con 0x7f1d2406ac20 2024-09-13T17:25:45.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d22a00700 1 -- 172.21.15.139:0/366070379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c00b910 con 0x7f1d2406ac20 2024-09-13T17:25:45.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d22a00700 1 -- 172.21.15.139:0/366070379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00bcc0 con 0x7f1d2406ac20 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- 172.21.15.139:0/366070379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2406ac20 msgr2=0x7f1d2406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 --2- 172.21.15.139:0/366070379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2406ac20 0x7f1d2406b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1d24066ff0 tx=0x7f1d1c00b330 comp rx=0 tx=0).stop 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- 172.21.15.139:0/366070379 shutdown_connections 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 --2- 172.21.15.139:0/366070379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2406ac20 0x7f1d2406b0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 --2- 172.21.15.139:0/366070379 >> v2:172.21.15.176:3300/0 conn(0x7f1d2406e200 0x7f1d2415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 --2- 172.21.15.139:0/366070379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2415abb0 0x7f1d240cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- 172.21.15.139:0/366070379 >> 172.21.15.139:0/366070379 conn(0x7f1d240cc890 msgr2=0x7f1d240ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.422+0000 7f1d29c00700 1 -- 172.21.15.139:0/366070379 shutdown_connections 2024-09-13T17:25:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.426+0000 7f1d29c00700 1 -- 172.21.15.139:0/366070379 wait complete. 2024-09-13T17:25:45.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.426+0000 7f1d29c00700 1 Processor -- start 2024-09-13T17:25:45.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.426+0000 7f1d29c00700 1 -- start start 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d2406ac20 0x7f1d2406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2406e200 0x7f1d24156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 0x7f1d241443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2406ceb0 con 0x7f1d2415abb0 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2406c230 con 0x7f1d2406ac20 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2406c510 con 0x7f1d2406e200 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 0x7f1d241443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 0x7f1d241443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56116/0 (socket says 172.21.15.139:56116) 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 -- 172.21.15.139:0/866589027 learned_addr learned my addr 172.21.15.139:0/866589027 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d23400700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2406e200 0x7f1d24156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d23e00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d2406ac20 0x7f1d2406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 -- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2406e200 msgr2=0x7f1d24156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2406e200 0x7f1d24156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 -- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d2406ac20 msgr2=0x7f1d2406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d2406ac20 0x7f1d2406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 -- 172.21.15.139:0/866589027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009b30 con 0x7f1d2415abb0 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d23400700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2406e200 0x7f1d24156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d23e00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d2406ac20 0x7f1d2406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29200700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 0x7f1d241443b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d24074850 tx=0x7f1d1c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00ce80 con 0x7f1d2415abb0 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c004250 con 0x7f1d2415abb0 2024-09-13T17:25:45.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2406c7f0 con 0x7f1d2415abb0 2024-09-13T17:25:45.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c004600 con 0x7f1d2415abb0 2024-09-13T17:25:45.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.430+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2406d810 con 0x7f1d2415abb0 2024-09-13T17:25:45.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.434+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d240677e0 con 0x7f1d2415abb0 2024-09-13T17:25:45.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.434+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d1c004760 con 0x7f1d2415abb0 2024-09-13T17:25:45.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.438+0000 7f1d1be00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d04066730 0x7f1d04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:45.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.438+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1d1c0857f0 con 0x7f1d2415abb0 2024-09-13T17:25:45.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.438+0000 7f1d23e00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d04066730 0x7f1d04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:45.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.438+0000 7f1d23e00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d04066730 0x7f1d04068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009ba0 tx=0x7f1d14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:45.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.442+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d1c052990 con 0x7f1d2415abb0 2024-09-13T17:25:45.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:45.666+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d2406cff0 con 0x7f1d2415abb0 2024-09-13T17:25:46.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.198+0000 7f1d1be00700 1 -- 172.21.15.139:0/866589027 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d2406cff0 con 0x7f1d2415abb0 2024-09-13T17:25:46.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d04066730 msgr2=0x7f1d04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d04066730 0x7f1d04068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009ba0 tx=0x7f1d14008040 comp rx=0 tx=0).stop 2024-09-13T17:25:46.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 msgr2=0x7f1d241443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 0x7f1d241443b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d24074850 tx=0x7f1d1c004af0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 shutdown_connections 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1d04066730 0x7f1d04068bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2415abb0 0x7f1d241443b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d2406e200 0x7f1d24156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 --2- 172.21.15.139:0/866589027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d2406ac20 0x7f1d2406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 >> 172.21.15.139:0/866589027 conn(0x7f1d240cc890 msgr2=0x7f1d240ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 shutdown_connections 2024-09-13T17:25:46.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.206+0000 7f1d29c00700 1 -- 172.21.15.139:0/866589027 wait complete. 2024-09-13T17:25:46.234 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:25:46.234 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:25:46.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.410+0000 7f4921e00700 1 Processor -- start 2024-09-13T17:25:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.410+0000 7f4921e00700 1 -- start start 2024-09-13T17:25:46.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f491c164960 0x7f491c162360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f491c162aa0 0x7f491c0d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c1628a0 con 0x7f491c0d11c0 2024-09-13T17:25:46.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0ce6a0 con 0x7f491c162aa0 2024-09-13T17:25:46.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0cda20 con 0x7f491c164960 2024-09-13T17:25:46.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f491c162aa0 0x7f491c0d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491aa00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f491c164960 0x7f491c162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f491c162aa0 0x7f491c0d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56130/0 (socket says 172.21.15.139:56130) 2024-09-13T17:25:46.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 -- 172.21.15.139:0/3508052612 learned_addr learned my addr 172.21.15.139:0/3508052612 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:46.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491b400700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f491c0d11c0 0x7f491c0b3de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:38138/0 (socket says 172.21.15.139:38138) 2024-09-13T17:25:46.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 -- 172.21.15.139:0/3508052612 >> v2:172.21.15.176:3300/0 conn(0x7f491c164960 msgr2=0x7f491c162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:46.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 --2- 172.21.15.139:0/3508052612 >> v2:172.21.15.176:3300/0 conn(0x7f491c164960 0x7f491c162360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 -- 172.21.15.139:0/3508052612 >> v1:172.21.15.176:6789/0 conn(0x7f491c0d11c0 legacy=0x7f491c0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 -- 172.21.15.139:0/3508052612 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0cdd00 con 0x7f491c162aa0 2024-09-13T17:25:46.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f491a000700 1 --2- 172.21.15.139:0/3508052612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c162aa0 0x7f491c0d0c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f491c073a70 tx=0x7f4908009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74abb97a198ecb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:46.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4919600700 1 -- 172.21.15.139:0/3508052612 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908011830 con 0x7f491c162aa0 2024-09-13T17:25:46.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4919600700 1 -- 172.21.15.139:0/3508052612 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908011990 con 0x7f491c162aa0 2024-09-13T17:25:46.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4919600700 1 -- 172.21.15.139:0/3508052612 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908011d20 con 0x7f491c162aa0 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- 172.21.15.139:0/3508052612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c162aa0 msgr2=0x7f491c0d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 --2- 172.21.15.139:0/3508052612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c162aa0 0x7f491c0d0c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f491c073a70 tx=0x7f4908009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- 172.21.15.139:0/3508052612 shutdown_connections 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 --2- 172.21.15.139:0/3508052612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c162aa0 0x7f491c0d0c80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 --2- 172.21.15.139:0/3508052612 >> v2:172.21.15.176:3300/0 conn(0x7f491c164960 0x7f491c162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- 172.21.15.139:0/3508052612 >> 172.21.15.139:0/3508052612 conn(0x7f491c06a390 msgr2=0x7f491c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- 172.21.15.139:0/3508052612 shutdown_connections 2024-09-13T17:25:46.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.414+0000 7f4921e00700 1 -- 172.21.15.139:0/3508052612 wait complete. 2024-09-13T17:25:46.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 Processor -- start 2024-09-13T17:25:46.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 -- start start 2024-09-13T17:25:46.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 0x7f491c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f491c162aa0 0x7f491c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 0x7f491c160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c06ff50 con 0x7f491c164960 2024-09-13T17:25:46.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c14f8d0 con 0x7f491c162aa0 2024-09-13T17:25:46.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f4921e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c15d380 con 0x7f491c0d11c0 2024-09-13T17:25:46.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f491b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 0x7f491c160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f491aa00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 0x7f491c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f491aa00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 0x7f491c14f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:48456/0 (socket says 172.21.15.139:48456) 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f491aa00700 1 -- 172.21.15.139:0/415500817 learned_addr learned my addr 172.21.15.139:0/415500817 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f491b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 0x7f491c160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56138/0 (socket says 172.21.15.139:56138) 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.418+0000 7f491a000700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f491c162aa0 0x7f491c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491aa00700 1 -- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f491c162aa0 msgr2=0x7f491c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491aa00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f491c162aa0 0x7f491c15e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491aa00700 1 -- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 msgr2=0x7f491c160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491aa00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 0x7f491c160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491aa00700 1 -- 172.21.15.139:0/415500817 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009570 con 0x7f491c0d11c0 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491b400700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 0x7f491c160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:46.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f491aa00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 0x7f491c14f390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e870 tx=0x7f490c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:46.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0095a0 con 0x7f491c0d11c0 2024-09-13T17:25:46.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c013680 con 0x7f491c0d11c0 2024-09-13T17:25:46.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c15d660 con 0x7f491c0d11c0 2024-09-13T17:25:46.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0139f0 con 0x7f491c0d11c0 2024-09-13T17:25:46.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c15dc20 con 0x7f491c0d11c0 2024-09-13T17:25:46.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.422+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0b5760 con 0x7f491c0d11c0 2024-09-13T17:25:46.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.426+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f490c013b50 con 0x7f491c0d11c0 2024-09-13T17:25:46.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.426+0000 7f4913400700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f48fc066760 0x7f48fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.426+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f490c0840f0 con 0x7f491c0d11c0 2024-09-13T17:25:46.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.426+0000 7f491a000700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f48fc066760 0x7f48fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.426+0000 7f491a000700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f48fc066760 0x7f48fc068c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f491c073a70 tx=0x7f4908008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:46.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.434+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f490c051310 con 0x7f491c0d11c0 2024-09-13T17:25:46.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.662+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f491c0cf130 con 0x7f491c0d11c0 2024-09-13T17:25:46.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.666+0000 7f4913400700 1 -- 172.21.15.139:0/415500817 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f490c054930 con 0x7f491c0d11c0 2024-09-13T17:25:46.669 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:46.669 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:25:43.178317+0000","modified":"2024-09-13T17:25:46.195947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6833/501919372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":501919372},{"type":"v1","addr":"172.21.15.176:6833","nonce":501919372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f48fc066760 msgr2=0x7f48fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f48fc066760 0x7f48fc068c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f491c073a70 tx=0x7f4908008030 comp rx=0 tx=0).stop 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 msgr2=0x7f491c14f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 0x7f491c14f390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e870 tx=0x7f490c00eb80 comp rx=0 tx=0).stop 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 shutdown_connections 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f48fc066760 0x7f48fc068c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f491c164960 0x7f491c160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f491c162aa0 0x7f491c15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 --2- 172.21.15.139:0/415500817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f491c0d11c0 0x7f491c14f390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 >> 172.21.15.139:0/415500817 conn(0x7f491c06a390 msgr2=0x7f491c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:46.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 shutdown_connections 2024-09-13T17:25:46.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.670+0000 7f4921e00700 1 -- 172.21.15.139:0/415500817 wait complete. 2024-09-13T17:25:46.677 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2024-09-13T17:25:46.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:25:46.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.854+0000 7f93b1c00700 1 Processor -- start 2024-09-13T17:25:46.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.854+0000 7f93b1c00700 1 -- start start 2024-09-13T17:25:46.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93b1c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93b1c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f93ac15e030 0x7f93ac0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93b1c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0b1740 con 0x7f93ac0d1570 2024-09-13T17:25:46.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93b1c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0d08c0 con 0x7f93ac15e030 2024-09-13T17:25:46.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93b1c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0d19e0 con 0x7f93ac146690 2024-09-13T17:25:46.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac0d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:48460/0 (socket says 172.21.15.139:48460) 2024-09-13T17:25:46.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 -- 172.21.15.139:0/3795524696 learned_addr learned my addr 172.21.15.139:0/3795524696 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:46.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93a3400700 1 --2- 172.21.15.139:0/3795524696 >> v2:172.21.15.176:3300/0 conn(0x7f93ac15e030 0x7f93ac0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 -- 172.21.15.139:0/3795524696 >> v2:172.21.15.176:3300/0 conn(0x7f93ac15e030 msgr2=0x7f93ac0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:46.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 --2- 172.21.15.139:0/3795524696 >> v2:172.21.15.176:3300/0 conn(0x7f93ac15e030 0x7f93ac0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 -- 172.21.15.139:0/3795524696 >> v1:172.21.15.176:6789/0 conn(0x7f93ac0d1570 legacy=0x7f93ac0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 -- 172.21.15.139:0/3795524696 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0b3760 con 0x7f93ac146690 2024-09-13T17:25:46.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.858+0000 7f93abe00700 1 --2- 172.21.15.139:0/3795524696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac0d0380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f939c009910 tx=0x7f939c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e92d708fa7d2b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:46.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93ab400700 1 -- 172.21.15.139:0/3795524696 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c011830 con 0x7f93ac146690 2024-09-13T17:25:46.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93ab400700 1 -- 172.21.15.139:0/3795524696 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c011990 con 0x7f93ac146690 2024-09-13T17:25:46.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93ab400700 1 -- 172.21.15.139:0/3795524696 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c011d40 con 0x7f93ac146690 2024-09-13T17:25:46.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 -- 172.21.15.139:0/3795524696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 msgr2=0x7f93ac0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 --2- 172.21.15.139:0/3795524696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac0d0380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f939c009910 tx=0x7f939c009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:46.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 -- 172.21.15.139:0/3795524696 shutdown_connections 2024-09-13T17:25:46.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 --2- 172.21.15.139:0/3795524696 >> v2:172.21.15.176:3300/0 conn(0x7f93ac15e030 0x7f93ac0d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 --2- 172.21.15.139:0/3795524696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac0d0380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 -- 172.21.15.139:0/3795524696 >> 172.21.15.139:0/3795524696 conn(0x7f93ac071fa0 msgr2=0x7f93ac072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:46.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 -- 172.21.15.139:0/3795524696 shutdown_connections 2024-09-13T17:25:46.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.862+0000 7f93b1c00700 1 -- 172.21.15.139:0/3795524696 wait complete. 2024-09-13T17:25:46.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 Processor -- start 2024-09-13T17:25:46.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 -- start start 2024-09-13T17:25:46.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ac0d1570 0x7f93ac0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 0x7f93ac0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac15cd80 con 0x7f93ac15e030 2024-09-13T17:25:46.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0a9870 con 0x7f93ac0d1570 2024-09-13T17:25:46.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0a89c0 con 0x7f93ac146690 2024-09-13T17:25:46.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 0x7f93ac0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 0x7f93ac0a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56144/0 (socket says 172.21.15.139:56144) 2024-09-13T17:25:46.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93b1200700 1 -- 172.21.15.139:0/1140417519 learned_addr learned my addr 172.21.15.139:0/1140417519 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:46.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93abe00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ac0d1570 0x7f93ac0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.866+0000 7f93a3400700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1200700 1 -- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 msgr2=0x7f93ac15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1200700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1200700 1 -- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ac0d1570 msgr2=0x7f93ac0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1200700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ac0d1570 0x7f93ac0b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1200700 1 -- 172.21.15.139:0/1140417519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c009570 con 0x7f93ac15e030 2024-09-13T17:25:46.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1200700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 0x7f93ac0a8480 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f93a400cc80 tx=0x7f93a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:46.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4003c20 con 0x7f93ac15e030 2024-09-13T17:25:46.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4003d80 con 0x7f93ac15e030 2024-09-13T17:25:46.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400aaa0 con 0x7f93ac15e030 2024-09-13T17:25:46.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac0a8c60 con 0x7f93ac15e030 2024-09-13T17:25:46.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0a9220 con 0x7f93ac15e030 2024-09-13T17:25:46.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.870+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac0677e0 con 0x7f93ac15e030 2024-09-13T17:25:46.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.874+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93a400ac00 con 0x7f93ac15e030 2024-09-13T17:25:46.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.874+0000 7f93a8c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9388066730 0x7f9388068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:46.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.874+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93a4084200 con 0x7f93ac15e030 2024-09-13T17:25:46.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.874+0000 7f93abe00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9388066730 0x7f9388068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:46.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.874+0000 7f93abe00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9388066730 0x7f9388068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f939c009c60 tx=0x7f939c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:46.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:46.882+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93a4051420 con 0x7f93ac15e030 2024-09-13T17:25:47.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.070+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93ac0b2230 con 0x7f93ac15e030 2024-09-13T17:25:47.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.070+0000 7f93a8c00700 1 -- 172.21.15.139:0/1140417519 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16822 (secure 0 0 0) 0x7f93a4054a40 con 0x7f93ac15e030 2024-09-13T17:25:47.077 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:47.077 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":40,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:25:44.183390+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9388066730 msgr2=0x7f9388068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9388066730 0x7f9388068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f939c009c60 tx=0x7f939c008030 comp rx=0 tx=0).stop 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 msgr2=0x7f93ac0a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 0x7f93ac0a8480 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f93a400cc80 tx=0x7f93a400cf90 comp rx=0 tx=0).stop 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 shutdown_connections 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f9388066730 0x7f9388068bf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93ac15e030 0x7f93ac0a8480 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ac146690 0x7f93ac15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 --2- 172.21.15.139:0/1140417519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ac0d1570 0x7f93ac0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 >> 172.21.15.139:0/1140417519 conn(0x7f93ac071fa0 msgr2=0x7f93ac0cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:47.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 shutdown_connections 2024-09-13T17:25:47.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.074+0000 7f93b1c00700 1 -- 172.21.15.139:0/1140417519 wait complete. 2024-09-13T17:25:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:25:47.103 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:25:47.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.266+0000 7f5e21e00700 1 Processor -- start 2024-09-13T17:25:47.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.266+0000 7f5e21e00700 1 -- start start 2024-09-13T17:25:47.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e21e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e21e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5e1c15aff0 0x7f5e1c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e21e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c070140 con 0x7f5e1c06db60 2024-09-13T17:25:47.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e21e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1c070420 con 0x7f5e1c15aff0 2024-09-13T17:25:47.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e21e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c070700 con 0x7f5e1c144300 2024-09-13T17:25:47.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c06d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:48478/0 (socket says 172.21.15.139:48478) 2024-09-13T17:25:47.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 -- 172.21.15.139:0/3412906097 learned_addr learned my addr 172.21.15.139:0/3412906097 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:47.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e1be00700 1 --2- 172.21.15.139:0/3412906097 >> v2:172.21.15.176:3300/0 conn(0x7f5e1c15aff0 0x7f5e1c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 -- 172.21.15.139:0/3412906097 >> v2:172.21.15.176:3300/0 conn(0x7f5e1c15aff0 msgr2=0x7f5e1c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:47.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 --2- 172.21.15.139:0/3412906097 >> v2:172.21.15.176:3300/0 conn(0x7f5e1c15aff0 0x7f5e1c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 -- 172.21.15.139:0/3412906097 >> v1:172.21.15.176:6789/0 conn(0x7f5e1c06db60 legacy=0x7f5e1c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 -- 172.21.15.139:0/3412906097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0709e0 con 0x7f5e1c144300 2024-09-13T17:25:47.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e20a00700 1 --2- 172.21.15.139:0/3412906097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c06d620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009910 tx=0x7f5e10009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422bf2eb9e04050c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:47.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e1b400700 1 -- 172.21.15.139:0/3412906097 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10011830 con 0x7f5e1c144300 2024-09-13T17:25:47.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e1b400700 1 -- 172.21.15.139:0/3412906097 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e10011990 con 0x7f5e1c144300 2024-09-13T17:25:47.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e1b400700 1 -- 172.21.15.139:0/3412906097 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10011d40 con 0x7f5e1c144300 2024-09-13T17:25:47.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.270+0000 7f5e21e00700 1 -- 172.21.15.139:0/3412906097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 msgr2=0x7f5e1c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3412906097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c06d620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009910 tx=0x7f5e10009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:47.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 -- 172.21.15.139:0/3412906097 shutdown_connections 2024-09-13T17:25:47.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3412906097 >> v2:172.21.15.176:3300/0 conn(0x7f5e1c15aff0 0x7f5e1c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3412906097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c06d620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 -- 172.21.15.139:0/3412906097 >> 172.21.15.139:0/3412906097 conn(0x7f5e1c0ce9d0 msgr2=0x7f5e1c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:47.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 -- 172.21.15.139:0/3412906097 shutdown_connections 2024-09-13T17:25:47.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 -- 172.21.15.139:0/3412906097 wait complete. 2024-09-13T17:25:47.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 Processor -- start 2024-09-13T17:25:47.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.274+0000 7f5e21e00700 1 -- start start 2024-09-13T17:25:47.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e1c06db60 0x7f5e1c1f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c13b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 0x7f5e1c0a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c13f410 con 0x7f5e1c15aff0 2024-09-13T17:25:47.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c13f6f0 con 0x7f5e1c06db60 2024-09-13T17:25:47.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c13f9d0 con 0x7f5e1c144300 2024-09-13T17:25:47.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 0x7f5e1c0a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 0x7f5e1c0a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56150/0 (socket says 172.21.15.139:56150) 2024-09-13T17:25:47.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 -- 172.21.15.139:0/3674341283 learned_addr learned my addr 172.21.15.139:0/3674341283 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:47.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e1be00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c13b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e20a00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e1c06db60 0x7f5e1c1f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 -- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 msgr2=0x7f5e1c13b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c13b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 -- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e1c06db60 msgr2=0x7f5e1c1f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e1c06db60 0x7f5e1c1f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 -- 172.21.15.139:0/3674341283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10009570 con 0x7f5e1c15aff0 2024-09-13T17:25:47.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e20a00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e1c06db60 0x7f5e1c1f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:47.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e1be00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c13b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:47.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21400700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 0x7f5e1c0a8d70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400cc50 tx=0x7f5e1400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:47.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400ad80 con 0x7f5e1c15aff0 2024-09-13T17:25:47.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1400ce50 con 0x7f5e1c15aff0 2024-09-13T17:25:47.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1c13fcb0 con 0x7f5e1c15aff0 2024-09-13T17:25:47.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14003c60 con 0x7f5e1c15aff0 2024-09-13T17:25:47.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.278+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c13b7d0 con 0x7f5e1c15aff0 2024-09-13T17:25:47.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.282+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c1401d0 con 0x7f5e1c15aff0 2024-09-13T17:25:47.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.282+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e140050d0 con 0x7f5e1c15aff0 2024-09-13T17:25:47.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.282+0000 7f5e18c00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5dfc066730 0x7f5dfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.282+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e140843c0 con 0x7f5e1c15aff0 2024-09-13T17:25:47.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.286+0000 7f5e20a00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5dfc066730 0x7f5dfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.286+0000 7f5e20a00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5dfc066730 0x7f5dfc068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e10000c00 tx=0x7f5e10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:47.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.290+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e140515e0 con 0x7f5e1c15aff0 2024-09-13T17:25:47.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.470+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e1c13b990 con 0x7f5dfc066730 2024-09-13T17:25:47.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.486+0000 7f5e18c00700 1 -- 172.21.15.139:0/3674341283 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286509 (secure 0 0 0) 0x7f5e10011c00 con 0x7f5dfc066730 2024-09-13T17:25:47.492 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5dfc066730 msgr2=0x7f5dfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5dfc066730 0x7f5dfc068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e10000c00 tx=0x7f5e10008030 comp rx=0 tx=0).stop 2024-09-13T17:25:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 msgr2=0x7f5e1c0a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 0x7f5e1c0a8d70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400cc50 tx=0x7f5e1400a340 comp rx=0 tx=0).stop 2024-09-13T17:25:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 shutdown_connections 2024-09-13T17:25:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5dfc066730 0x7f5dfc068bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e1c15aff0 0x7f5e1c0a8d70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e1c144300 0x7f5e1c13b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 --2- 172.21.15.139:0/3674341283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e1c06db60 0x7f5e1c1f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 >> 172.21.15.139:0/3674341283 conn(0x7f5e1c0ce9d0 msgr2=0x7f5e1c0afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 shutdown_connections 2024-09-13T17:25:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.494+0000 7f5e21e00700 1 -- 172.21.15.139:0/3674341283 wait complete. 2024-09-13T17:25:47.501 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:25:47.521 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-13T17:25:46.117861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221032,"kb_used_data":4816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753688,"statfs":{"total":773094113280,"available":772867776512,"internally_reserved":0,"allocated":4931584,"data_stored":2762444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.427947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197270+0000","last_change":"2024-09-13T17:25:43.208050+0000","last_active":"2024-09-13T17:25:44.197270+0000","last_peered":"2024-09-13T17:25:44.197270+0000","last_clean":"2024-09-13T17:25:44.197270+0000","last_became_active":"2024-09-13T17:25:43.207811+0000","last_became_peered":"2024-09-13T17:25:43.207811+0000","last_unstale":"2024-09-13T17:25:44.197270+0000","last_undegraded":"2024-09-13T17:25:44.197270+0000","last_fullsized":"2024-09-13T17:25:44.197270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:57.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197018+0000","last_change":"2024-09-13T17:25:43.212692+0000","last_active":"2024-09-13T17:25:44.197018+0000","last_peered":"2024-09-13T17:25:44.197018+0000","last_clean":"2024-09-13T17:25:44.197018+0000","last_became_active":"2024-09-13T17:25:43.212449+0000","last_became_peered":"2024-09-13T17:25:43.212449+0000","last_unstale":"2024-09-13T17:25:44.197018+0000","last_undegraded":"2024-09-13T17:25:44.197018+0000","last_fullsized":"2024-09-13T17:25:44.197018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:22.042357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854714+0000","last_change":"2024-09-13T17:25:43.206232+0000","last_active":"2024-09-13T17:25:44.854714+0000","last_peered":"2024-09-13T17:25:44.854714+0000","last_clean":"2024-09-13T17:25:44.854714+0000","last_became_active":"2024-09-13T17:25:43.205781+0000","last_became_peered":"2024-09-13T17:25:43.205781+0000","last_unstale":"2024-09-13T17:25:44.854714+0000","last_undegraded":"2024-09-13T17:25:44.854714+0000","last_fullsized":"2024-09-13T17:25:44.854714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:15.332365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623860+0000","last_change":"2024-09-13T17:25:43.218574+0000","last_active":"2024-09-13T17:25:44.623860+0000","last_peered":"2024-09-13T17:25:44.623860+0000","last_clean":"2024-09-13T17:25:44.623860+0000","last_became_active":"2024-09-13T17:25:43.218251+0000","last_became_peered":"2024-09-13T17:25:43.218251+0000","last_unstale":"2024-09-13T17:25:44.623860+0000","last_undegraded":"2024-09-13T17:25:44.623860+0000","last_fullsized":"2024-09-13T17:25:44.623860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:57.171088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623237+0000","last_change":"2024-09-13T17:25:43.218686+0000","last_active":"2024-09-13T17:25:44.623237+0000","last_peered":"2024-09-13T17:25:44.623237+0000","last_clean":"2024-09-13T17:25:44.623237+0000","last_became_active":"2024-09-13T17:25:43.218263+0000","last_became_peered":"2024-09-13T17:25:43.218263+0000","last_unstale":"2024-09-13T17:25:44.623237+0000","last_undegraded":"2024-09-13T17:25:44.623237+0000","last_fullsized":"2024-09-13T17:25:44.623237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855598+0000","last_change":"2024-09-13T17:25:43.203259+0000","last_active":"2024-09-13T17:25:44.855598+0000","last_peered":"2024-09-13T17:25:44.855598+0000","last_clean":"2024-09-13T17:25:44.855598+0000","last_became_active":"2024-09-13T17:25:43.203008+0000","last_became_peered":"2024-09-13T17:25:43.203008+0000","last_unstale":"2024-09-13T17:25:44.855598+0000","last_undegraded":"2024-09-13T17:25:44.855598+0000","last_fullsized":"2024-09-13T17:25:44.855598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:05.284968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201172+0000","last_change":"2024-09-13T17:25:43.213909+0000","last_active":"2024-09-13T17:25:44.201172+0000","last_peered":"2024-09-13T17:25:44.201172+0000","last_clean":"2024-09-13T17:25:44.201172+0000","last_became_active":"2024-09-13T17:25:43.213397+0000","last_became_peered":"2024-09-13T17:25:43.213397+0000","last_unstale":"2024-09-13T17:25:44.201172+0000","last_undegraded":"2024-09-13T17:25:44.201172+0000","last_fullsized":"2024-09-13T17:25:44.201172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:13.921489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196600+0000","last_change":"2024-09-13T17:25:43.202662+0000","last_active":"2024-09-13T17:25:44.196600+0000","last_peered":"2024-09-13T17:25:44.196600+0000","last_clean":"2024-09-13T17:25:44.196600+0000","last_became_active":"2024-09-13T17:25:43.202437+0000","last_became_peered":"2024-09-13T17:25:43.202437+0000","last_unstale":"2024-09-13T17:25:44.196600+0000","last_undegraded":"2024-09-13T17:25:44.196600+0000","last_fullsized":"2024-09-13T17:25:44.196600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:20.072342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855048+0000","last_change":"2024-09-13T17:25:43.211391+0000","last_active":"2024-09-13T17:25:44.855048+0000","last_peered":"2024-09-13T17:25:44.855048+0000","last_clean":"2024-09-13T17:25:44.855048+0000","last_became_active":"2024-09-13T17:25:43.211137+0000","last_became_peered":"2024-09-13T17:25:43.211137+0000","last_unstale":"2024-09-13T17:25:44.855048+0000","last_undegraded":"2024-09-13T17:25:44.855048+0000","last_fullsized":"2024-09-13T17:25:44.855048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:28.942367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201798+0000","last_change":"2024-09-13T17:25:43.211498+0000","last_active":"2024-09-13T17:25:44.201798+0000","last_peered":"2024-09-13T17:25:44.201798+0000","last_clean":"2024-09-13T17:25:44.201798+0000","last_became_active":"2024-09-13T17:25:43.211163+0000","last_became_peered":"2024-09-13T17:25:43.211163+0000","last_unstale":"2024-09-13T17:25:44.201798+0000","last_undegraded":"2024-09-13T17:25:44.201798+0000","last_fullsized":"2024-09-13T17:25:44.201798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:20.072342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202102+0000","last_change":"2024-09-13T17:25:43.214549+0000","last_active":"2024-09-13T17:25:44.202102+0000","last_peered":"2024-09-13T17:25:44.202102+0000","last_clean":"2024-09-13T17:25:44.202102+0000","last_became_active":"2024-09-13T17:25:43.214302+0000","last_became_peered":"2024-09-13T17:25:43.214302+0000","last_unstale":"2024-09-13T17:25:44.202102+0000","last_undegraded":"2024-09-13T17:25:44.202102+0000","last_fullsized":"2024-09-13T17:25:44.202102+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:23.395033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854717+0000","last_change":"2024-09-13T17:25:43.202890+0000","last_active":"2024-09-13T17:25:44.854717+0000","last_peered":"2024-09-13T17:25:44.854717+0000","last_clean":"2024-09-13T17:25:44.854717+0000","last_became_active":"2024-09-13T17:25:43.202651+0000","last_became_peered":"2024-09-13T17:25:43.202651+0000","last_unstale":"2024-09-13T17:25:44.854717+0000","last_undegraded":"2024-09-13T17:25:44.854717+0000","last_fullsized":"2024-09-13T17:25:44.854717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.287351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201259+0000","last_change":"2024-09-13T17:25:43.204747+0000","last_active":"2024-09-13T17:25:44.201259+0000","last_peered":"2024-09-13T17:25:44.201259+0000","last_clean":"2024-09-13T17:25:44.201259+0000","last_became_active":"2024-09-13T17:25:43.204457+0000","last_became_peered":"2024-09-13T17:25:43.204457+0000","last_unstale":"2024-09-13T17:25:44.201259+0000","last_undegraded":"2024-09-13T17:25:44.201259+0000","last_fullsized":"2024-09-13T17:25:44.201259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:01.337432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.199902+0000","last_change":"2024-09-13T17:25:43.212942+0000","last_active":"2024-09-13T17:25:44.199902+0000","last_peered":"2024-09-13T17:25:44.199902+0000","last_clean":"2024-09-13T17:25:44.199902+0000","last_became_active":"2024-09-13T17:25:43.212698+0000","last_became_peered":"2024-09-13T17:25:43.212698+0000","last_unstale":"2024-09-13T17:25:44.199902+0000","last_undegraded":"2024-09-13T17:25:44.199902+0000","last_fullsized":"2024-09-13T17:25:44.199902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.739546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201206+0000","last_change":"2024-09-13T17:25:43.209366+0000","last_active":"2024-09-13T17:25:44.201206+0000","last_peered":"2024-09-13T17:25:44.201206+0000","last_clean":"2024-09-13T17:25:44.201206+0000","last_became_active":"2024-09-13T17:25:43.208972+0000","last_became_peered":"2024-09-13T17:25:43.208972+0000","last_unstale":"2024-09-13T17:25:44.201206+0000","last_undegraded":"2024-09-13T17:25:44.201206+0000","last_fullsized":"2024-09-13T17:25:44.201206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.739546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269272+0000","last_change":"2024-09-13T17:25:43.228735+0000","last_active":"2024-09-13T17:25:44.269272+0000","last_peered":"2024-09-13T17:25:44.269272+0000","last_clean":"2024-09-13T17:25:44.269272+0000","last_became_active":"2024-09-13T17:25:43.223809+0000","last_became_peered":"2024-09-13T17:25:43.223809+0000","last_unstale":"2024-09-13T17:25:44.269272+0000","last_undegraded":"2024-09-13T17:25:44.269272+0000","last_fullsized":"2024-09-13T17:25:44.269272+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.270158+0000","last_change":"2024-09-13T17:25:43.223332+0000","last_active":"2024-09-13T17:25:44.270158+0000","last_peered":"2024-09-13T17:25:44.270158+0000","last_clean":"2024-09-13T17:25:44.270158+0000","last_became_active":"2024-09-13T17:25:43.223068+0000","last_became_peered":"2024-09-13T17:25:43.223068+0000","last_unstale":"2024-09-13T17:25:44.270158+0000","last_undegraded":"2024-09-13T17:25:44.270158+0000","last_fullsized":"2024-09-13T17:25:44.270158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.287351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600131+0000","last_change":"2024-09-13T17:25:43.225707+0000","last_active":"2024-09-13T17:25:44.600131+0000","last_peered":"2024-09-13T17:25:44.600131+0000","last_clean":"2024-09-13T17:25:44.600131+0000","last_became_active":"2024-09-13T17:25:43.225465+0000","last_became_peered":"2024-09-13T17:25:43.225465+0000","last_unstale":"2024-09-13T17:25:44.600131+0000","last_undegraded":"2024-09-13T17:25:44.600131+0000","last_fullsized":"2024-09-13T17:25:44.600131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623743+0000","last_change":"2024-09-13T17:25:43.207844+0000","last_active":"2024-09-13T17:25:44.623743+0000","last_peered":"2024-09-13T17:25:44.623743+0000","last_clean":"2024-09-13T17:25:44.623743+0000","last_became_active":"2024-09-13T17:25:43.207623+0000","last_became_peered":"2024-09-13T17:25:43.207623+0000","last_unstale":"2024-09-13T17:25:44.623743+0000","last_undegraded":"2024-09-13T17:25:44.623743+0000","last_fullsized":"2024-09-13T17:25:44.623743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599910+0000","last_change":"2024-09-13T17:25:43.226362+0000","last_active":"2024-09-13T17:25:44.599910+0000","last_peered":"2024-09-13T17:25:44.599910+0000","last_clean":"2024-09-13T17:25:44.599910+0000","last_became_active":"2024-09-13T17:25:43.225314+0000","last_became_peered":"2024-09-13T17:25:43.225314+0000","last_unstale":"2024-09-13T17:25:44.599910+0000","last_undegraded":"2024-09-13T17:25:44.599910+0000","last_fullsized":"2024-09-13T17:25:44.599910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201347+0000","last_change":"2024-09-13T17:25:43.210872+0000","last_active":"2024-09-13T17:25:44.201347+0000","last_peered":"2024-09-13T17:25:44.201347+0000","last_clean":"2024-09-13T17:25:44.201347+0000","last_became_active":"2024-09-13T17:25:43.210600+0000","last_became_peered":"2024-09-13T17:25:43.210600+0000","last_unstale":"2024-09-13T17:25:44.201347+0000","last_undegraded":"2024-09-13T17:25:44.201347+0000","last_fullsized":"2024-09-13T17:25:44.201347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:29.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200274+0000","last_change":"2024-09-13T17:25:43.206628+0000","last_active":"2024-09-13T17:25:44.200274+0000","last_peered":"2024-09-13T17:25:44.200274+0000","last_clean":"2024-09-13T17:25:44.200274+0000","last_became_active":"2024-09-13T17:25:43.205949+0000","last_became_peered":"2024-09-13T17:25:43.205949+0000","last_unstale":"2024-09-13T17:25:44.200274+0000","last_undegraded":"2024-09-13T17:25:44.200274+0000","last_fullsized":"2024-09-13T17:25:44.200274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:22.042357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269373+0000","last_change":"2024-09-13T17:25:43.223365+0000","last_active":"2024-09-13T17:25:44.269373+0000","last_peered":"2024-09-13T17:25:44.269373+0000","last_clean":"2024-09-13T17:25:44.269373+0000","last_became_active":"2024-09-13T17:25:43.223097+0000","last_became_peered":"2024-09-13T17:25:43.223097+0000","last_unstale":"2024-09-13T17:25:44.269373+0000","last_undegraded":"2024-09-13T17:25:44.269373+0000","last_fullsized":"2024-09-13T17:25:44.269373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:57.171088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623265+0000","last_change":"2024-09-13T17:25:43.203665+0000","last_active":"2024-09-13T17:25:44.623265+0000","last_peered":"2024-09-13T17:25:44.623265+0000","last_clean":"2024-09-13T17:25:44.623265+0000","last_became_active":"2024-09-13T17:25:43.203329+0000","last_became_peered":"2024-09-13T17:25:43.203329+0000","last_unstale":"2024-09-13T17:25:44.623265+0000","last_undegraded":"2024-09-13T17:25:44.623265+0000","last_fullsized":"2024-09-13T17:25:44.623265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.287351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600099+0000","last_change":"2024-09-13T17:25:43.222428+0000","last_active":"2024-09-13T17:25:44.600099+0000","last_peered":"2024-09-13T17:25:44.600099+0000","last_clean":"2024-09-13T17:25:44.600099+0000","last_became_active":"2024-09-13T17:25:43.221921+0000","last_became_peered":"2024-09-13T17:25:43.221921+0000","last_unstale":"2024-09-13T17:25:44.600099+0000","last_undegraded":"2024-09-13T17:25:44.600099+0000","last_fullsized":"2024-09-13T17:25:44.600099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:28.942367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.856303+0000","last_change":"2024-09-13T17:25:43.204301+0000","last_active":"2024-09-13T17:25:44.856303+0000","last_peered":"2024-09-13T17:25:44.856303+0000","last_clean":"2024-09-13T17:25:44.856303+0000","last_became_active":"2024-09-13T17:25:43.204030+0000","last_became_peered":"2024-09-13T17:25:43.204030+0000","last_unstale":"2024-09-13T17:25:44.856303+0000","last_undegraded":"2024-09-13T17:25:44.856303+0000","last_fullsized":"2024-09-13T17:25:44.856303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:34.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600293+0000","last_change":"2024-09-13T17:25:43.224113+0000","last_active":"2024-09-13T17:25:44.600293+0000","last_peered":"2024-09-13T17:25:44.600293+0000","last_clean":"2024-09-13T17:25:44.600293+0000","last_became_active":"2024-09-13T17:25:43.221532+0000","last_became_peered":"2024-09-13T17:25:43.221532+0000","last_unstale":"2024-09-13T17:25:44.600293+0000","last_undegraded":"2024-09-13T17:25:44.600293+0000","last_fullsized":"2024-09-13T17:25:44.600293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201818+0000","last_change":"2024-09-13T17:25:43.216776+0000","last_active":"2024-09-13T17:25:44.201818+0000","last_peered":"2024-09-13T17:25:44.201818+0000","last_clean":"2024-09-13T17:25:44.201818+0000","last_became_active":"2024-09-13T17:25:43.216299+0000","last_became_peered":"2024-09-13T17:25:43.216299+0000","last_unstale":"2024-09-13T17:25:44.201818+0000","last_undegraded":"2024-09-13T17:25:44.201818+0000","last_fullsized":"2024-09-13T17:25:44.201818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:28.261169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599860+0000","last_change":"2024-09-13T17:25:43.226172+0000","last_active":"2024-09-13T17:25:44.599860+0000","last_peered":"2024-09-13T17:25:44.599860+0000","last_clean":"2024-09-13T17:25:44.599860+0000","last_became_active":"2024-09-13T17:25:43.224704+0000","last_became_peered":"2024-09-13T17:25:43.224704+0000","last_unstale":"2024-09-13T17:25:44.599860+0000","last_undegraded":"2024-09-13T17:25:44.599860+0000","last_fullsized":"2024-09-13T17:25:44.599860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:05.791019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599623+0000","last_change":"2024-09-13T17:25:43.226609+0000","last_active":"2024-09-13T17:25:44.599623+0000","last_peered":"2024-09-13T17:25:44.599623+0000","last_clean":"2024-09-13T17:25:44.599623+0000","last_became_active":"2024-09-13T17:25:43.226332+0000","last_became_peered":"2024-09-13T17:25:43.226332+0000","last_unstale":"2024-09-13T17:25:44.599623+0000","last_undegraded":"2024-09-13T17:25:44.599623+0000","last_fullsized":"2024-09-13T17:25:44.599623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:15.332365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269737+0000","last_change":"2024-09-13T17:25:43.229108+0000","last_active":"2024-09-13T17:25:44.269737+0000","last_peered":"2024-09-13T17:25:44.269737+0000","last_clean":"2024-09-13T17:25:44.269737+0000","last_became_active":"2024-09-13T17:25:43.223765+0000","last_became_peered":"2024-09-13T17:25:43.223765+0000","last_unstale":"2024-09-13T17:25:44.269737+0000","last_undegraded":"2024-09-13T17:25:44.269737+0000","last_fullsized":"2024-09-13T17:25:44.269737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:02.819978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855301+0000","last_change":"2024-09-13T17:25:43.209556+0000","last_active":"2024-09-13T17:25:44.855301+0000","last_peered":"2024-09-13T17:25:44.855301+0000","last_clean":"2024-09-13T17:25:44.855301+0000","last_became_active":"2024-09-13T17:25:43.209300+0000","last_became_peered":"2024-09-13T17:25:43.209300+0000","last_unstale":"2024-09-13T17:25:44.855301+0000","last_undegraded":"2024-09-13T17:25:44.855301+0000","last_fullsized":"2024-09-13T17:25:44.855301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:42.763701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269932+0000","last_change":"2024-09-13T17:25:43.228255+0000","last_active":"2024-09-13T17:25:44.269932+0000","last_peered":"2024-09-13T17:25:44.269932+0000","last_clean":"2024-09-13T17:25:44.269932+0000","last_became_active":"2024-09-13T17:25:43.224006+0000","last_became_peered":"2024-09-13T17:25:43.224006+0000","last_unstale":"2024-09-13T17:25:44.269932+0000","last_undegraded":"2024-09-13T17:25:44.269932+0000","last_fullsized":"2024-09-13T17:25:44.269932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600237+0000","last_change":"2024-09-13T17:25:42.717840+0000","last_active":"2024-09-13T17:25:44.600237+0000","last_peered":"2024-09-13T17:25:44.600237+0000","last_clean":"2024-09-13T17:25:44.600237+0000","last_became_active":"2024-09-13T17:25:42.717566+0000","last_became_peered":"2024-09-13T17:25:42.717566+0000","last_unstale":"2024-09-13T17:25:44.600237+0000","last_undegraded":"2024-09-13T17:25:44.600237+0000","last_fullsized":"2024-09-13T17:25:44.600237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:37.515930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.856108+0000","last_change":"2024-09-13T17:25:43.207377+0000","last_active":"2024-09-13T17:25:44.856108+0000","last_peered":"2024-09-13T17:25:44.856108+0000","last_clean":"2024-09-13T17:25:44.856108+0000","last_became_active":"2024-09-13T17:25:43.207147+0000","last_became_peered":"2024-09-13T17:25:43.207147+0000","last_unstale":"2024-09-13T17:25:44.856108+0000","last_undegraded":"2024-09-13T17:25:44.856108+0000","last_fullsized":"2024-09-13T17:25:44.856108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:18.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855073+0000","last_change":"2024-09-13T17:25:42.721133+0000","last_active":"2024-09-13T17:25:44.855073+0000","last_peered":"2024-09-13T17:25:44.855073+0000","last_clean":"2024-09-13T17:25:44.855073+0000","last_became_active":"2024-09-13T17:25:42.720782+0000","last_became_peered":"2024-09-13T17:25:42.720782+0000","last_unstale":"2024-09-13T17:25:44.855073+0000","last_undegraded":"2024-09-13T17:25:44.855073+0000","last_fullsized":"2024-09-13T17:25:44.855073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:35.522014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200715+0000","last_change":"2024-09-13T17:25:43.215971+0000","last_active":"2024-09-13T17:25:44.200715+0000","last_peered":"2024-09-13T17:25:44.200715+0000","last_clean":"2024-09-13T17:25:44.200715+0000","last_became_active":"2024-09-13T17:25:43.215727+0000","last_became_peered":"2024-09-13T17:25:43.215727+0000","last_unstale":"2024-09-13T17:25:44.200715+0000","last_undegraded":"2024-09-13T17:25:44.200715+0000","last_fullsized":"2024-09-13T17:25:44.200715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:42.763701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.856267+0000","last_change":"2024-09-13T17:25:42.733667+0000","last_active":"2024-09-13T17:25:44.856267+0000","last_peered":"2024-09-13T17:25:44.856267+0000","last_clean":"2024-09-13T17:25:44.856267+0000","last_became_active":"2024-09-13T17:25:42.733450+0000","last_became_peered":"2024-09-13T17:25:42.733450+0000","last_unstale":"2024-09-13T17:25:44.856267+0000","last_undegraded":"2024-09-13T17:25:44.856267+0000","last_fullsized":"2024-09-13T17:25:44.856267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:56.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197137+0000","last_change":"2024-09-13T17:25:43.214741+0000","last_active":"2024-09-13T17:25:44.197137+0000","last_peered":"2024-09-13T17:25:44.197137+0000","last_clean":"2024-09-13T17:25:44.197137+0000","last_became_active":"2024-09-13T17:25:43.214519+0000","last_became_peered":"2024-09-13T17:25:43.214519+0000","last_unstale":"2024-09-13T17:25:44.197137+0000","last_undegraded":"2024-09-13T17:25:44.197137+0000","last_fullsized":"2024-09-13T17:25:44.197137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:13.921489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200486+0000","last_change":"2024-09-13T17:25:42.728803+0000","last_active":"2024-09-13T17:25:44.200486+0000","last_peered":"2024-09-13T17:25:44.200486+0000","last_clean":"2024-09-13T17:25:44.200486+0000","last_became_active":"2024-09-13T17:25:42.728592+0000","last_became_peered":"2024-09-13T17:25:42.728592+0000","last_unstale":"2024-09-13T17:25:44.200486+0000","last_undegraded":"2024-09-13T17:25:44.200486+0000","last_fullsized":"2024-09-13T17:25:44.200486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:09.097149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855044+0000","last_change":"2024-09-13T17:25:43.205321+0000","last_active":"2024-09-13T17:25:44.855044+0000","last_peered":"2024-09-13T17:25:44.855044+0000","last_clean":"2024-09-13T17:25:44.855044+0000","last_became_active":"2024-09-13T17:25:43.205042+0000","last_became_peered":"2024-09-13T17:25:43.205042+0000","last_unstale":"2024-09-13T17:25:44.855044+0000","last_undegraded":"2024-09-13T17:25:44.855044+0000","last_fullsized":"2024-09-13T17:25:44.855044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:05.791019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201649+0000","last_change":"2024-09-13T17:25:42.728145+0000","last_active":"2024-09-13T17:25:44.201649+0000","last_peered":"2024-09-13T17:25:44.201649+0000","last_clean":"2024-09-13T17:25:44.201649+0000","last_became_active":"2024-09-13T17:25:42.727879+0000","last_became_peered":"2024-09-13T17:25:42.727879+0000","last_unstale":"2024-09-13T17:25:44.201649+0000","last_undegraded":"2024-09-13T17:25:44.201649+0000","last_fullsized":"2024-09-13T17:25:44.201649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:01.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201346+0000","last_change":"2024-09-13T17:25:43.204303+0000","last_active":"2024-09-13T17:25:44.201346+0000","last_peered":"2024-09-13T17:25:44.201346+0000","last_clean":"2024-09-13T17:25:44.201346+0000","last_became_active":"2024-09-13T17:25:43.203815+0000","last_became_peered":"2024-09-13T17:25:43.203815+0000","last_unstale":"2024-09-13T17:25:44.201346+0000","last_undegraded":"2024-09-13T17:25:44.201346+0000","last_fullsized":"2024-09-13T17:25:44.201346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:42.763701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269465+0000","last_change":"2024-09-13T17:25:42.727079+0000","last_active":"2024-09-13T17:25:44.269465+0000","last_peered":"2024-09-13T17:25:44.269465+0000","last_clean":"2024-09-13T17:25:44.269465+0000","last_became_active":"2024-09-13T17:25:42.726807+0000","last_became_peered":"2024-09-13T17:25:42.726807+0000","last_unstale":"2024-09-13T17:25:44.269465+0000","last_undegraded":"2024-09-13T17:25:44.269465+0000","last_fullsized":"2024-09-13T17:25:44.269465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:49.894247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200355+0000","last_change":"2024-09-13T17:25:43.208367+0000","last_active":"2024-09-13T17:25:44.200355+0000","last_peered":"2024-09-13T17:25:44.200355+0000","last_clean":"2024-09-13T17:25:44.200355+0000","last_became_active":"2024-09-13T17:25:43.206435+0000","last_became_peered":"2024-09-13T17:25:43.206435+0000","last_unstale":"2024-09-13T17:25:44.200355+0000","last_undegraded":"2024-09-13T17:25:44.200355+0000","last_fullsized":"2024-09-13T17:25:44.200355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:28.261169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855565+0000","last_change":"2024-09-13T17:25:42.727936+0000","last_active":"2024-09-13T17:25:44.855565+0000","last_peered":"2024-09-13T17:25:44.855565+0000","last_clean":"2024-09-13T17:25:44.855565+0000","last_became_active":"2024-09-13T17:25:42.727667+0000","last_became_peered":"2024-09-13T17:25:42.727667+0000","last_unstale":"2024-09-13T17:25:44.855565+0000","last_undegraded":"2024-09-13T17:25:44.855565+0000","last_fullsized":"2024-09-13T17:25:44.855565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:09.001400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196818+0000","last_change":"2024-09-13T17:25:43.208909+0000","last_active":"2024-09-13T17:25:44.196818+0000","last_peered":"2024-09-13T17:25:44.196818+0000","last_clean":"2024-09-13T17:25:44.196818+0000","last_became_active":"2024-09-13T17:25:43.208637+0000","last_became_peered":"2024-09-13T17:25:43.208637+0000","last_unstale":"2024-09-13T17:25:44.196818+0000","last_undegraded":"2024-09-13T17:25:44.196818+0000","last_fullsized":"2024-09-13T17:25:44.196818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:09.260041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200011+0000","last_change":"2024-09-13T17:25:42.718000+0000","last_active":"2024-09-13T17:25:44.200011+0000","last_peered":"2024-09-13T17:25:44.200011+0000","last_clean":"2024-09-13T17:25:44.200011+0000","last_became_active":"2024-09-13T17:25:42.717744+0000","last_became_peered":"2024-09-13T17:25:42.717744+0000","last_unstale":"2024-09-13T17:25:44.200011+0000","last_undegraded":"2024-09-13T17:25:44.200011+0000","last_fullsized":"2024-09-13T17:25:44.200011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:37.987070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623892+0000","last_change":"2024-09-13T17:25:43.215749+0000","last_active":"2024-09-13T17:25:44.623892+0000","last_peered":"2024-09-13T17:25:44.623892+0000","last_clean":"2024-09-13T17:25:44.623892+0000","last_became_active":"2024-09-13T17:25:43.215508+0000","last_became_peered":"2024-09-13T17:25:43.215508+0000","last_unstale":"2024-09-13T17:25:44.623892+0000","last_undegraded":"2024-09-13T17:25:44.623892+0000","last_fullsized":"2024-09-13T17:25:44.623892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:10.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197196+0000","last_change":"2024-09-13T17:25:42.731108+0000","last_active":"2024-09-13T17:25:44.197196+0000","last_peered":"2024-09-13T17:25:44.197196+0000","last_clean":"2024-09-13T17:25:44.197196+0000","last_became_active":"2024-09-13T17:25:42.730659+0000","last_became_peered":"2024-09-13T17:25:42.730659+0000","last_unstale":"2024-09-13T17:25:44.197196+0000","last_undegraded":"2024-09-13T17:25:44.197196+0000","last_fullsized":"2024-09-13T17:25:44.197196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:27.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269982+0000","last_change":"2024-09-13T17:25:43.228482+0000","last_active":"2024-09-13T17:25:44.269982+0000","last_peered":"2024-09-13T17:25:44.269982+0000","last_clean":"2024-09-13T17:25:44.269982+0000","last_became_active":"2024-09-13T17:25:43.223591+0000","last_became_peered":"2024-09-13T17:25:43.223591+0000","last_unstale":"2024-09-13T17:25:44.269982+0000","last_undegraded":"2024-09-13T17:25:44.269982+0000","last_fullsized":"2024-09-13T17:25:44.269982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:28.942367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202118+0000","last_change":"2024-09-13T17:25:42.733238+0000","last_active":"2024-09-13T17:25:44.202118+0000","last_peered":"2024-09-13T17:25:44.202118+0000","last_clean":"2024-09-13T17:25:44.202118+0000","last_became_active":"2024-09-13T17:25:42.732956+0000","last_became_peered":"2024-09-13T17:25:42.732956+0000","last_unstale":"2024-09-13T17:25:44.202118+0000","last_undegraded":"2024-09-13T17:25:44.202118+0000","last_fullsized":"2024-09-13T17:25:44.202118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:09.001400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854896+0000","last_change":"2024-09-13T17:25:43.207975+0000","last_active":"2024-09-13T17:25:44.854896+0000","last_peered":"2024-09-13T17:25:44.854896+0000","last_clean":"2024-09-13T17:25:44.854896+0000","last_became_active":"2024-09-13T17:25:43.207713+0000","last_became_peered":"2024-09-13T17:25:43.207713+0000","last_unstale":"2024-09-13T17:25:44.854896+0000","last_undegraded":"2024-09-13T17:25:44.854896+0000","last_fullsized":"2024-09-13T17:25:44.854896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202139+0000","last_change":"2024-09-13T17:25:42.728245+0000","last_active":"2024-09-13T17:25:44.202139+0000","last_peered":"2024-09-13T17:25:44.202139+0000","last_clean":"2024-09-13T17:25:44.202139+0000","last_became_active":"2024-09-13T17:25:42.726340+0000","last_became_peered":"2024-09-13T17:25:42.726340+0000","last_unstale":"2024-09-13T17:25:44.202139+0000","last_undegraded":"2024-09-13T17:25:44.202139+0000","last_fullsized":"2024-09-13T17:25:44.202139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:00.313972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200789+0000","last_change":"2024-09-13T17:25:43.205653+0000","last_active":"2024-09-13T17:25:44.200789+0000","last_peered":"2024-09-13T17:25:44.200789+0000","last_clean":"2024-09-13T17:25:44.200789+0000","last_became_active":"2024-09-13T17:25:43.205358+0000","last_became_peered":"2024-09-13T17:25:43.205358+0000","last_unstale":"2024-09-13T17:25:44.200789+0000","last_undegraded":"2024-09-13T17:25:44.200789+0000","last_fullsized":"2024-09-13T17:25:44.200789+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:05.284968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196875+0000","last_change":"2024-09-13T17:25:42.731008+0000","last_active":"2024-09-13T17:25:44.196875+0000","last_peered":"2024-09-13T17:25:44.196875+0000","last_clean":"2024-09-13T17:25:44.196875+0000","last_became_active":"2024-09-13T17:25:42.730758+0000","last_became_peered":"2024-09-13T17:25:42.730758+0000","last_unstale":"2024-09-13T17:25:44.196875+0000","last_undegraded":"2024-09-13T17:25:44.196875+0000","last_fullsized":"2024-09-13T17:25:44.196875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:09.097149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854461+0000","last_change":"2024-09-13T17:25:43.217135+0000","last_active":"2024-09-13T17:25:44.854461+0000","last_peered":"2024-09-13T17:25:44.854461+0000","last_clean":"2024-09-13T17:25:44.854461+0000","last_became_active":"2024-09-13T17:25:43.216873+0000","last_became_peered":"2024-09-13T17:25:43.216873+0000","last_unstale":"2024-09-13T17:25:44.854461+0000","last_undegraded":"2024-09-13T17:25:44.854461+0000","last_fullsized":"2024-09-13T17:25:44.854461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197047+0000","last_change":"2024-09-13T17:25:42.731456+0000","last_active":"2024-09-13T17:25:44.197047+0000","last_peered":"2024-09-13T17:25:44.197047+0000","last_clean":"2024-09-13T17:25:44.197047+0000","last_became_active":"2024-09-13T17:25:42.731202+0000","last_became_peered":"2024-09-13T17:25:42.731202+0000","last_unstale":"2024-09-13T17:25:44.197047+0000","last_undegraded":"2024-09-13T17:25:44.197047+0000","last_fullsized":"2024-09-13T17:25:44.197047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:08.577806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196558+0000","last_change":"2024-09-13T17:25:43.207961+0000","last_active":"2024-09-13T17:25:44.196558+0000","last_peered":"2024-09-13T17:25:44.196558+0000","last_clean":"2024-09-13T17:25:44.196558+0000","last_became_active":"2024-09-13T17:25:43.207625+0000","last_became_peered":"2024-09-13T17:25:43.207625+0000","last_unstale":"2024-09-13T17:25:44.196558+0000","last_undegraded":"2024-09-13T17:25:44.196558+0000","last_fullsized":"2024-09-13T17:25:44.196558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:23.395033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855542+0000","last_change":"2024-09-13T17:25:42.727982+0000","last_active":"2024-09-13T17:25:44.855542+0000","last_peered":"2024-09-13T17:25:44.855542+0000","last_clean":"2024-09-13T17:25:44.855542+0000","last_became_active":"2024-09-13T17:25:42.727644+0000","last_became_peered":"2024-09-13T17:25:42.727644+0000","last_unstale":"2024-09-13T17:25:44.855542+0000","last_undegraded":"2024-09-13T17:25:44.855542+0000","last_fullsized":"2024-09-13T17:25:44.855542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:08.577806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269512+0000","last_change":"2024-09-13T17:25:43.220277+0000","last_active":"2024-09-13T17:25:44.269512+0000","last_peered":"2024-09-13T17:25:44.269512+0000","last_clean":"2024-09-13T17:25:44.269512+0000","last_became_active":"2024-09-13T17:25:43.219993+0000","last_became_peered":"2024-09-13T17:25:43.219993+0000","last_unstale":"2024-09-13T17:25:44.269512+0000","last_undegraded":"2024-09-13T17:25:44.269512+0000","last_fullsized":"2024-09-13T17:25:44.269512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:01.329510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599755+0000","last_change":"2024-09-13T17:25:42.717754+0000","last_active":"2024-09-13T17:25:44.599755+0000","last_peered":"2024-09-13T17:25:44.599755+0000","last_clean":"2024-09-13T17:25:44.599755+0000","last_became_active":"2024-09-13T17:25:42.717484+0000","last_became_peered":"2024-09-13T17:25:42.717484+0000","last_unstale":"2024-09-13T17:25:44.599755+0000","last_undegraded":"2024-09-13T17:25:44.599755+0000","last_fullsized":"2024-09-13T17:25:44.599755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:33.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196934+0000","last_change":"2024-09-13T17:25:43.207696+0000","last_active":"2024-09-13T17:25:44.196934+0000","last_peered":"2024-09-13T17:25:44.196934+0000","last_clean":"2024-09-13T17:25:44.196934+0000","last_became_active":"2024-09-13T17:25:43.207480+0000","last_became_peered":"2024-09-13T17:25:43.207480+0000","last_unstale":"2024-09-13T17:25:44.196934+0000","last_undegraded":"2024-09-13T17:25:44.196934+0000","last_fullsized":"2024-09-13T17:25:44.196934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:00.647608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269324+0000","last_change":"2024-09-13T17:25:42.726363+0000","last_active":"2024-09-13T17:25:44.269324+0000","last_peered":"2024-09-13T17:25:44.269324+0000","last_clean":"2024-09-13T17:25:44.269324+0000","last_became_active":"2024-09-13T17:25:42.726100+0000","last_became_peered":"2024-09-13T17:25:42.726100+0000","last_unstale":"2024-09-13T17:25:44.269324+0000","last_undegraded":"2024-09-13T17:25:44.269324+0000","last_fullsized":"2024-09-13T17:25:44.269324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:28.182506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196927+0000","last_change":"2024-09-13T17:25:43.218153+0000","last_active":"2024-09-13T17:25:44.196927+0000","last_peered":"2024-09-13T17:25:44.196927+0000","last_clean":"2024-09-13T17:25:44.196927+0000","last_became_active":"2024-09-13T17:25:43.217812+0000","last_became_peered":"2024-09-13T17:25:43.217812+0000","last_unstale":"2024-09-13T17:25:44.196927+0000","last_undegraded":"2024-09-13T17:25:44.196927+0000","last_fullsized":"2024-09-13T17:25:44.196927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:01.337432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201999+0000","last_change":"2024-09-13T17:25:42.731673+0000","last_active":"2024-09-13T17:25:44.201999+0000","last_peered":"2024-09-13T17:25:44.201999+0000","last_clean":"2024-09-13T17:25:44.201999+0000","last_became_active":"2024-09-13T17:25:42.731435+0000","last_became_peered":"2024-09-13T17:25:42.731435+0000","last_unstale":"2024-09-13T17:25:44.201999+0000","last_undegraded":"2024-09-13T17:25:44.201999+0000","last_fullsized":"2024-09-13T17:25:44.201999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:53.752433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201967+0000","last_change":"2024-09-13T17:25:43.203619+0000","last_active":"2024-09-13T17:25:44.201967+0000","last_peered":"2024-09-13T17:25:44.201967+0000","last_clean":"2024-09-13T17:25:44.201967+0000","last_became_active":"2024-09-13T17:25:43.203383+0000","last_became_peered":"2024-09-13T17:25:43.203383+0000","last_unstale":"2024-09-13T17:25:44.201967+0000","last_undegraded":"2024-09-13T17:25:44.201967+0000","last_fullsized":"2024-09-13T17:25:44.201967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:05.284968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200804+0000","last_change":"2024-09-13T17:25:42.729732+0000","last_active":"2024-09-13T17:25:44.200804+0000","last_peered":"2024-09-13T17:25:44.200804+0000","last_clean":"2024-09-13T17:25:44.200804+0000","last_became_active":"2024-09-13T17:25:42.729438+0000","last_became_peered":"2024-09-13T17:25:42.729438+0000","last_unstale":"2024-09-13T17:25:44.200804+0000","last_undegraded":"2024-09-13T17:25:44.200804+0000","last_fullsized":"2024-09-13T17:25:44.200804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:59.271812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200709+0000","last_change":"2024-09-13T17:25:43.201056+0000","last_active":"2024-09-13T17:25:44.200709+0000","last_peered":"2024-09-13T17:25:44.200709+0000","last_clean":"2024-09-13T17:25:44.200709+0000","last_became_active":"2024-09-13T17:25:43.200679+0000","last_became_peered":"2024-09-13T17:25:43.200679+0000","last_unstale":"2024-09-13T17:25:44.200709+0000","last_undegraded":"2024-09-13T17:25:44.200709+0000","last_fullsized":"2024-09-13T17:25:44.200709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:20.072342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623859+0000","last_change":"2024-09-13T17:25:42.724686+0000","last_active":"2024-09-13T17:25:44.623859+0000","last_peered":"2024-09-13T17:25:44.623859+0000","last_clean":"2024-09-13T17:25:44.623859+0000","last_became_active":"2024-09-13T17:25:42.724445+0000","last_became_peered":"2024-09-13T17:25:42.724445+0000","last_unstale":"2024-09-13T17:25:44.623859+0000","last_undegraded":"2024-09-13T17:25:44.623859+0000","last_fullsized":"2024-09-13T17:25:44.623859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:35.522014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623461+0000","last_change":"2024-09-13T17:25:43.206406+0000","last_active":"2024-09-13T17:25:44.623461+0000","last_peered":"2024-09-13T17:25:44.623461+0000","last_clean":"2024-09-13T17:25:44.623461+0000","last_became_active":"2024-09-13T17:25:43.205903+0000","last_became_peered":"2024-09-13T17:25:43.205903+0000","last_unstale":"2024-09-13T17:25:44.623461+0000","last_undegraded":"2024-09-13T17:25:44.623461+0000","last_fullsized":"2024-09-13T17:25:44.623461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855876+0000","last_change":"2024-09-13T17:25:42.730763+0000","last_active":"2024-09-13T17:25:44.855876+0000","last_peered":"2024-09-13T17:25:44.855876+0000","last_clean":"2024-09-13T17:25:44.855876+0000","last_became_active":"2024-09-13T17:25:42.730533+0000","last_became_peered":"2024-09-13T17:25:42.730533+0000","last_unstale":"2024-09-13T17:25:44.855876+0000","last_undegraded":"2024-09-13T17:25:44.855876+0000","last_fullsized":"2024-09-13T17:25:44.855876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:59.271812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269523+0000","last_change":"2024-09-13T17:25:43.228575+0000","last_active":"2024-09-13T17:25:44.269523+0000","last_peered":"2024-09-13T17:25:44.269523+0000","last_clean":"2024-09-13T17:25:44.269523+0000","last_became_active":"2024-09-13T17:25:43.223459+0000","last_became_peered":"2024-09-13T17:25:43.223459+0000","last_unstale":"2024-09-13T17:25:44.269523+0000","last_undegraded":"2024-09-13T17:25:44.269523+0000","last_fullsized":"2024-09-13T17:25:44.269523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:10.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623264+0000","last_change":"2024-09-13T17:25:42.719792+0000","last_active":"2024-09-13T17:25:44.623264+0000","last_peered":"2024-09-13T17:25:44.623264+0000","last_clean":"2024-09-13T17:25:44.623264+0000","last_became_active":"2024-09-13T17:25:42.719540+0000","last_became_peered":"2024-09-13T17:25:42.719540+0000","last_unstale":"2024-09-13T17:25:44.623264+0000","last_undegraded":"2024-09-13T17:25:44.623264+0000","last_fullsized":"2024-09-13T17:25:44.623264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:20.967983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854564+0000","last_change":"2024-09-13T17:25:43.214381+0000","last_active":"2024-09-13T17:25:44.854564+0000","last_peered":"2024-09-13T17:25:44.854564+0000","last_clean":"2024-09-13T17:25:44.854564+0000","last_became_active":"2024-09-13T17:25:43.214139+0000","last_became_peered":"2024-09-13T17:25:43.214139+0000","last_unstale":"2024-09-13T17:25:44.854564+0000","last_undegraded":"2024-09-13T17:25:44.854564+0000","last_fullsized":"2024-09-13T17:25:44.854564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623269+0000","last_change":"2024-09-13T17:25:42.717939+0000","last_active":"2024-09-13T17:25:44.623269+0000","last_peered":"2024-09-13T17:25:44.623269+0000","last_clean":"2024-09-13T17:25:44.623269+0000","last_became_active":"2024-09-13T17:25:42.716696+0000","last_became_peered":"2024-09-13T17:25:42.716696+0000","last_unstale":"2024-09-13T17:25:44.623269+0000","last_undegraded":"2024-09-13T17:25:44.623269+0000","last_fullsized":"2024-09-13T17:25:44.623269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:20.951522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201420+0000","last_change":"2024-09-13T17:25:43.217821+0000","last_active":"2024-09-13T17:25:44.201420+0000","last_peered":"2024-09-13T17:25:44.201420+0000","last_clean":"2024-09-13T17:25:44.201420+0000","last_became_active":"2024-09-13T17:25:43.217570+0000","last_became_peered":"2024-09-13T17:25:43.217570+0000","last_unstale":"2024-09-13T17:25:44.201420+0000","last_undegraded":"2024-09-13T17:25:44.201420+0000","last_fullsized":"2024-09-13T17:25:44.201420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:34.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269658+0000","last_change":"2024-09-13T17:25:42.728663+0000","last_active":"2024-09-13T17:25:44.269658+0000","last_peered":"2024-09-13T17:25:44.269658+0000","last_clean":"2024-09-13T17:25:44.269658+0000","last_became_active":"2024-09-13T17:25:42.728413+0000","last_became_peered":"2024-09-13T17:25:42.728413+0000","last_unstale":"2024-09-13T17:25:44.269658+0000","last_undegraded":"2024-09-13T17:25:44.269658+0000","last_fullsized":"2024-09-13T17:25:44.269658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:31.028302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197059+0000","last_change":"2024-09-13T17:25:43.209045+0000","last_active":"2024-09-13T17:25:44.197059+0000","last_peered":"2024-09-13T17:25:44.197059+0000","last_clean":"2024-09-13T17:25:44.197059+0000","last_became_active":"2024-09-13T17:25:43.208727+0000","last_became_peered":"2024-09-13T17:25:43.208727+0000","last_unstale":"2024-09-13T17:25:44.197059+0000","last_undegraded":"2024-09-13T17:25:44.197059+0000","last_fullsized":"2024-09-13T17:25:44.197059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.981048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623621+0000","last_change":"2024-09-13T17:25:42.719404+0000","last_active":"2024-09-13T17:25:44.623621+0000","last_peered":"2024-09-13T17:25:44.623621+0000","last_clean":"2024-09-13T17:25:44.623621+0000","last_became_active":"2024-09-13T17:25:42.719098+0000","last_became_peered":"2024-09-13T17:25:42.719098+0000","last_unstale":"2024-09-13T17:25:44.623621+0000","last_undegraded":"2024-09-13T17:25:44.623621+0000","last_fullsized":"2024-09-13T17:25:44.623621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:40.839095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855693+0000","last_change":"2024-09-13T17:25:43.213808+0000","last_active":"2024-09-13T17:25:44.855693+0000","last_peered":"2024-09-13T17:25:44.855693+0000","last_clean":"2024-09-13T17:25:44.855693+0000","last_became_active":"2024-09-13T17:25:43.213561+0000","last_became_peered":"2024-09-13T17:25:43.213561+0000","last_unstale":"2024-09-13T17:25:44.855693+0000","last_undegraded":"2024-09-13T17:25:44.855693+0000","last_fullsized":"2024-09-13T17:25:44.855693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:11.441102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202108+0000","last_change":"2024-09-13T17:25:42.728226+0000","last_active":"2024-09-13T17:25:44.202108+0000","last_peered":"2024-09-13T17:25:44.202108+0000","last_clean":"2024-09-13T17:25:44.202108+0000","last_became_active":"2024-09-13T17:25:42.727883+0000","last_became_peered":"2024-09-13T17:25:42.727883+0000","last_unstale":"2024-09-13T17:25:44.202108+0000","last_undegraded":"2024-09-13T17:25:44.202108+0000","last_fullsized":"2024-09-13T17:25:44.202108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:57.821165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.270106+0000","last_change":"2024-09-13T17:25:43.223914+0000","last_active":"2024-09-13T17:25:44.270106+0000","last_peered":"2024-09-13T17:25:44.270106+0000","last_clean":"2024-09-13T17:25:44.270106+0000","last_became_active":"2024-09-13T17:25:43.223552+0000","last_became_peered":"2024-09-13T17:25:43.223552+0000","last_unstale":"2024-09-13T17:25:44.270106+0000","last_undegraded":"2024-09-13T17:25:44.270106+0000","last_fullsized":"2024-09-13T17:25:44.270106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.626614+0000","last_change":"2024-09-13T17:25:42.729209+0000","last_active":"2024-09-13T17:25:44.626614+0000","last_peered":"2024-09-13T17:25:44.626614+0000","last_clean":"2024-09-13T17:25:44.626614+0000","last_became_active":"2024-09-13T17:25:42.728901+0000","last_became_peered":"2024-09-13T17:25:42.728901+0000","last_unstale":"2024-09-13T17:25:44.626614+0000","last_undegraded":"2024-09-13T17:25:44.626614+0000","last_fullsized":"2024-09-13T17:25:44.626614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:56.460261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197073+0000","last_change":"2024-09-13T17:25:43.200635+0000","last_active":"2024-09-13T17:25:44.197073+0000","last_peered":"2024-09-13T17:25:44.197073+0000","last_clean":"2024-09-13T17:25:44.197073+0000","last_became_active":"2024-09-13T17:25:43.200151+0000","last_became_peered":"2024-09-13T17:25:43.200151+0000","last_unstale":"2024-09-13T17:25:44.197073+0000","last_undegraded":"2024-09-13T17:25:44.197073+0000","last_fullsized":"2024-09-13T17:25:44.197073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:28.261169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854908+0000","last_change":"2024-09-13T17:25:42.722088+0000","last_active":"2024-09-13T17:25:44.854908+0000","last_peered":"2024-09-13T17:25:44.854908+0000","last_clean":"2024-09-13T17:25:44.854908+0000","last_became_active":"2024-09-13T17:25:42.721856+0000","last_became_peered":"2024-09-13T17:25:42.721856+0000","last_unstale":"2024-09-13T17:25:44.854908+0000","last_undegraded":"2024-09-13T17:25:44.854908+0000","last_fullsized":"2024-09-13T17:25:44.854908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:20.967983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854678+0000","last_change":"2024-09-13T17:25:43.216506+0000","last_active":"2024-09-13T17:25:44.854678+0000","last_peered":"2024-09-13T17:25:44.854678+0000","last_clean":"2024-09-13T17:25:44.854678+0000","last_became_active":"2024-09-13T17:25:43.216197+0000","last_became_peered":"2024-09-13T17:25:43.216197+0000","last_unstale":"2024-09-13T17:25:44.854678+0000","last_undegraded":"2024-09-13T17:25:44.854678+0000","last_fullsized":"2024-09-13T17:25:44.854678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.762069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854964+0000","last_change":"2024-09-13T17:25:42.717481+0000","last_active":"2024-09-13T17:25:44.854964+0000","last_peered":"2024-09-13T17:25:44.854964+0000","last_clean":"2024-09-13T17:25:44.854964+0000","last_became_active":"2024-09-13T17:25:42.717124+0000","last_became_peered":"2024-09-13T17:25:42.717124+0000","last_unstale":"2024-09-13T17:25:44.854964+0000","last_undegraded":"2024-09-13T17:25:44.854964+0000","last_fullsized":"2024-09-13T17:25:44.854964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:36.806772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855452+0000","last_change":"2024-09-13T17:25:43.212011+0000","last_active":"2024-09-13T17:25:44.855452+0000","last_peered":"2024-09-13T17:25:44.855452+0000","last_clean":"2024-09-13T17:25:44.855452+0000","last_became_active":"2024-09-13T17:25:43.211787+0000","last_became_peered":"2024-09-13T17:25:43.211787+0000","last_unstale":"2024-09-13T17:25:44.855452+0000","last_undegraded":"2024-09-13T17:25:44.855452+0000","last_fullsized":"2024-09-13T17:25:44.855452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.739546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599735+0000","last_change":"2024-09-13T17:25:42.720190+0000","last_active":"2024-09-13T17:25:44.599735+0000","last_peered":"2024-09-13T17:25:44.599735+0000","last_clean":"2024-09-13T17:25:44.599735+0000","last_became_active":"2024-09-13T17:25:42.719797+0000","last_became_peered":"2024-09-13T17:25:42.719797+0000","last_unstale":"2024-09-13T17:25:44.599735+0000","last_undegraded":"2024-09-13T17:25:44.599735+0000","last_fullsized":"2024-09-13T17:25:44.599735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:18.925462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200152+0000","last_change":"2024-09-13T17:25:43.202302+0000","last_active":"2024-09-13T17:25:44.200152+0000","last_peered":"2024-09-13T17:25:44.200152+0000","last_clean":"2024-09-13T17:25:44.200152+0000","last_became_active":"2024-09-13T17:25:43.202078+0000","last_became_peered":"2024-09-13T17:25:43.202078+0000","last_unstale":"2024-09-13T17:25:44.200152+0000","last_undegraded":"2024-09-13T17:25:44.200152+0000","last_fullsized":"2024-09-13T17:25:44.200152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:29.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200035+0000","last_change":"2024-09-13T17:25:42.729431+0000","last_active":"2024-09-13T17:25:44.200035+0000","last_peered":"2024-09-13T17:25:44.200035+0000","last_clean":"2024-09-13T17:25:44.200035+0000","last_became_active":"2024-09-13T17:25:42.729155+0000","last_became_peered":"2024-09-13T17:25:42.729155+0000","last_unstale":"2024-09-13T17:25:44.200035+0000","last_undegraded":"2024-09-13T17:25:44.200035+0000","last_fullsized":"2024-09-13T17:25:44.200035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:08.577806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269810+0000","last_change":"2024-09-13T17:25:43.228249+0000","last_active":"2024-09-13T17:25:44.269810+0000","last_peered":"2024-09-13T17:25:44.269810+0000","last_clean":"2024-09-13T17:25:44.269810+0000","last_became_active":"2024-09-13T17:25:43.227949+0000","last_became_peered":"2024-09-13T17:25:43.227949+0000","last_unstale":"2024-09-13T17:25:44.269810+0000","last_undegraded":"2024-09-13T17:25:44.269810+0000","last_fullsized":"2024-09-13T17:25:44.269810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:15.332365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196548+0000","last_change":"2024-09-13T17:25:42.726115+0000","last_active":"2024-09-13T17:25:44.196548+0000","last_peered":"2024-09-13T17:25:44.196548+0000","last_clean":"2024-09-13T17:25:44.196548+0000","last_became_active":"2024-09-13T17:25:42.725823+0000","last_became_peered":"2024-09-13T17:25:42.725823+0000","last_unstale":"2024-09-13T17:25:44.196548+0000","last_undegraded":"2024-09-13T17:25:44.196548+0000","last_fullsized":"2024-09-13T17:25:44.196548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:37.987070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201975+0000","last_change":"2024-09-13T17:25:43.212003+0000","last_active":"2024-09-13T17:25:44.201975+0000","last_peered":"2024-09-13T17:25:44.201975+0000","last_clean":"2024-09-13T17:25:44.201975+0000","last_became_active":"2024-09-13T17:25:43.211758+0000","last_became_peered":"2024-09-13T17:25:43.211758+0000","last_unstale":"2024-09-13T17:25:44.201975+0000","last_undegraded":"2024-09-13T17:25:44.201975+0000","last_fullsized":"2024-09-13T17:25:44.201975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:22.042357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269947+0000","last_change":"2024-09-13T17:25:42.729425+0000","last_active":"2024-09-13T17:25:44.269947+0000","last_peered":"2024-09-13T17:25:44.269947+0000","last_clean":"2024-09-13T17:25:44.269947+0000","last_became_active":"2024-09-13T17:25:42.729109+0000","last_became_peered":"2024-09-13T17:25:42.729109+0000","last_unstale":"2024-09-13T17:25:44.269947+0000","last_undegraded":"2024-09-13T17:25:44.269947+0000","last_fullsized":"2024-09-13T17:25:44.269947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:09.971351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:25:43.199920+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:25:43.199920+0000","last_peered":"2024-09-13T17:25:43.199920+0000","last_clean":"2024-09-13T17:25:43.199920+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:25:43.199920+0000","last_undegraded":"2024-09-13T17:25:43.199920+0000","last_fullsized":"2024-09-13T17:25:43.199920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":790780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.624},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.079}]},{"osd":2,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.2130000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.256},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.167}]},{"osd":4,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.631}]},{"osd":5,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.3799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.468},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.4299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":199360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.524},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":1.49}]},{"osd":1,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.786},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.5509999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.355}]},{"osd":3,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.0900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.716}]},{"osd":5,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.659},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.5129999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":198890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.367},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.306}]},{"osd":1,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.119},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.244}]},{"osd":3,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.2110000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.2709999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.401}]},{"osd":7,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.5389999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":199382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.997},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1240000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.2410000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.349},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.333}]},{"osd":3,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.538},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.48}]},{"osd":5,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.4419999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.208},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.4019999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":479232,"data_stored":200376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.234},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.1180000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.163}]},{"osd":6,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.999}]},{"osd":7,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1890000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":198848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.1220000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.075},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.014}]},{"osd":3,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.248}]},{"osd":4,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.7530000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.077,"5min":3.077,"15min":3.077},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.4259999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.504},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.3280000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.4870000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":192248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.028},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.244}]},{"osd":6,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.214},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":3.452,"5min":3.452,"15min":3.452},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.2749999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.006},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.4730000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.181}]},{"osd":4,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.52},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.165}]},{"osd":5,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.345},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.369}]},{"osd":6,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3200000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:25:47.527 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:25:47.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 Processor -- start 2024-09-13T17:25:47.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 -- start start 2024-09-13T17:25:47.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbd6406fe10 0x7fbd640ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd640b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd640cd160 con 0x7fbd6415cc00 2024-09-13T17:25:47.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd640b34b0 con 0x7fbd6406fe10 2024-09-13T17:25:47.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.734+0000 7fbd63200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640aceb0 con 0x7fbd640b2b70 2024-09-13T17:25:47.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbd6406fe10 0x7fbd640ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbd6415cc00 0x7fbd640adbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45442/0 (socket says 172.21.15.139:45442) 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbd6406fe10 0x7fbd640ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56158/0 (socket says 172.21.15.139:56158) 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61e00700 1 -- 172.21.15.139:0/232547333 learned_addr learned my addr 172.21.15.139:0/232547333 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd62800700 1 --2- 172.21.15.139:0/232547333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd640b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 -- 172.21.15.139:0/232547333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 msgr2=0x7fbd640b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 --2- 172.21.15.139:0/232547333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd640b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 -- 172.21.15.139:0/232547333 >> v1:172.21.15.139:6789/0 conn(0x7fbd6415cc00 legacy=0x7fbd640adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 -- 172.21.15.139:0/232547333 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640ad190 con 0x7fbd6406fe10 2024-09-13T17:25:47.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd61400700 1 --2- 172.21.15.139:0/232547333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6406fe10 0x7fbd640ac890 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009850 tx=0x7fbd4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f6d4939e22ad5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:47.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd60a00700 1 -- 172.21.15.139:0/232547333 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c011830 con 0x7fbd6406fe10 2024-09-13T17:25:47.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd60a00700 1 -- 172.21.15.139:0/232547333 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c011990 con 0x7fbd6406fe10 2024-09-13T17:25:47.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd60a00700 1 -- 172.21.15.139:0/232547333 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c011d40 con 0x7fbd6406fe10 2024-09-13T17:25:47.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 -- 172.21.15.139:0/232547333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6406fe10 msgr2=0x7fbd640ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 --2- 172.21.15.139:0/232547333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6406fe10 0x7fbd640ac890 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009850 tx=0x7fbd4c009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:47.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 -- 172.21.15.139:0/232547333 shutdown_connections 2024-09-13T17:25:47.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 --2- 172.21.15.139:0/232547333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd640b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 --2- 172.21.15.139:0/232547333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6406fe10 0x7fbd640ac890 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 -- 172.21.15.139:0/232547333 >> 172.21.15.139:0/232547333 conn(0x7fbd640ce9d0 msgr2=0x7fbd640cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:47.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 -- 172.21.15.139:0/232547333 shutdown_connections 2024-09-13T17:25:47.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.738+0000 7fbd63200700 1 -- 172.21.15.139:0/232547333 wait complete. 2024-09-13T17:25:47.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.742+0000 7fbd63200700 1 Processor -- start 2024-09-13T17:25:47.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.742+0000 7fbd63200700 1 -- start start 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6406fe10 0x7fbd64152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd64158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 0x7fbd6406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64155470 con 0x7fbd6415cc00 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64158e30 con 0x7fbd6406fe10 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64155710 con 0x7fbd640b2b70 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 0x7fbd6406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 0x7fbd6406ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56164/0 (socket says 172.21.15.139:56164) 2024-09-13T17:25:47.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 -- 172.21.15.139:0/1549313595 learned_addr learned my addr 172.21.15.139:0/1549313595 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd61e00700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6406fe10 0x7fbd64152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd61400700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd64158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 -- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 msgr2=0x7fbd64158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd64158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 -- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6406fe10 msgr2=0x7fbd64152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6406fe10 0x7fbd64152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 -- 172.21.15.139:0/1549313595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0094b0 con 0x7fbd6415cc00 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd62800700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 0x7fbd6406ccb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00efc0 tx=0x7fbd5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00cd40 con 0x7fbd6415cc00 2024-09-13T17:25:47.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00f040 con 0x7fbd6415cc00 2024-09-13T17:25:47.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd641559f0 con 0x7fbd6415cc00 2024-09-13T17:25:47.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0146c0 con 0x7fbd6415cc00 2024-09-13T17:25:47.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.746+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd64158a70 con 0x7fbd6415cc00 2024-09-13T17:25:47.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.750+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd641602b0 con 0x7fbd6415cc00 2024-09-13T17:25:47.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.750+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd5c014820 con 0x7fbd6415cc00 2024-09-13T17:25:47.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.754+0000 7fbd5a000700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbd40066730 0x7fbd40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:47.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.754+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd5c084c70 con 0x7fbd6415cc00 2024-09-13T17:25:47.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.754+0000 7fbd61e00700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbd40066730 0x7fbd40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:47.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.754+0000 7fbd61e00700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbd40066730 0x7fbd40068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005930 tx=0x7fbd54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:47.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.758+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd5c051e00 con 0x7fbd6415cc00 2024-09-13T17:25:47.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.942+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd6406e1b0 con 0x7fbd40066730 2024-09-13T17:25:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.958+0000 7fbd5a000700 1 -- 172.21.15.139:0/1549313595 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286509 (secure 0 0 0) 0x7fbd6406e1b0 con 0x7fbd40066730 2024-09-13T17:25:47.969 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:47.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbd40066730 msgr2=0x7fbd40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbd40066730 0x7fbd40068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005930 tx=0x7fbd54009040 comp rx=0 tx=0).stop 2024-09-13T17:25:47.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 msgr2=0x7fbd6406ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 0x7fbd6406ccb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00efc0 tx=0x7fbd5c00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 shutdown_connections 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbd40066730 0x7fbd40068bf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6415cc00 0x7fbd6406ccb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640b2b70 0x7fbd64158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 --2- 172.21.15.139:0/1549313595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6406fe10 0x7fbd64152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 >> 172.21.15.139:0/1549313595 conn(0x7fbd640ce9d0 msgr2=0x7fbd6415a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 shutdown_connections 2024-09-13T17:25:47.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:47.966+0000 7fbd63200700 1 -- 172.21.15.139:0/1549313595 wait complete. 2024-09-13T17:25:47.973 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:25:47.991 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-13T17:25:46.117861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221032,"kb_used_data":4816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753688,"statfs":{"total":773094113280,"available":772867776512,"internally_reserved":0,"allocated":4931584,"data_stored":2762444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.427947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197270+0000","last_change":"2024-09-13T17:25:43.208050+0000","last_active":"2024-09-13T17:25:44.197270+0000","last_peered":"2024-09-13T17:25:44.197270+0000","last_clean":"2024-09-13T17:25:44.197270+0000","last_became_active":"2024-09-13T17:25:43.207811+0000","last_became_peered":"2024-09-13T17:25:43.207811+0000","last_unstale":"2024-09-13T17:25:44.197270+0000","last_undegraded":"2024-09-13T17:25:44.197270+0000","last_fullsized":"2024-09-13T17:25:44.197270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:57.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197018+0000","last_change":"2024-09-13T17:25:43.212692+0000","last_active":"2024-09-13T17:25:44.197018+0000","last_peered":"2024-09-13T17:25:44.197018+0000","last_clean":"2024-09-13T17:25:44.197018+0000","last_became_active":"2024-09-13T17:25:43.212449+0000","last_became_peered":"2024-09-13T17:25:43.212449+0000","last_unstale":"2024-09-13T17:25:44.197018+0000","last_undegraded":"2024-09-13T17:25:44.197018+0000","last_fullsized":"2024-09-13T17:25:44.197018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:22.042357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854714+0000","last_change":"2024-09-13T17:25:43.206232+0000","last_active":"2024-09-13T17:25:44.854714+0000","last_peered":"2024-09-13T17:25:44.854714+0000","last_clean":"2024-09-13T17:25:44.854714+0000","last_became_active":"2024-09-13T17:25:43.205781+0000","last_became_peered":"2024-09-13T17:25:43.205781+0000","last_unstale":"2024-09-13T17:25:44.854714+0000","last_undegraded":"2024-09-13T17:25:44.854714+0000","last_fullsized":"2024-09-13T17:25:44.854714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:15.332365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623860+0000","last_change":"2024-09-13T17:25:43.218574+0000","last_active":"2024-09-13T17:25:44.623860+0000","last_peered":"2024-09-13T17:25:44.623860+0000","last_clean":"2024-09-13T17:25:44.623860+0000","last_became_active":"2024-09-13T17:25:43.218251+0000","last_became_peered":"2024-09-13T17:25:43.218251+0000","last_unstale":"2024-09-13T17:25:44.623860+0000","last_undegraded":"2024-09-13T17:25:44.623860+0000","last_fullsized":"2024-09-13T17:25:44.623860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:57.171088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623237+0000","last_change":"2024-09-13T17:25:43.218686+0000","last_active":"2024-09-13T17:25:44.623237+0000","last_peered":"2024-09-13T17:25:44.623237+0000","last_clean":"2024-09-13T17:25:44.623237+0000","last_became_active":"2024-09-13T17:25:43.218263+0000","last_became_peered":"2024-09-13T17:25:43.218263+0000","last_unstale":"2024-09-13T17:25:44.623237+0000","last_undegraded":"2024-09-13T17:25:44.623237+0000","last_fullsized":"2024-09-13T17:25:44.623237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855598+0000","last_change":"2024-09-13T17:25:43.203259+0000","last_active":"2024-09-13T17:25:44.855598+0000","last_peered":"2024-09-13T17:25:44.855598+0000","last_clean":"2024-09-13T17:25:44.855598+0000","last_became_active":"2024-09-13T17:25:43.203008+0000","last_became_peered":"2024-09-13T17:25:43.203008+0000","last_unstale":"2024-09-13T17:25:44.855598+0000","last_undegraded":"2024-09-13T17:25:44.855598+0000","last_fullsized":"2024-09-13T17:25:44.855598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:05.284968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201172+0000","last_change":"2024-09-13T17:25:43.213909+0000","last_active":"2024-09-13T17:25:44.201172+0000","last_peered":"2024-09-13T17:25:44.201172+0000","last_clean":"2024-09-13T17:25:44.201172+0000","last_became_active":"2024-09-13T17:25:43.213397+0000","last_became_peered":"2024-09-13T17:25:43.213397+0000","last_unstale":"2024-09-13T17:25:44.201172+0000","last_undegraded":"2024-09-13T17:25:44.201172+0000","last_fullsized":"2024-09-13T17:25:44.201172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:13.921489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196600+0000","last_change":"2024-09-13T17:25:43.202662+0000","last_active":"2024-09-13T17:25:44.196600+0000","last_peered":"2024-09-13T17:25:44.196600+0000","last_clean":"2024-09-13T17:25:44.196600+0000","last_became_active":"2024-09-13T17:25:43.202437+0000","last_became_peered":"2024-09-13T17:25:43.202437+0000","last_unstale":"2024-09-13T17:25:44.196600+0000","last_undegraded":"2024-09-13T17:25:44.196600+0000","last_fullsized":"2024-09-13T17:25:44.196600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:20.072342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855048+0000","last_change":"2024-09-13T17:25:43.211391+0000","last_active":"2024-09-13T17:25:44.855048+0000","last_peered":"2024-09-13T17:25:44.855048+0000","last_clean":"2024-09-13T17:25:44.855048+0000","last_became_active":"2024-09-13T17:25:43.211137+0000","last_became_peered":"2024-09-13T17:25:43.211137+0000","last_unstale":"2024-09-13T17:25:44.855048+0000","last_undegraded":"2024-09-13T17:25:44.855048+0000","last_fullsized":"2024-09-13T17:25:44.855048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:28.942367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201798+0000","last_change":"2024-09-13T17:25:43.211498+0000","last_active":"2024-09-13T17:25:44.201798+0000","last_peered":"2024-09-13T17:25:44.201798+0000","last_clean":"2024-09-13T17:25:44.201798+0000","last_became_active":"2024-09-13T17:25:43.211163+0000","last_became_peered":"2024-09-13T17:25:43.211163+0000","last_unstale":"2024-09-13T17:25:44.201798+0000","last_undegraded":"2024-09-13T17:25:44.201798+0000","last_fullsized":"2024-09-13T17:25:44.201798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:20.072342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202102+0000","last_change":"2024-09-13T17:25:43.214549+0000","last_active":"2024-09-13T17:25:44.202102+0000","last_peered":"2024-09-13T17:25:44.202102+0000","last_clean":"2024-09-13T17:25:44.202102+0000","last_became_active":"2024-09-13T17:25:43.214302+0000","last_became_peered":"2024-09-13T17:25:43.214302+0000","last_unstale":"2024-09-13T17:25:44.202102+0000","last_undegraded":"2024-09-13T17:25:44.202102+0000","last_fullsized":"2024-09-13T17:25:44.202102+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:23.395033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854717+0000","last_change":"2024-09-13T17:25:43.202890+0000","last_active":"2024-09-13T17:25:44.854717+0000","last_peered":"2024-09-13T17:25:44.854717+0000","last_clean":"2024-09-13T17:25:44.854717+0000","last_became_active":"2024-09-13T17:25:43.202651+0000","last_became_peered":"2024-09-13T17:25:43.202651+0000","last_unstale":"2024-09-13T17:25:44.854717+0000","last_undegraded":"2024-09-13T17:25:44.854717+0000","last_fullsized":"2024-09-13T17:25:44.854717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.287351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201259+0000","last_change":"2024-09-13T17:25:43.204747+0000","last_active":"2024-09-13T17:25:44.201259+0000","last_peered":"2024-09-13T17:25:44.201259+0000","last_clean":"2024-09-13T17:25:44.201259+0000","last_became_active":"2024-09-13T17:25:43.204457+0000","last_became_peered":"2024-09-13T17:25:43.204457+0000","last_unstale":"2024-09-13T17:25:44.201259+0000","last_undegraded":"2024-09-13T17:25:44.201259+0000","last_fullsized":"2024-09-13T17:25:44.201259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:01.337432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.199902+0000","last_change":"2024-09-13T17:25:43.212942+0000","last_active":"2024-09-13T17:25:44.199902+0000","last_peered":"2024-09-13T17:25:44.199902+0000","last_clean":"2024-09-13T17:25:44.199902+0000","last_became_active":"2024-09-13T17:25:43.212698+0000","last_became_peered":"2024-09-13T17:25:43.212698+0000","last_unstale":"2024-09-13T17:25:44.199902+0000","last_undegraded":"2024-09-13T17:25:44.199902+0000","last_fullsized":"2024-09-13T17:25:44.199902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.739546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201206+0000","last_change":"2024-09-13T17:25:43.209366+0000","last_active":"2024-09-13T17:25:44.201206+0000","last_peered":"2024-09-13T17:25:44.201206+0000","last_clean":"2024-09-13T17:25:44.201206+0000","last_became_active":"2024-09-13T17:25:43.208972+0000","last_became_peered":"2024-09-13T17:25:43.208972+0000","last_unstale":"2024-09-13T17:25:44.201206+0000","last_undegraded":"2024-09-13T17:25:44.201206+0000","last_fullsized":"2024-09-13T17:25:44.201206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.739546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269272+0000","last_change":"2024-09-13T17:25:43.228735+0000","last_active":"2024-09-13T17:25:44.269272+0000","last_peered":"2024-09-13T17:25:44.269272+0000","last_clean":"2024-09-13T17:25:44.269272+0000","last_became_active":"2024-09-13T17:25:43.223809+0000","last_became_peered":"2024-09-13T17:25:43.223809+0000","last_unstale":"2024-09-13T17:25:44.269272+0000","last_undegraded":"2024-09-13T17:25:44.269272+0000","last_fullsized":"2024-09-13T17:25:44.269272+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.270158+0000","last_change":"2024-09-13T17:25:43.223332+0000","last_active":"2024-09-13T17:25:44.270158+0000","last_peered":"2024-09-13T17:25:44.270158+0000","last_clean":"2024-09-13T17:25:44.270158+0000","last_became_active":"2024-09-13T17:25:43.223068+0000","last_became_peered":"2024-09-13T17:25:43.223068+0000","last_unstale":"2024-09-13T17:25:44.270158+0000","last_undegraded":"2024-09-13T17:25:44.270158+0000","last_fullsized":"2024-09-13T17:25:44.270158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.287351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600131+0000","last_change":"2024-09-13T17:25:43.225707+0000","last_active":"2024-09-13T17:25:44.600131+0000","last_peered":"2024-09-13T17:25:44.600131+0000","last_clean":"2024-09-13T17:25:44.600131+0000","last_became_active":"2024-09-13T17:25:43.225465+0000","last_became_peered":"2024-09-13T17:25:43.225465+0000","last_unstale":"2024-09-13T17:25:44.600131+0000","last_undegraded":"2024-09-13T17:25:44.600131+0000","last_fullsized":"2024-09-13T17:25:44.600131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623743+0000","last_change":"2024-09-13T17:25:43.207844+0000","last_active":"2024-09-13T17:25:44.623743+0000","last_peered":"2024-09-13T17:25:44.623743+0000","last_clean":"2024-09-13T17:25:44.623743+0000","last_became_active":"2024-09-13T17:25:43.207623+0000","last_became_peered":"2024-09-13T17:25:43.207623+0000","last_unstale":"2024-09-13T17:25:44.623743+0000","last_undegraded":"2024-09-13T17:25:44.623743+0000","last_fullsized":"2024-09-13T17:25:44.623743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599910+0000","last_change":"2024-09-13T17:25:43.226362+0000","last_active":"2024-09-13T17:25:44.599910+0000","last_peered":"2024-09-13T17:25:44.599910+0000","last_clean":"2024-09-13T17:25:44.599910+0000","last_became_active":"2024-09-13T17:25:43.225314+0000","last_became_peered":"2024-09-13T17:25:43.225314+0000","last_unstale":"2024-09-13T17:25:44.599910+0000","last_undegraded":"2024-09-13T17:25:44.599910+0000","last_fullsized":"2024-09-13T17:25:44.599910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201347+0000","last_change":"2024-09-13T17:25:43.210872+0000","last_active":"2024-09-13T17:25:44.201347+0000","last_peered":"2024-09-13T17:25:44.201347+0000","last_clean":"2024-09-13T17:25:44.201347+0000","last_became_active":"2024-09-13T17:25:43.210600+0000","last_became_peered":"2024-09-13T17:25:43.210600+0000","last_unstale":"2024-09-13T17:25:44.201347+0000","last_undegraded":"2024-09-13T17:25:44.201347+0000","last_fullsized":"2024-09-13T17:25:44.201347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:29.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200274+0000","last_change":"2024-09-13T17:25:43.206628+0000","last_active":"2024-09-13T17:25:44.200274+0000","last_peered":"2024-09-13T17:25:44.200274+0000","last_clean":"2024-09-13T17:25:44.200274+0000","last_became_active":"2024-09-13T17:25:43.205949+0000","last_became_peered":"2024-09-13T17:25:43.205949+0000","last_unstale":"2024-09-13T17:25:44.200274+0000","last_undegraded":"2024-09-13T17:25:44.200274+0000","last_fullsized":"2024-09-13T17:25:44.200274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:22.042357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269373+0000","last_change":"2024-09-13T17:25:43.223365+0000","last_active":"2024-09-13T17:25:44.269373+0000","last_peered":"2024-09-13T17:25:44.269373+0000","last_clean":"2024-09-13T17:25:44.269373+0000","last_became_active":"2024-09-13T17:25:43.223097+0000","last_became_peered":"2024-09-13T17:25:43.223097+0000","last_unstale":"2024-09-13T17:25:44.269373+0000","last_undegraded":"2024-09-13T17:25:44.269373+0000","last_fullsized":"2024-09-13T17:25:44.269373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:57.171088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623265+0000","last_change":"2024-09-13T17:25:43.203665+0000","last_active":"2024-09-13T17:25:44.623265+0000","last_peered":"2024-09-13T17:25:44.623265+0000","last_clean":"2024-09-13T17:25:44.623265+0000","last_became_active":"2024-09-13T17:25:43.203329+0000","last_became_peered":"2024-09-13T17:25:43.203329+0000","last_unstale":"2024-09-13T17:25:44.623265+0000","last_undegraded":"2024-09-13T17:25:44.623265+0000","last_fullsized":"2024-09-13T17:25:44.623265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.287351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600099+0000","last_change":"2024-09-13T17:25:43.222428+0000","last_active":"2024-09-13T17:25:44.600099+0000","last_peered":"2024-09-13T17:25:44.600099+0000","last_clean":"2024-09-13T17:25:44.600099+0000","last_became_active":"2024-09-13T17:25:43.221921+0000","last_became_peered":"2024-09-13T17:25:43.221921+0000","last_unstale":"2024-09-13T17:25:44.600099+0000","last_undegraded":"2024-09-13T17:25:44.600099+0000","last_fullsized":"2024-09-13T17:25:44.600099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:28.942367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.856303+0000","last_change":"2024-09-13T17:25:43.204301+0000","last_active":"2024-09-13T17:25:44.856303+0000","last_peered":"2024-09-13T17:25:44.856303+0000","last_clean":"2024-09-13T17:25:44.856303+0000","last_became_active":"2024-09-13T17:25:43.204030+0000","last_became_peered":"2024-09-13T17:25:43.204030+0000","last_unstale":"2024-09-13T17:25:44.856303+0000","last_undegraded":"2024-09-13T17:25:44.856303+0000","last_fullsized":"2024-09-13T17:25:44.856303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:34.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600293+0000","last_change":"2024-09-13T17:25:43.224113+0000","last_active":"2024-09-13T17:25:44.600293+0000","last_peered":"2024-09-13T17:25:44.600293+0000","last_clean":"2024-09-13T17:25:44.600293+0000","last_became_active":"2024-09-13T17:25:43.221532+0000","last_became_peered":"2024-09-13T17:25:43.221532+0000","last_unstale":"2024-09-13T17:25:44.600293+0000","last_undegraded":"2024-09-13T17:25:44.600293+0000","last_fullsized":"2024-09-13T17:25:44.600293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201818+0000","last_change":"2024-09-13T17:25:43.216776+0000","last_active":"2024-09-13T17:25:44.201818+0000","last_peered":"2024-09-13T17:25:44.201818+0000","last_clean":"2024-09-13T17:25:44.201818+0000","last_became_active":"2024-09-13T17:25:43.216299+0000","last_became_peered":"2024-09-13T17:25:43.216299+0000","last_unstale":"2024-09-13T17:25:44.201818+0000","last_undegraded":"2024-09-13T17:25:44.201818+0000","last_fullsized":"2024-09-13T17:25:44.201818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:28.261169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599860+0000","last_change":"2024-09-13T17:25:43.226172+0000","last_active":"2024-09-13T17:25:44.599860+0000","last_peered":"2024-09-13T17:25:44.599860+0000","last_clean":"2024-09-13T17:25:44.599860+0000","last_became_active":"2024-09-13T17:25:43.224704+0000","last_became_peered":"2024-09-13T17:25:43.224704+0000","last_unstale":"2024-09-13T17:25:44.599860+0000","last_undegraded":"2024-09-13T17:25:44.599860+0000","last_fullsized":"2024-09-13T17:25:44.599860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:05.791019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599623+0000","last_change":"2024-09-13T17:25:43.226609+0000","last_active":"2024-09-13T17:25:44.599623+0000","last_peered":"2024-09-13T17:25:44.599623+0000","last_clean":"2024-09-13T17:25:44.599623+0000","last_became_active":"2024-09-13T17:25:43.226332+0000","last_became_peered":"2024-09-13T17:25:43.226332+0000","last_unstale":"2024-09-13T17:25:44.599623+0000","last_undegraded":"2024-09-13T17:25:44.599623+0000","last_fullsized":"2024-09-13T17:25:44.599623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:15.332365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269737+0000","last_change":"2024-09-13T17:25:43.229108+0000","last_active":"2024-09-13T17:25:44.269737+0000","last_peered":"2024-09-13T17:25:44.269737+0000","last_clean":"2024-09-13T17:25:44.269737+0000","last_became_active":"2024-09-13T17:25:43.223765+0000","last_became_peered":"2024-09-13T17:25:43.223765+0000","last_unstale":"2024-09-13T17:25:44.269737+0000","last_undegraded":"2024-09-13T17:25:44.269737+0000","last_fullsized":"2024-09-13T17:25:44.269737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:02.819978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855301+0000","last_change":"2024-09-13T17:25:43.209556+0000","last_active":"2024-09-13T17:25:44.855301+0000","last_peered":"2024-09-13T17:25:44.855301+0000","last_clean":"2024-09-13T17:25:44.855301+0000","last_became_active":"2024-09-13T17:25:43.209300+0000","last_became_peered":"2024-09-13T17:25:43.209300+0000","last_unstale":"2024-09-13T17:25:44.855301+0000","last_undegraded":"2024-09-13T17:25:44.855301+0000","last_fullsized":"2024-09-13T17:25:44.855301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:42.763701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269932+0000","last_change":"2024-09-13T17:25:43.228255+0000","last_active":"2024-09-13T17:25:44.269932+0000","last_peered":"2024-09-13T17:25:44.269932+0000","last_clean":"2024-09-13T17:25:44.269932+0000","last_became_active":"2024-09-13T17:25:43.224006+0000","last_became_peered":"2024-09-13T17:25:43.224006+0000","last_unstale":"2024-09-13T17:25:44.269932+0000","last_undegraded":"2024-09-13T17:25:44.269932+0000","last_fullsized":"2024-09-13T17:25:44.269932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.600237+0000","last_change":"2024-09-13T17:25:42.717840+0000","last_active":"2024-09-13T17:25:44.600237+0000","last_peered":"2024-09-13T17:25:44.600237+0000","last_clean":"2024-09-13T17:25:44.600237+0000","last_became_active":"2024-09-13T17:25:42.717566+0000","last_became_peered":"2024-09-13T17:25:42.717566+0000","last_unstale":"2024-09-13T17:25:44.600237+0000","last_undegraded":"2024-09-13T17:25:44.600237+0000","last_fullsized":"2024-09-13T17:25:44.600237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:37.515930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.856108+0000","last_change":"2024-09-13T17:25:43.207377+0000","last_active":"2024-09-13T17:25:44.856108+0000","last_peered":"2024-09-13T17:25:44.856108+0000","last_clean":"2024-09-13T17:25:44.856108+0000","last_became_active":"2024-09-13T17:25:43.207147+0000","last_became_peered":"2024-09-13T17:25:43.207147+0000","last_unstale":"2024-09-13T17:25:44.856108+0000","last_undegraded":"2024-09-13T17:25:44.856108+0000","last_fullsized":"2024-09-13T17:25:44.856108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:18.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855073+0000","last_change":"2024-09-13T17:25:42.721133+0000","last_active":"2024-09-13T17:25:44.855073+0000","last_peered":"2024-09-13T17:25:44.855073+0000","last_clean":"2024-09-13T17:25:44.855073+0000","last_became_active":"2024-09-13T17:25:42.720782+0000","last_became_peered":"2024-09-13T17:25:42.720782+0000","last_unstale":"2024-09-13T17:25:44.855073+0000","last_undegraded":"2024-09-13T17:25:44.855073+0000","last_fullsized":"2024-09-13T17:25:44.855073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:35.522014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200715+0000","last_change":"2024-09-13T17:25:43.215971+0000","last_active":"2024-09-13T17:25:44.200715+0000","last_peered":"2024-09-13T17:25:44.200715+0000","last_clean":"2024-09-13T17:25:44.200715+0000","last_became_active":"2024-09-13T17:25:43.215727+0000","last_became_peered":"2024-09-13T17:25:43.215727+0000","last_unstale":"2024-09-13T17:25:44.200715+0000","last_undegraded":"2024-09-13T17:25:44.200715+0000","last_fullsized":"2024-09-13T17:25:44.200715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:42.763701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.856267+0000","last_change":"2024-09-13T17:25:42.733667+0000","last_active":"2024-09-13T17:25:44.856267+0000","last_peered":"2024-09-13T17:25:44.856267+0000","last_clean":"2024-09-13T17:25:44.856267+0000","last_became_active":"2024-09-13T17:25:42.733450+0000","last_became_peered":"2024-09-13T17:25:42.733450+0000","last_unstale":"2024-09-13T17:25:44.856267+0000","last_undegraded":"2024-09-13T17:25:44.856267+0000","last_fullsized":"2024-09-13T17:25:44.856267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:56.155550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197137+0000","last_change":"2024-09-13T17:25:43.214741+0000","last_active":"2024-09-13T17:25:44.197137+0000","last_peered":"2024-09-13T17:25:44.197137+0000","last_clean":"2024-09-13T17:25:44.197137+0000","last_became_active":"2024-09-13T17:25:43.214519+0000","last_became_peered":"2024-09-13T17:25:43.214519+0000","last_unstale":"2024-09-13T17:25:44.197137+0000","last_undegraded":"2024-09-13T17:25:44.197137+0000","last_fullsized":"2024-09-13T17:25:44.197137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:13.921489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200486+0000","last_change":"2024-09-13T17:25:42.728803+0000","last_active":"2024-09-13T17:25:44.200486+0000","last_peered":"2024-09-13T17:25:44.200486+0000","last_clean":"2024-09-13T17:25:44.200486+0000","last_became_active":"2024-09-13T17:25:42.728592+0000","last_became_peered":"2024-09-13T17:25:42.728592+0000","last_unstale":"2024-09-13T17:25:44.200486+0000","last_undegraded":"2024-09-13T17:25:44.200486+0000","last_fullsized":"2024-09-13T17:25:44.200486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:09.097149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855044+0000","last_change":"2024-09-13T17:25:43.205321+0000","last_active":"2024-09-13T17:25:44.855044+0000","last_peered":"2024-09-13T17:25:44.855044+0000","last_clean":"2024-09-13T17:25:44.855044+0000","last_became_active":"2024-09-13T17:25:43.205042+0000","last_became_peered":"2024-09-13T17:25:43.205042+0000","last_unstale":"2024-09-13T17:25:44.855044+0000","last_undegraded":"2024-09-13T17:25:44.855044+0000","last_fullsized":"2024-09-13T17:25:44.855044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:05.791019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201649+0000","last_change":"2024-09-13T17:25:42.728145+0000","last_active":"2024-09-13T17:25:44.201649+0000","last_peered":"2024-09-13T17:25:44.201649+0000","last_clean":"2024-09-13T17:25:44.201649+0000","last_became_active":"2024-09-13T17:25:42.727879+0000","last_became_peered":"2024-09-13T17:25:42.727879+0000","last_unstale":"2024-09-13T17:25:44.201649+0000","last_undegraded":"2024-09-13T17:25:44.201649+0000","last_fullsized":"2024-09-13T17:25:44.201649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:01.804439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201346+0000","last_change":"2024-09-13T17:25:43.204303+0000","last_active":"2024-09-13T17:25:44.201346+0000","last_peered":"2024-09-13T17:25:44.201346+0000","last_clean":"2024-09-13T17:25:44.201346+0000","last_became_active":"2024-09-13T17:25:43.203815+0000","last_became_peered":"2024-09-13T17:25:43.203815+0000","last_unstale":"2024-09-13T17:25:44.201346+0000","last_undegraded":"2024-09-13T17:25:44.201346+0000","last_fullsized":"2024-09-13T17:25:44.201346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:42.763701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269465+0000","last_change":"2024-09-13T17:25:42.727079+0000","last_active":"2024-09-13T17:25:44.269465+0000","last_peered":"2024-09-13T17:25:44.269465+0000","last_clean":"2024-09-13T17:25:44.269465+0000","last_became_active":"2024-09-13T17:25:42.726807+0000","last_became_peered":"2024-09-13T17:25:42.726807+0000","last_unstale":"2024-09-13T17:25:44.269465+0000","last_undegraded":"2024-09-13T17:25:44.269465+0000","last_fullsized":"2024-09-13T17:25:44.269465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:49.894247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200355+0000","last_change":"2024-09-13T17:25:43.208367+0000","last_active":"2024-09-13T17:25:44.200355+0000","last_peered":"2024-09-13T17:25:44.200355+0000","last_clean":"2024-09-13T17:25:44.200355+0000","last_became_active":"2024-09-13T17:25:43.206435+0000","last_became_peered":"2024-09-13T17:25:43.206435+0000","last_unstale":"2024-09-13T17:25:44.200355+0000","last_undegraded":"2024-09-13T17:25:44.200355+0000","last_fullsized":"2024-09-13T17:25:44.200355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:28.261169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855565+0000","last_change":"2024-09-13T17:25:42.727936+0000","last_active":"2024-09-13T17:25:44.855565+0000","last_peered":"2024-09-13T17:25:44.855565+0000","last_clean":"2024-09-13T17:25:44.855565+0000","last_became_active":"2024-09-13T17:25:42.727667+0000","last_became_peered":"2024-09-13T17:25:42.727667+0000","last_unstale":"2024-09-13T17:25:44.855565+0000","last_undegraded":"2024-09-13T17:25:44.855565+0000","last_fullsized":"2024-09-13T17:25:44.855565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:09.001400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196818+0000","last_change":"2024-09-13T17:25:43.208909+0000","last_active":"2024-09-13T17:25:44.196818+0000","last_peered":"2024-09-13T17:25:44.196818+0000","last_clean":"2024-09-13T17:25:44.196818+0000","last_became_active":"2024-09-13T17:25:43.208637+0000","last_became_peered":"2024-09-13T17:25:43.208637+0000","last_unstale":"2024-09-13T17:25:44.196818+0000","last_undegraded":"2024-09-13T17:25:44.196818+0000","last_fullsized":"2024-09-13T17:25:44.196818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:09.260041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200011+0000","last_change":"2024-09-13T17:25:42.718000+0000","last_active":"2024-09-13T17:25:44.200011+0000","last_peered":"2024-09-13T17:25:44.200011+0000","last_clean":"2024-09-13T17:25:44.200011+0000","last_became_active":"2024-09-13T17:25:42.717744+0000","last_became_peered":"2024-09-13T17:25:42.717744+0000","last_unstale":"2024-09-13T17:25:44.200011+0000","last_undegraded":"2024-09-13T17:25:44.200011+0000","last_fullsized":"2024-09-13T17:25:44.200011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:37.987070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623892+0000","last_change":"2024-09-13T17:25:43.215749+0000","last_active":"2024-09-13T17:25:44.623892+0000","last_peered":"2024-09-13T17:25:44.623892+0000","last_clean":"2024-09-13T17:25:44.623892+0000","last_became_active":"2024-09-13T17:25:43.215508+0000","last_became_peered":"2024-09-13T17:25:43.215508+0000","last_unstale":"2024-09-13T17:25:44.623892+0000","last_undegraded":"2024-09-13T17:25:44.623892+0000","last_fullsized":"2024-09-13T17:25:44.623892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:10.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197196+0000","last_change":"2024-09-13T17:25:42.731108+0000","last_active":"2024-09-13T17:25:44.197196+0000","last_peered":"2024-09-13T17:25:44.197196+0000","last_clean":"2024-09-13T17:25:44.197196+0000","last_became_active":"2024-09-13T17:25:42.730659+0000","last_became_peered":"2024-09-13T17:25:42.730659+0000","last_unstale":"2024-09-13T17:25:44.197196+0000","last_undegraded":"2024-09-13T17:25:44.197196+0000","last_fullsized":"2024-09-13T17:25:44.197196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:27.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269982+0000","last_change":"2024-09-13T17:25:43.228482+0000","last_active":"2024-09-13T17:25:44.269982+0000","last_peered":"2024-09-13T17:25:44.269982+0000","last_clean":"2024-09-13T17:25:44.269982+0000","last_became_active":"2024-09-13T17:25:43.223591+0000","last_became_peered":"2024-09-13T17:25:43.223591+0000","last_unstale":"2024-09-13T17:25:44.269982+0000","last_undegraded":"2024-09-13T17:25:44.269982+0000","last_fullsized":"2024-09-13T17:25:44.269982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:28.942367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202118+0000","last_change":"2024-09-13T17:25:42.733238+0000","last_active":"2024-09-13T17:25:44.202118+0000","last_peered":"2024-09-13T17:25:44.202118+0000","last_clean":"2024-09-13T17:25:44.202118+0000","last_became_active":"2024-09-13T17:25:42.732956+0000","last_became_peered":"2024-09-13T17:25:42.732956+0000","last_unstale":"2024-09-13T17:25:44.202118+0000","last_undegraded":"2024-09-13T17:25:44.202118+0000","last_fullsized":"2024-09-13T17:25:44.202118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:09.001400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854896+0000","last_change":"2024-09-13T17:25:43.207975+0000","last_active":"2024-09-13T17:25:44.854896+0000","last_peered":"2024-09-13T17:25:44.854896+0000","last_clean":"2024-09-13T17:25:44.854896+0000","last_became_active":"2024-09-13T17:25:43.207713+0000","last_became_peered":"2024-09-13T17:25:43.207713+0000","last_unstale":"2024-09-13T17:25:44.854896+0000","last_undegraded":"2024-09-13T17:25:44.854896+0000","last_fullsized":"2024-09-13T17:25:44.854896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202139+0000","last_change":"2024-09-13T17:25:42.728245+0000","last_active":"2024-09-13T17:25:44.202139+0000","last_peered":"2024-09-13T17:25:44.202139+0000","last_clean":"2024-09-13T17:25:44.202139+0000","last_became_active":"2024-09-13T17:25:42.726340+0000","last_became_peered":"2024-09-13T17:25:42.726340+0000","last_unstale":"2024-09-13T17:25:44.202139+0000","last_undegraded":"2024-09-13T17:25:44.202139+0000","last_fullsized":"2024-09-13T17:25:44.202139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:00.313972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200789+0000","last_change":"2024-09-13T17:25:43.205653+0000","last_active":"2024-09-13T17:25:44.200789+0000","last_peered":"2024-09-13T17:25:44.200789+0000","last_clean":"2024-09-13T17:25:44.200789+0000","last_became_active":"2024-09-13T17:25:43.205358+0000","last_became_peered":"2024-09-13T17:25:43.205358+0000","last_unstale":"2024-09-13T17:25:44.200789+0000","last_undegraded":"2024-09-13T17:25:44.200789+0000","last_fullsized":"2024-09-13T17:25:44.200789+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:05.284968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196875+0000","last_change":"2024-09-13T17:25:42.731008+0000","last_active":"2024-09-13T17:25:44.196875+0000","last_peered":"2024-09-13T17:25:44.196875+0000","last_clean":"2024-09-13T17:25:44.196875+0000","last_became_active":"2024-09-13T17:25:42.730758+0000","last_became_peered":"2024-09-13T17:25:42.730758+0000","last_unstale":"2024-09-13T17:25:44.196875+0000","last_undegraded":"2024-09-13T17:25:44.196875+0000","last_fullsized":"2024-09-13T17:25:44.196875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:09.097149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854461+0000","last_change":"2024-09-13T17:25:43.217135+0000","last_active":"2024-09-13T17:25:44.854461+0000","last_peered":"2024-09-13T17:25:44.854461+0000","last_clean":"2024-09-13T17:25:44.854461+0000","last_became_active":"2024-09-13T17:25:43.216873+0000","last_became_peered":"2024-09-13T17:25:43.216873+0000","last_unstale":"2024-09-13T17:25:44.854461+0000","last_undegraded":"2024-09-13T17:25:44.854461+0000","last_fullsized":"2024-09-13T17:25:44.854461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:09.593344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197047+0000","last_change":"2024-09-13T17:25:42.731456+0000","last_active":"2024-09-13T17:25:44.197047+0000","last_peered":"2024-09-13T17:25:44.197047+0000","last_clean":"2024-09-13T17:25:44.197047+0000","last_became_active":"2024-09-13T17:25:42.731202+0000","last_became_peered":"2024-09-13T17:25:42.731202+0000","last_unstale":"2024-09-13T17:25:44.197047+0000","last_undegraded":"2024-09-13T17:25:44.197047+0000","last_fullsized":"2024-09-13T17:25:44.197047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:08.577806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196558+0000","last_change":"2024-09-13T17:25:43.207961+0000","last_active":"2024-09-13T17:25:44.196558+0000","last_peered":"2024-09-13T17:25:44.196558+0000","last_clean":"2024-09-13T17:25:44.196558+0000","last_became_active":"2024-09-13T17:25:43.207625+0000","last_became_peered":"2024-09-13T17:25:43.207625+0000","last_unstale":"2024-09-13T17:25:44.196558+0000","last_undegraded":"2024-09-13T17:25:44.196558+0000","last_fullsized":"2024-09-13T17:25:44.196558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:23.395033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855542+0000","last_change":"2024-09-13T17:25:42.727982+0000","last_active":"2024-09-13T17:25:44.855542+0000","last_peered":"2024-09-13T17:25:44.855542+0000","last_clean":"2024-09-13T17:25:44.855542+0000","last_became_active":"2024-09-13T17:25:42.727644+0000","last_became_peered":"2024-09-13T17:25:42.727644+0000","last_unstale":"2024-09-13T17:25:44.855542+0000","last_undegraded":"2024-09-13T17:25:44.855542+0000","last_fullsized":"2024-09-13T17:25:44.855542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:08.577806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269512+0000","last_change":"2024-09-13T17:25:43.220277+0000","last_active":"2024-09-13T17:25:44.269512+0000","last_peered":"2024-09-13T17:25:44.269512+0000","last_clean":"2024-09-13T17:25:44.269512+0000","last_became_active":"2024-09-13T17:25:43.219993+0000","last_became_peered":"2024-09-13T17:25:43.219993+0000","last_unstale":"2024-09-13T17:25:44.269512+0000","last_undegraded":"2024-09-13T17:25:44.269512+0000","last_fullsized":"2024-09-13T17:25:44.269512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:01.329510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599755+0000","last_change":"2024-09-13T17:25:42.717754+0000","last_active":"2024-09-13T17:25:44.599755+0000","last_peered":"2024-09-13T17:25:44.599755+0000","last_clean":"2024-09-13T17:25:44.599755+0000","last_became_active":"2024-09-13T17:25:42.717484+0000","last_became_peered":"2024-09-13T17:25:42.717484+0000","last_unstale":"2024-09-13T17:25:44.599755+0000","last_undegraded":"2024-09-13T17:25:44.599755+0000","last_fullsized":"2024-09-13T17:25:44.599755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:33.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196934+0000","last_change":"2024-09-13T17:25:43.207696+0000","last_active":"2024-09-13T17:25:44.196934+0000","last_peered":"2024-09-13T17:25:44.196934+0000","last_clean":"2024-09-13T17:25:44.196934+0000","last_became_active":"2024-09-13T17:25:43.207480+0000","last_became_peered":"2024-09-13T17:25:43.207480+0000","last_unstale":"2024-09-13T17:25:44.196934+0000","last_undegraded":"2024-09-13T17:25:44.196934+0000","last_fullsized":"2024-09-13T17:25:44.196934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:00.647608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269324+0000","last_change":"2024-09-13T17:25:42.726363+0000","last_active":"2024-09-13T17:25:44.269324+0000","last_peered":"2024-09-13T17:25:44.269324+0000","last_clean":"2024-09-13T17:25:44.269324+0000","last_became_active":"2024-09-13T17:25:42.726100+0000","last_became_peered":"2024-09-13T17:25:42.726100+0000","last_unstale":"2024-09-13T17:25:44.269324+0000","last_undegraded":"2024-09-13T17:25:44.269324+0000","last_fullsized":"2024-09-13T17:25:44.269324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:28.182506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196927+0000","last_change":"2024-09-13T17:25:43.218153+0000","last_active":"2024-09-13T17:25:44.196927+0000","last_peered":"2024-09-13T17:25:44.196927+0000","last_clean":"2024-09-13T17:25:44.196927+0000","last_became_active":"2024-09-13T17:25:43.217812+0000","last_became_peered":"2024-09-13T17:25:43.217812+0000","last_unstale":"2024-09-13T17:25:44.196927+0000","last_undegraded":"2024-09-13T17:25:44.196927+0000","last_fullsized":"2024-09-13T17:25:44.196927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:01.337432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201999+0000","last_change":"2024-09-13T17:25:42.731673+0000","last_active":"2024-09-13T17:25:44.201999+0000","last_peered":"2024-09-13T17:25:44.201999+0000","last_clean":"2024-09-13T17:25:44.201999+0000","last_became_active":"2024-09-13T17:25:42.731435+0000","last_became_peered":"2024-09-13T17:25:42.731435+0000","last_unstale":"2024-09-13T17:25:44.201999+0000","last_undegraded":"2024-09-13T17:25:44.201999+0000","last_fullsized":"2024-09-13T17:25:44.201999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:53.752433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201967+0000","last_change":"2024-09-13T17:25:43.203619+0000","last_active":"2024-09-13T17:25:44.201967+0000","last_peered":"2024-09-13T17:25:44.201967+0000","last_clean":"2024-09-13T17:25:44.201967+0000","last_became_active":"2024-09-13T17:25:43.203383+0000","last_became_peered":"2024-09-13T17:25:43.203383+0000","last_unstale":"2024-09-13T17:25:44.201967+0000","last_undegraded":"2024-09-13T17:25:44.201967+0000","last_fullsized":"2024-09-13T17:25:44.201967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:05.284968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200804+0000","last_change":"2024-09-13T17:25:42.729732+0000","last_active":"2024-09-13T17:25:44.200804+0000","last_peered":"2024-09-13T17:25:44.200804+0000","last_clean":"2024-09-13T17:25:44.200804+0000","last_became_active":"2024-09-13T17:25:42.729438+0000","last_became_peered":"2024-09-13T17:25:42.729438+0000","last_unstale":"2024-09-13T17:25:44.200804+0000","last_undegraded":"2024-09-13T17:25:44.200804+0000","last_fullsized":"2024-09-13T17:25:44.200804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:59.271812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200709+0000","last_change":"2024-09-13T17:25:43.201056+0000","last_active":"2024-09-13T17:25:44.200709+0000","last_peered":"2024-09-13T17:25:44.200709+0000","last_clean":"2024-09-13T17:25:44.200709+0000","last_became_active":"2024-09-13T17:25:43.200679+0000","last_became_peered":"2024-09-13T17:25:43.200679+0000","last_unstale":"2024-09-13T17:25:44.200709+0000","last_undegraded":"2024-09-13T17:25:44.200709+0000","last_fullsized":"2024-09-13T17:25:44.200709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:20.072342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623859+0000","last_change":"2024-09-13T17:25:42.724686+0000","last_active":"2024-09-13T17:25:44.623859+0000","last_peered":"2024-09-13T17:25:44.623859+0000","last_clean":"2024-09-13T17:25:44.623859+0000","last_became_active":"2024-09-13T17:25:42.724445+0000","last_became_peered":"2024-09-13T17:25:42.724445+0000","last_unstale":"2024-09-13T17:25:44.623859+0000","last_undegraded":"2024-09-13T17:25:44.623859+0000","last_fullsized":"2024-09-13T17:25:44.623859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:35.522014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623461+0000","last_change":"2024-09-13T17:25:43.206406+0000","last_active":"2024-09-13T17:25:44.623461+0000","last_peered":"2024-09-13T17:25:44.623461+0000","last_clean":"2024-09-13T17:25:44.623461+0000","last_became_active":"2024-09-13T17:25:43.205903+0000","last_became_peered":"2024-09-13T17:25:43.205903+0000","last_unstale":"2024-09-13T17:25:44.623461+0000","last_undegraded":"2024-09-13T17:25:44.623461+0000","last_fullsized":"2024-09-13T17:25:44.623461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.112688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855876+0000","last_change":"2024-09-13T17:25:42.730763+0000","last_active":"2024-09-13T17:25:44.855876+0000","last_peered":"2024-09-13T17:25:44.855876+0000","last_clean":"2024-09-13T17:25:44.855876+0000","last_became_active":"2024-09-13T17:25:42.730533+0000","last_became_peered":"2024-09-13T17:25:42.730533+0000","last_unstale":"2024-09-13T17:25:44.855876+0000","last_undegraded":"2024-09-13T17:25:44.855876+0000","last_fullsized":"2024-09-13T17:25:44.855876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:59.271812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269523+0000","last_change":"2024-09-13T17:25:43.228575+0000","last_active":"2024-09-13T17:25:44.269523+0000","last_peered":"2024-09-13T17:25:44.269523+0000","last_clean":"2024-09-13T17:25:44.269523+0000","last_became_active":"2024-09-13T17:25:43.223459+0000","last_became_peered":"2024-09-13T17:25:43.223459+0000","last_unstale":"2024-09-13T17:25:44.269523+0000","last_undegraded":"2024-09-13T17:25:44.269523+0000","last_fullsized":"2024-09-13T17:25:44.269523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:10.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623264+0000","last_change":"2024-09-13T17:25:42.719792+0000","last_active":"2024-09-13T17:25:44.623264+0000","last_peered":"2024-09-13T17:25:44.623264+0000","last_clean":"2024-09-13T17:25:44.623264+0000","last_became_active":"2024-09-13T17:25:42.719540+0000","last_became_peered":"2024-09-13T17:25:42.719540+0000","last_unstale":"2024-09-13T17:25:44.623264+0000","last_undegraded":"2024-09-13T17:25:44.623264+0000","last_fullsized":"2024-09-13T17:25:44.623264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:20.967983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854564+0000","last_change":"2024-09-13T17:25:43.214381+0000","last_active":"2024-09-13T17:25:44.854564+0000","last_peered":"2024-09-13T17:25:44.854564+0000","last_clean":"2024-09-13T17:25:44.854564+0000","last_became_active":"2024-09-13T17:25:43.214139+0000","last_became_peered":"2024-09-13T17:25:43.214139+0000","last_unstale":"2024-09-13T17:25:44.854564+0000","last_undegraded":"2024-09-13T17:25:44.854564+0000","last_fullsized":"2024-09-13T17:25:44.854564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623269+0000","last_change":"2024-09-13T17:25:42.717939+0000","last_active":"2024-09-13T17:25:44.623269+0000","last_peered":"2024-09-13T17:25:44.623269+0000","last_clean":"2024-09-13T17:25:44.623269+0000","last_became_active":"2024-09-13T17:25:42.716696+0000","last_became_peered":"2024-09-13T17:25:42.716696+0000","last_unstale":"2024-09-13T17:25:44.623269+0000","last_undegraded":"2024-09-13T17:25:44.623269+0000","last_fullsized":"2024-09-13T17:25:44.623269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:20.951522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201420+0000","last_change":"2024-09-13T17:25:43.217821+0000","last_active":"2024-09-13T17:25:44.201420+0000","last_peered":"2024-09-13T17:25:44.201420+0000","last_clean":"2024-09-13T17:25:44.201420+0000","last_became_active":"2024-09-13T17:25:43.217570+0000","last_became_peered":"2024-09-13T17:25:43.217570+0000","last_unstale":"2024-09-13T17:25:44.201420+0000","last_undegraded":"2024-09-13T17:25:44.201420+0000","last_fullsized":"2024-09-13T17:25:44.201420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:34.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269658+0000","last_change":"2024-09-13T17:25:42.728663+0000","last_active":"2024-09-13T17:25:44.269658+0000","last_peered":"2024-09-13T17:25:44.269658+0000","last_clean":"2024-09-13T17:25:44.269658+0000","last_became_active":"2024-09-13T17:25:42.728413+0000","last_became_peered":"2024-09-13T17:25:42.728413+0000","last_unstale":"2024-09-13T17:25:44.269658+0000","last_undegraded":"2024-09-13T17:25:44.269658+0000","last_fullsized":"2024-09-13T17:25:44.269658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:31.028302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197059+0000","last_change":"2024-09-13T17:25:43.209045+0000","last_active":"2024-09-13T17:25:44.197059+0000","last_peered":"2024-09-13T17:25:44.197059+0000","last_clean":"2024-09-13T17:25:44.197059+0000","last_became_active":"2024-09-13T17:25:43.208727+0000","last_became_peered":"2024-09-13T17:25:43.208727+0000","last_unstale":"2024-09-13T17:25:44.197059+0000","last_undegraded":"2024-09-13T17:25:44.197059+0000","last_fullsized":"2024-09-13T17:25:44.197059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.981048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.623621+0000","last_change":"2024-09-13T17:25:42.719404+0000","last_active":"2024-09-13T17:25:44.623621+0000","last_peered":"2024-09-13T17:25:44.623621+0000","last_clean":"2024-09-13T17:25:44.623621+0000","last_became_active":"2024-09-13T17:25:42.719098+0000","last_became_peered":"2024-09-13T17:25:42.719098+0000","last_unstale":"2024-09-13T17:25:44.623621+0000","last_undegraded":"2024-09-13T17:25:44.623621+0000","last_fullsized":"2024-09-13T17:25:44.623621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:40.839095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855693+0000","last_change":"2024-09-13T17:25:43.213808+0000","last_active":"2024-09-13T17:25:44.855693+0000","last_peered":"2024-09-13T17:25:44.855693+0000","last_clean":"2024-09-13T17:25:44.855693+0000","last_became_active":"2024-09-13T17:25:43.213561+0000","last_became_peered":"2024-09-13T17:25:43.213561+0000","last_unstale":"2024-09-13T17:25:44.855693+0000","last_undegraded":"2024-09-13T17:25:44.855693+0000","last_fullsized":"2024-09-13T17:25:44.855693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:11.441102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.202108+0000","last_change":"2024-09-13T17:25:42.728226+0000","last_active":"2024-09-13T17:25:44.202108+0000","last_peered":"2024-09-13T17:25:44.202108+0000","last_clean":"2024-09-13T17:25:44.202108+0000","last_became_active":"2024-09-13T17:25:42.727883+0000","last_became_peered":"2024-09-13T17:25:42.727883+0000","last_unstale":"2024-09-13T17:25:44.202108+0000","last_undegraded":"2024-09-13T17:25:44.202108+0000","last_fullsized":"2024-09-13T17:25:44.202108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:57.821165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.270106+0000","last_change":"2024-09-13T17:25:43.223914+0000","last_active":"2024-09-13T17:25:44.270106+0000","last_peered":"2024-09-13T17:25:44.270106+0000","last_clean":"2024-09-13T17:25:44.270106+0000","last_became_active":"2024-09-13T17:25:43.223552+0000","last_became_peered":"2024-09-13T17:25:43.223552+0000","last_unstale":"2024-09-13T17:25:44.270106+0000","last_undegraded":"2024-09-13T17:25:44.270106+0000","last_fullsized":"2024-09-13T17:25:44.270106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:39.002609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.626614+0000","last_change":"2024-09-13T17:25:42.729209+0000","last_active":"2024-09-13T17:25:44.626614+0000","last_peered":"2024-09-13T17:25:44.626614+0000","last_clean":"2024-09-13T17:25:44.626614+0000","last_became_active":"2024-09-13T17:25:42.728901+0000","last_became_peered":"2024-09-13T17:25:42.728901+0000","last_unstale":"2024-09-13T17:25:44.626614+0000","last_undegraded":"2024-09-13T17:25:44.626614+0000","last_fullsized":"2024-09-13T17:25:44.626614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:56.460261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.197073+0000","last_change":"2024-09-13T17:25:43.200635+0000","last_active":"2024-09-13T17:25:44.197073+0000","last_peered":"2024-09-13T17:25:44.197073+0000","last_clean":"2024-09-13T17:25:44.197073+0000","last_became_active":"2024-09-13T17:25:43.200151+0000","last_became_peered":"2024-09-13T17:25:43.200151+0000","last_unstale":"2024-09-13T17:25:44.197073+0000","last_undegraded":"2024-09-13T17:25:44.197073+0000","last_fullsized":"2024-09-13T17:25:44.197073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:28.261169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854908+0000","last_change":"2024-09-13T17:25:42.722088+0000","last_active":"2024-09-13T17:25:44.854908+0000","last_peered":"2024-09-13T17:25:44.854908+0000","last_clean":"2024-09-13T17:25:44.854908+0000","last_became_active":"2024-09-13T17:25:42.721856+0000","last_became_peered":"2024-09-13T17:25:42.721856+0000","last_unstale":"2024-09-13T17:25:44.854908+0000","last_undegraded":"2024-09-13T17:25:44.854908+0000","last_fullsized":"2024-09-13T17:25:44.854908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:20.967983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854678+0000","last_change":"2024-09-13T17:25:43.216506+0000","last_active":"2024-09-13T17:25:44.854678+0000","last_peered":"2024-09-13T17:25:44.854678+0000","last_clean":"2024-09-13T17:25:44.854678+0000","last_became_active":"2024-09-13T17:25:43.216197+0000","last_became_peered":"2024-09-13T17:25:43.216197+0000","last_unstale":"2024-09-13T17:25:44.854678+0000","last_undegraded":"2024-09-13T17:25:44.854678+0000","last_fullsized":"2024-09-13T17:25:44.854678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.762069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.854964+0000","last_change":"2024-09-13T17:25:42.717481+0000","last_active":"2024-09-13T17:25:44.854964+0000","last_peered":"2024-09-13T17:25:44.854964+0000","last_clean":"2024-09-13T17:25:44.854964+0000","last_became_active":"2024-09-13T17:25:42.717124+0000","last_became_peered":"2024-09-13T17:25:42.717124+0000","last_unstale":"2024-09-13T17:25:44.854964+0000","last_undegraded":"2024-09-13T17:25:44.854964+0000","last_fullsized":"2024-09-13T17:25:44.854964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:36.806772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.855452+0000","last_change":"2024-09-13T17:25:43.212011+0000","last_active":"2024-09-13T17:25:44.855452+0000","last_peered":"2024-09-13T17:25:44.855452+0000","last_clean":"2024-09-13T17:25:44.855452+0000","last_became_active":"2024-09-13T17:25:43.211787+0000","last_became_peered":"2024-09-13T17:25:43.211787+0000","last_unstale":"2024-09-13T17:25:44.855452+0000","last_undegraded":"2024-09-13T17:25:44.855452+0000","last_fullsized":"2024-09-13T17:25:44.855452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.739546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.599735+0000","last_change":"2024-09-13T17:25:42.720190+0000","last_active":"2024-09-13T17:25:44.599735+0000","last_peered":"2024-09-13T17:25:44.599735+0000","last_clean":"2024-09-13T17:25:44.599735+0000","last_became_active":"2024-09-13T17:25:42.719797+0000","last_became_peered":"2024-09-13T17:25:42.719797+0000","last_unstale":"2024-09-13T17:25:44.599735+0000","last_undegraded":"2024-09-13T17:25:44.599735+0000","last_fullsized":"2024-09-13T17:25:44.599735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:18.925462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200152+0000","last_change":"2024-09-13T17:25:43.202302+0000","last_active":"2024-09-13T17:25:44.200152+0000","last_peered":"2024-09-13T17:25:44.200152+0000","last_clean":"2024-09-13T17:25:44.200152+0000","last_became_active":"2024-09-13T17:25:43.202078+0000","last_became_peered":"2024-09-13T17:25:43.202078+0000","last_unstale":"2024-09-13T17:25:44.200152+0000","last_undegraded":"2024-09-13T17:25:44.200152+0000","last_fullsized":"2024-09-13T17:25:44.200152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:29.094941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.200035+0000","last_change":"2024-09-13T17:25:42.729431+0000","last_active":"2024-09-13T17:25:44.200035+0000","last_peered":"2024-09-13T17:25:44.200035+0000","last_clean":"2024-09-13T17:25:44.200035+0000","last_became_active":"2024-09-13T17:25:42.729155+0000","last_became_peered":"2024-09-13T17:25:42.729155+0000","last_unstale":"2024-09-13T17:25:44.200035+0000","last_undegraded":"2024-09-13T17:25:44.200035+0000","last_fullsized":"2024-09-13T17:25:44.200035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:08.577806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269810+0000","last_change":"2024-09-13T17:25:43.228249+0000","last_active":"2024-09-13T17:25:44.269810+0000","last_peered":"2024-09-13T17:25:44.269810+0000","last_clean":"2024-09-13T17:25:44.269810+0000","last_became_active":"2024-09-13T17:25:43.227949+0000","last_became_peered":"2024-09-13T17:25:43.227949+0000","last_unstale":"2024-09-13T17:25:44.269810+0000","last_undegraded":"2024-09-13T17:25:44.269810+0000","last_fullsized":"2024-09-13T17:25:44.269810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:15.332365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.196548+0000","last_change":"2024-09-13T17:25:42.726115+0000","last_active":"2024-09-13T17:25:44.196548+0000","last_peered":"2024-09-13T17:25:44.196548+0000","last_clean":"2024-09-13T17:25:44.196548+0000","last_became_active":"2024-09-13T17:25:42.725823+0000","last_became_peered":"2024-09-13T17:25:42.725823+0000","last_unstale":"2024-09-13T17:25:44.196548+0000","last_undegraded":"2024-09-13T17:25:44.196548+0000","last_fullsized":"2024-09-13T17:25:44.196548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:37.987070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.201975+0000","last_change":"2024-09-13T17:25:43.212003+0000","last_active":"2024-09-13T17:25:44.201975+0000","last_peered":"2024-09-13T17:25:44.201975+0000","last_clean":"2024-09-13T17:25:44.201975+0000","last_became_active":"2024-09-13T17:25:43.211758+0000","last_became_peered":"2024-09-13T17:25:43.211758+0000","last_unstale":"2024-09-13T17:25:44.201975+0000","last_undegraded":"2024-09-13T17:25:44.201975+0000","last_fullsized":"2024-09-13T17:25:44.201975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:42.688426+0000","last_clean_scrub_stamp":"2024-09-13T17:25:42.688426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:22.042357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:25:44.269947+0000","last_change":"2024-09-13T17:25:42.729425+0000","last_active":"2024-09-13T17:25:44.269947+0000","last_peered":"2024-09-13T17:25:44.269947+0000","last_clean":"2024-09-13T17:25:44.269947+0000","last_became_active":"2024-09-13T17:25:42.729109+0000","last_became_peered":"2024-09-13T17:25:42.729109+0000","last_unstale":"2024-09-13T17:25:44.269947+0000","last_undegraded":"2024-09-13T17:25:44.269947+0000","last_fullsized":"2024-09-13T17:25:44.269947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:25:41.672887+0000","last_clean_scrub_stamp":"2024-09-13T17:25:41.672887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:09.971351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:25:43.199920+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:25:43.199920+0000","last_peered":"2024-09-13T17:25:43.199920+0000","last_clean":"2024-09-13T17:25:43.199920+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:25:43.199920+0000","last_undegraded":"2024-09-13T17:25:43.199920+0000","last_fullsized":"2024-09-13T17:25:43.199920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":790780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.624},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.079}]},{"osd":2,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.2130000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.256},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.167}]},{"osd":4,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.631}]},{"osd":5,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.3799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.468},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.4299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":199360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.524},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":1.49}]},{"osd":1,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.786},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.5509999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.355}]},{"osd":3,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.0900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.716}]},{"osd":5,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.659},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.5129999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":198890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.367},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.306}]},{"osd":1,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.119},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.244}]},{"osd":3,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.2110000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.2709999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.401}]},{"osd":7,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.5389999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":199382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.997},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1240000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.2410000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.349},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.333}]},{"osd":3,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.538},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.48}]},{"osd":5,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.4419999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.208},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.4019999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":479232,"data_stored":200376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.234},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.1180000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.163}]},{"osd":6,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.999}]},{"osd":7,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1890000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":198848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.1220000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.075},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.014}]},{"osd":3,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.248}]},{"osd":4,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.7530000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.077,"5min":3.077,"15min":3.077},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.4259999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.504},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.3280000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.4870000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":192248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.028},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.244}]},{"osd":6,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.214},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":3.452,"5min":3.452,"15min":3.452},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.2749999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.006},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.4730000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.181}]},{"osd":4,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.52},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.165}]},{"osd":5,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.345},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.369}]},{"osd":6,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3200000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:25:06 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:25:47.996 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:25:47.996 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:25:48.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.214+0000 7f1125e00700 1 Processor -- start 2024-09-13T17:25:48.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.214+0000 7f1125e00700 1 -- start start 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f11200cfaa0 0x7f11200d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f11200b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11200d0230 con 0x7f112006bd30 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11200d0510 con 0x7f11200cfaa0 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11200d07f0 con 0x7f11200d1810 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111ea00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f112006bd30 0x7f112006d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45444/0 (socket says 172.21.15.139:45444) 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111ea00700 1 -- 172.21.15.139:0/2459663641 learned_addr learned my addr 172.21.15.139:0/2459663641 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111e000700 1 --2- 172.21.15.139:0/2459663641 >> v2:172.21.15.176:3300/0 conn(0x7f11200cfaa0 0x7f11200d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111f400700 1 --2- 172.21.15.139:0/2459663641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f11200b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111f400700 1 -- 172.21.15.139:0/2459663641 >> v2:172.21.15.176:3300/0 conn(0x7f11200cfaa0 msgr2=0x7f11200d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111f400700 1 --2- 172.21.15.139:0/2459663641 >> v2:172.21.15.176:3300/0 conn(0x7f11200cfaa0 0x7f11200d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111d600700 1 -- 172.21.15.139:0/2459663641 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708428702 0 0) 0x7f11200d0230 con 0x7f112006bd30 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111f400700 1 -- 172.21.15.139:0/2459663641 >> v1:172.21.15.139:6789/0 conn(0x7f112006bd30 legacy=0x7f112006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111f400700 1 -- 172.21.15.139:0/2459663641 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200d0ad0 con 0x7f11200d1810 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111f400700 1 --2- 172.21.15.139:0/2459663641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f11200b3d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1118009d90 tx=0x7f111800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b69e6cef5b8cd43e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111d600700 1 -- 172.21.15.139:0/2459663641 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111800e070 con 0x7f11200d1810 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111d600700 1 -- 172.21.15.139:0/2459663641 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111800bb20 con 0x7f11200d1810 2024-09-13T17:25:48.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f111d600700 1 -- 172.21.15.139:0/2459663641 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118012430 con 0x7f11200d1810 2024-09-13T17:25:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 -- 172.21.15.139:0/2459663641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 msgr2=0x7f11200b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 --2- 172.21.15.139:0/2459663641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f11200b3d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1118009d90 tx=0x7f111800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 -- 172.21.15.139:0/2459663641 shutdown_connections 2024-09-13T17:25:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 --2- 172.21.15.139:0/2459663641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f11200b3d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 --2- 172.21.15.139:0/2459663641 >> v2:172.21.15.176:3300/0 conn(0x7f11200cfaa0 0x7f11200d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.218+0000 7f1125e00700 1 -- 172.21.15.139:0/2459663641 >> 172.21.15.139:0/2459663641 conn(0x7f112006a390 msgr2=0x7f112006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:48.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 -- 172.21.15.139:0/2459663641 shutdown_connections 2024-09-13T17:25:48.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 -- 172.21.15.139:0/2459663641 wait complete. 2024-09-13T17:25:48.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 Processor -- start 2024-09-13T17:25:48.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 -- start start 2024-09-13T17:25:48.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 0x7f1120144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11200cfaa0 0x7f112015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f112014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112015ed90 con 0x7f112006bd30 2024-09-13T17:25:48.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112015dcf0 con 0x7f11200cfaa0 2024-09-13T17:25:48.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.222+0000 7f1125e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112015dfd0 con 0x7f11200d1810 2024-09-13T17:25:48.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 0x7f1120144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 0x7f1120144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56170/0 (socket says 172.21.15.139:56170) 2024-09-13T17:25:48.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 -- 172.21.15.139:0/3039938354 learned_addr learned my addr 172.21.15.139:0/3039938354 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:48.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111e000700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11200cfaa0 0x7f112015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111f400700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f112014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 -- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 msgr2=0x7f112014fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f112014fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 -- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11200cfaa0 msgr2=0x7f112015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11200cfaa0 0x7f112015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 -- 172.21.15.139:0/3039938354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118009a70 con 0x7f112006bd30 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f111ea00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 0x7f1120144a00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f111000c580 tx=0x7f111000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110004ca0 con 0x7f112006bd30 2024-09-13T17:25:48.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110004e20 con 0x7f112006bd30 2024-09-13T17:25:48.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110007310 con 0x7f112006bd30 2024-09-13T17:25:48.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112015e2b0 con 0x7f112006bd30 2024-09-13T17:25:48.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112015e870 con 0x7f112006bd30 2024-09-13T17:25:48.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.226+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11200d12d0 con 0x7f112006bd30 2024-09-13T17:25:48.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.230+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1110007470 con 0x7f112006bd30 2024-09-13T17:25:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.230+0000 7f1117400700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1100066730 0x7f1100068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.230+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1110083e40 con 0x7f112006bd30 2024-09-13T17:25:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.230+0000 7f111e000700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1100066730 0x7f1100068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.230+0000 7f111e000700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1100066730 0x7f1100068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11201539f0 tx=0x7f110c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:48.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.238+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1110051100 con 0x7f112006bd30 2024-09-13T17:25:48.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.486+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f112006aa50 con 0x7f112006bd30 2024-09-13T17:25:48.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.494+0000 7f1117400700 1 -- 172.21.15.139:0/3039938354 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1110007720 con 0x7f112006bd30 2024-09-13T17:25:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1100066730 msgr2=0x7f1100068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1100066730 0x7f1100068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11201539f0 tx=0x7f110c009240 comp rx=0 tx=0).stop 2024-09-13T17:25:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 msgr2=0x7f1120144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 0x7f1120144a00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f111000c580 tx=0x7f111000c890 comp rx=0 tx=0).stop 2024-09-13T17:25:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 shutdown_connections 2024-09-13T17:25:48.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f1100066730 0x7f1100068bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11200d1810 0x7f112014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11200cfaa0 0x7f112015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 --2- 172.21.15.139:0/3039938354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f112006bd30 0x7f1120144a00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 >> 172.21.15.139:0/3039938354 conn(0x7f112006a390 msgr2=0x7f112006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 shutdown_connections 2024-09-13T17:25:48.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.498+0000 7f1125e00700 1 -- 172.21.15.139:0/3039938354 wait complete. 2024-09-13T17:25:48.505 INFO:teuthology.orchestra.run.smithi139.stderr:updated caps for client.0 2024-09-13T17:25:48.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:25:48.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.694+0000 7f1172a00700 1 Processor -- start 2024-09-13T17:25:48.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.694+0000 7f1172a00700 1 -- start start 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1172a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f116c156e00 0x7f116c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1172a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116c159da0 con 0x7f116c1595c0 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1172a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116c15a080 con 0x7f116c06b3a0 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1172a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116c15a360 con 0x7f116c156e00 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1170c00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f116c1595c0 0x7f116c0ccee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45456/0 (socket says 172.21.15.139:45456) 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1171600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f116c156e00 0x7f116c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.698+0000 7f1170c00700 1 -- 172.21.15.139:0/3566232520 learned_addr learned my addr 172.21.15.139:0/3566232520 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:48.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1171600700 1 -- 172.21.15.139:0/3566232520 >> v1:172.21.15.176:6789/0 conn(0x7f116c06b3a0 legacy=0x7f116c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1171600700 1 -- 172.21.15.139:0/3566232520 >> v1:172.21.15.139:6789/0 conn(0x7f116c1595c0 legacy=0x7f116c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1171600700 1 -- 172.21.15.139:0/3566232520 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c06c350 con 0x7f116c156e00 2024-09-13T17:25:48.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f116be00700 1 -- 172.21.15.139:0/3566232520 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907254129 0 0) 0x7f116c159da0 con 0x7f116c1595c0 2024-09-13T17:25:48.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1171600700 1 --2- 172.21.15.139:0/3566232520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c156e00 0x7f116c070ff0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1160009850 tx=0x7f1160009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c26480f1a180bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:48.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f116be00700 1 -- 172.21.15.139:0/3566232520 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000f8a0 con 0x7f116c156e00 2024-09-13T17:25:48.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f116be00700 1 -- 172.21.15.139:0/3566232520 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000fa00 con 0x7f116c156e00 2024-09-13T17:25:48.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f116be00700 1 -- 172.21.15.139:0/3566232520 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000fd90 con 0x7f116c156e00 2024-09-13T17:25:48.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 -- 172.21.15.139:0/3566232520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c156e00 msgr2=0x7f116c070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 --2- 172.21.15.139:0/3566232520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c156e00 0x7f116c070ff0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1160009850 tx=0x7f1160009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:48.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 -- 172.21.15.139:0/3566232520 shutdown_connections 2024-09-13T17:25:48.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 --2- 172.21.15.139:0/3566232520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c156e00 0x7f116c070ff0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 -- 172.21.15.139:0/3566232520 >> 172.21.15.139:0/3566232520 conn(0x7f116c06ed30 msgr2=0x7f116c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:48.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 -- 172.21.15.139:0/3566232520 shutdown_connections 2024-09-13T17:25:48.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.702+0000 7f1172a00700 1 -- 172.21.15.139:0/3566232520 wait complete. 2024-09-13T17:25:48.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.706+0000 7f1172a00700 1 Processor -- start 2024-09-13T17:25:48.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.706+0000 7f1172a00700 1 -- start start 2024-09-13T17:25:48.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c06b3a0 0x7f116c1f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c156e00 0x7f116c15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c1595c0 0x7f116c151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c15c930 con 0x7f116c1595c0 2024-09-13T17:25:48.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c15c650 con 0x7f116c156e00 2024-09-13T17:25:48.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c15a740 con 0x7f116c06b3a0 2024-09-13T17:25:48.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c1595c0 0x7f116c151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1171600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c06b3a0 0x7f116c1f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1170c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c156e00 0x7f116c15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1171600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c06b3a0 0x7f116c1f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:48526/0 (socket says 172.21.15.139:48526) 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1171600700 1 -- 172.21.15.139:0/16681713 learned_addr learned my addr 172.21.15.139:0/16681713 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 -- 172.21.15.139:0/16681713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c06b3a0 msgr2=0x7f116c1f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c06b3a0 0x7f116c1f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 -- 172.21.15.139:0/16681713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c156e00 msgr2=0x7f116c15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c156e00 0x7f116c15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 -- 172.21.15.139:0/16681713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600094b0 con 0x7f116c1595c0 2024-09-13T17:25:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172000700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c1595c0 0x7f116c151830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f116400cb90 tx=0x7f116400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164003c20 con 0x7f116c1595c0 2024-09-13T17:25:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c15aa20 con 0x7f116c1595c0 2024-09-13T17:25:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164003d80 con 0x7f116c1595c0 2024-09-13T17:25:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400aa80 con 0x7f116c1595c0 2024-09-13T17:25:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.710+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c1f7970 con 0x7f116c1595c0 2024-09-13T17:25:48.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.714+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116c15a5a0 con 0x7f116c1595c0 2024-09-13T17:25:48.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.714+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f116400abe0 con 0x7f116c1595c0 2024-09-13T17:25:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.714+0000 7f1169600700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f114c066730 0x7f114c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.714+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1164084230 con 0x7f116c1595c0 2024-09-13T17:25:48.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.714+0000 7f1171600700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f114c066730 0x7f114c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:48.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.718+0000 7f1171600700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f114c066730 0x7f114c068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1160009fd0 tx=0x7f1160008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:48.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.722+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f116c15a5a0 con 0x7f116c1595c0 2024-09-13T17:25:48.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.954+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f116c15af40 con 0x7f116c1595c0 2024-09-13T17:25:48.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1169600700 1 -- 172.21.15.139:0/16681713 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f116c15af40 con 0x7f116c1595c0 2024-09-13T17:25:48.961 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:48.962 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:25:43.178317+0000","modified":"2024-09-13T17:25:46.195947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6833/501919372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":501919372},{"type":"v1","addr":"172.21.15.176:6833","nonce":501919372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:25:48.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f114c066730 msgr2=0x7f114c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f114c066730 0x7f114c068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1160009fd0 tx=0x7f1160008030 comp rx=0 tx=0).stop 2024-09-13T17:25:48.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c1595c0 msgr2=0x7f116c151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:48.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c1595c0 0x7f116c151830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f116400cb90 tx=0x7f116400cea0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 shutdown_connections 2024-09-13T17:25:48.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f114c066730 0x7f114c068bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f116c1595c0 0x7f116c151830 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c156e00 0x7f116c15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.958+0000 7f1172a00700 1 --2- 172.21.15.139:0/16681713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c06b3a0 0x7f116c1f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:48.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.962+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 >> 172.21.15.139:0/16681713 conn(0x7f116c06ed30 msgr2=0x7f116c158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:48.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.962+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 shutdown_connections 2024-09-13T17:25:48.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:48.962+0000 7f1172a00700 1 -- 172.21.15.139:0/16681713 wait complete. 2024-09-13T17:25:48.967 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2024-09-13T17:25:49.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:25:43.178317+0000', 'modified': '2024-09-13T17:25:46.195947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5298': {'gid': 5298, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.176:6833/501919372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 501919372}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 501919372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:25:49.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:25:49.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:25:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 Processor -- start 2024-09-13T17:25:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 -- start start 2024-09-13T17:25:49.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f45f0144300 0x7f45f006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f00cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f45f006db60 0x7f45f00cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f0070140 con 0x7f45f006db60 2024-09-13T17:25:49.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f0070420 con 0x7f45f0144300 2024-09-13T17:25:49.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.554+0000 7f45f6e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0070700 con 0x7f45f015aff0 2024-09-13T17:25:49.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f00cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f45f0144300 0x7f45f006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f45f006db60 0x7f45f00cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f45f0144300 0x7f45f006d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:45866/0 (socket says 172.21.15.139:45866) 2024-09-13T17:25:49.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 -- 172.21.15.139:0/1112242802 learned_addr learned my addr 172.21.15.139:0/1112242802 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f00cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:48538/0 (socket says 172.21.15.139:48538) 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 -- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 msgr2=0x7f45f00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 --2- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f00cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 -- 172.21.15.139:0/1112242802 >> v2:172.21.15.139:3300/0 conn(0x7f45f006db60 msgr2=0x7f45f00cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 --2- 172.21.15.139:0/1112242802 >> v2:172.21.15.139:3300/0 conn(0x7f45f006db60 0x7f45f00cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 -- 172.21.15.139:0/1112242802 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00709e0 con 0x7f45f0144300 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5000700 1 --2- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f00cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:49.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f5a00700 1 --2- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f006d620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f45f006fa70 tx=0x7f45e4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d432eba3655031ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45efe00700 1 -- 172.21.15.139:0/1112242802 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4011830 con 0x7f45f0144300 2024-09-13T17:25:49.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45efe00700 1 -- 172.21.15.139:0/1112242802 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4011990 con 0x7f45f0144300 2024-09-13T17:25:49.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45efe00700 1 -- 172.21.15.139:0/1112242802 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4011d20 con 0x7f45f0144300 2024-09-13T17:25:49.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 -- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 msgr2=0x7f45f006d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 --2- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f006d620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f45f006fa70 tx=0x7f45e4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 -- 172.21.15.139:0/1112242802 shutdown_connections 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 --2- 172.21.15.139:0/1112242802 >> v2:172.21.15.139:3300/0 conn(0x7f45f006db60 0x7f45f00cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 --2- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f00cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 --2- 172.21.15.139:0/1112242802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f006d620 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 -- 172.21.15.139:0/1112242802 >> 172.21.15.139:0/1112242802 conn(0x7f45f00ce9d0 msgr2=0x7f45f00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 -- 172.21.15.139:0/1112242802 shutdown_connections 2024-09-13T17:25:49.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.558+0000 7f45f6e00700 1 -- 172.21.15.139:0/1112242802 wait complete. 2024-09-13T17:25:49.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.562+0000 7f45f6e00700 1 Processor -- start 2024-09-13T17:25:49.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.562+0000 7f45f6e00700 1 -- start start 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 0x7f45f00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f00c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f01f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00ccb60 con 0x7f45f006db60 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00aa4a0 con 0x7f45f0144300 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00aa780 con 0x7f45f015aff0 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 0x7f45f00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 0x7f45f00cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56216/0 (socket says 172.21.15.139:56216) 2024-09-13T17:25:49.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 -- 172.21.15.139:0/3167708668 learned_addr learned my addr 172.21.15.139:0/3167708668 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6400700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f01f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5000700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f00c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 -- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 msgr2=0x7f45f01f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f01f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 -- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 msgr2=0x7f45f00c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f00c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 -- 172.21.15.139:0/3167708668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0094b0 con 0x7f45f006db60 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f5a00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 0x7f45f00cc620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f45e4000c00 tx=0x7f45e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45ed600700 1 -- 172.21.15.139:0/3167708668 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4004450 con 0x7f45f006db60 2024-09-13T17:25:49.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45ed600700 1 -- 172.21.15.139:0/3167708668 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40045b0 con 0x7f45f006db60 2024-09-13T17:25:49.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e4009570 con 0x7f45f006db60 2024-09-13T17:25:49.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45ed600700 1 -- 172.21.15.139:0/3167708668 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40038e0 con 0x7f45f006db60 2024-09-13T17:25:49.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.566+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f00aad40 con 0x7f45f006db60 2024-09-13T17:25:49.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.570+0000 7f45ed600700 1 -- 172.21.15.139:0/3167708668 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45e4021070 con 0x7f45f006db60 2024-09-13T17:25:49.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.570+0000 7f45ed600700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f45d0066730 0x7f45d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.570+0000 7f45ed600700 1 -- 172.21.15.139:0/3167708668 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45e40856a0 con 0x7f45f006db60 2024-09-13T17:25:49.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.570+0000 7f45f5000700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f45d0066730 0x7f45d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.570+0000 7f45f5000700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f45d0066730 0x7f45d0068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ab190 tx=0x7f45dc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.574+0000 7f45fb7ac740 1 Processor -- start 2024-09-13T17:25:49.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.574+0000 7f45fb7ac740 1 -- start start 2024-09-13T17:25:49.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.574+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.574+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15113890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 0x15113dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x15072d80 con 0x1514b6c0 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x15070510 con 0x15129d00 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1506be00 con 0x1514ada0 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 0x15113dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 0x15113dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56230/0 (socket says 172.21.15.139:56230) 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 -- 172.21.15.139:0/4081506818 learned_addr learned my addr 172.21.15.139:0/4081506818 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f5a00700 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f5000700 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 -- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 msgr2=0x1514b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 -- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 msgr2=0x15113890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15113890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 -- 172.21.15.139:0/4081506818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14ede960 con 0x1514b6c0 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f5a00700 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45f6400700 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 0x15113dd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f45e80112b0 tx=0x7f45e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecfff8b37e5569e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45e2000700 1 -- 172.21.15.139:0/4081506818 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8010040 con 0x1514b6c0 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45e2000700 1 -- 172.21.15.139:0/4081506818 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8016450 con 0x1514b6c0 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45e2000700 1 -- 172.21.15.139:0/4081506818 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80167c0 con 0x1514b6c0 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- 172.21.15.139:0/4081506818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 msgr2=0x15113dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 0x15113dd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f45e80112b0 tx=0x7f45e800b040 comp rx=0 tx=0).stop 2024-09-13T17:25:49.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- 172.21.15.139:0/4081506818 shutdown_connections 2024-09-13T17:25:49.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514b6c0 0x15113dd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15113890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/4081506818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- 172.21.15.139:0/4081506818 >> 172.21.15.139:0/4081506818 conn(0x14e934d0 msgr2=0x1512cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- 172.21.15.139:0/4081506818 shutdown_connections 2024-09-13T17:25:49.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.578+0000 7f45fb7ac740 1 -- 172.21.15.139:0/4081506818 wait complete. 2024-09-13T17:25:49.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 -- start start 2024-09-13T17:25:49.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 Processor -- start 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15103390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1514bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x15029730 con 0x15129d00 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1502f5b0 con 0x1514b6c0 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x14f17aa0 con 0x1514ada0 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 10 client.0 _ll_register_callbacks cb 0x15065610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15103390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15103390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56236/0 (socket says 172.21.15.139:56236) 2024-09-13T17:25:49.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 -- 172.21.15.139:0/1980055120 learned_addr learned my addr 172.21.15.139:0/1980055120 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5000700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f6400700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1514bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 -- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 msgr2=0x1514baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 -- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 msgr2=0x1514bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1514bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 -- 172.21.15.139:0/1980055120 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e8009dd0 con 0x15129d00 2024-09-13T17:25:49.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45f5a00700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15103390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f45e405e440 tx=0x7f45e4055f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc83ebf59fe437bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45d6a00700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45d6a00700 1 -- 172.21.15.139:0/1980055120 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4056580 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45d6a00700 1 -- 172.21.15.139:0/1980055120 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45e405a3b0 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14ea01e0 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.582+0000 7f45d6a00700 1 -- 172.21.15.139:0/1980055120 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e405e970 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 10 client.5463 fetch_fsmap learned FSMap version 16 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x15032220 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45d6a00700 1 -- 172.21.15.139:0/1980055120 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14ea01e0 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45d6a00700 1 -- 172.21.15.139:0/1980055120 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f45e4071020 con 0x15129d00 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 10 client.5463 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 10 client.5463 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 20 client.5463 populate_metadata read hostname 'smithi139' 2024-09-13T17:25:49.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151011e0 0x151015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 4 client.5463 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:25:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 --> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14eea460 con 0x151011e0 2024-09-13T17:25:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45f5000700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151011e0 0x151015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45f5000700 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151011e0 0x151015c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1eeb7c69749b36 server_cookie=17e2325ca7288009 in_seq=0 out_seq=0 2024-09-13T17:25:49.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.586+0000 7f45d6a00700 10 client.5463 ms_handle_connect on v2:172.21.15.176:6832/501919372 2024-09-13T17:25:49.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45d6a00700 1 -- 172.21.15.139:0/1980055120 <== mds.0 v2:172.21.15.176:6832/501919372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x14eea460 con 0x151011e0 2024-09-13T17:25:49.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45d6a00700 10 client.5463 handle_command_reply: tid=0 2024-09-13T17:25:49.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 client.5463 shutdown 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 msgr2=0x15103390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15103390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f45e405e440 tx=0x7f45e4055f60 comp rx=0 tx=0).stop 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 shutdown_connections 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1514bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1514baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151011e0 0x151015c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/1980055120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15103390 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 >> 172.21.15.139:0/1980055120 conn(0x14e934d0 msgr2=0x15126860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45d6a00700 0 client.5463 ms_handle_reset on v2:172.21.15.176:6832/501919372 2024-09-13T17:25:49.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 shutdown_connections 2024-09-13T17:25:49.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 1 -- 172.21.15.139:0/1980055120 wait complete. 2024-09-13T17:25:49.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.590+0000 7f45fb7ac740 20 client.5463 trim_cache size 0 max 16384 2024-09-13T17:25:49.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 Processor -- start 2024-09-13T17:25:49.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 -- start start 2024-09-13T17:25:49.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15164090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1515eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1515f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x1502f5b0 con 0x15129d00 2024-09-13T17:25:49.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x15028700 con 0x1514b6c0 2024-09-13T17:25:49.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.610+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x15029730 con 0x1514ada0 2024-09-13T17:25:49.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1515eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15164090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56250/0 (socket says 172.21.15.139:56250) 2024-09-13T17:25:49.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5a00700 1 -- 172.21.15.139:0/3387538102 learned_addr learned my addr 172.21.15.139:0/3387538102 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f6400700 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1515f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 -- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 msgr2=0x1515f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1515f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 -- 172.21.15.139:0/3387538102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 msgr2=0x15164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 -- 172.21.15.139:0/3387538102 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15018450 con 0x1514ada0 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45f5000700 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1515eef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x15102a00 tx=0x7f45dc018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38bce7bf9132b95a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45e2a00700 1 -- 172.21.15.139:0/3387538102 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0043a0 con 0x1514ada0 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45e2a00700 1 -- 172.21.15.139:0/3387538102 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc004500 con 0x1514ada0 2024-09-13T17:25:49.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45e2a00700 1 -- 172.21.15.139:0/3387538102 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0293e0 con 0x1514ada0 2024-09-13T17:25:49.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 -- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 msgr2=0x1515eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1515eef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x15102a00 tx=0x7f45dc018000 comp rx=0 tx=0).stop 2024-09-13T17:25:49.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 -- 172.21.15.139:0/3387538102 shutdown_connections 2024-09-13T17:25:49.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1514b6c0 0x1515f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514ada0 0x1515eef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/3387538102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x15129d00 0x15164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 -- 172.21.15.139:0/3387538102 >> 172.21.15.139:0/3387538102 conn(0x14e934d0 msgr2=0x150ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 -- 172.21.15.139:0/3387538102 shutdown_connections 2024-09-13T17:25:49.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 -- 172.21.15.139:0/3387538102 wait complete. 2024-09-13T17:25:49.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.614+0000 7f45fb7ac740 1 -- start start 2024-09-13T17:25:49.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 Processor -- start 2024-09-13T17:25:49.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15164350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 0x151ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514b6c0 0x151ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x151053e0 con 0x1514ada0 2024-09-13T17:25:49.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x151694d0 con 0x15129d00 2024-09-13T17:25:49.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x15163b60 con 0x1514b6c0 2024-09-13T17:25:49.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45fb7ac740 10 client.0 _ll_register_callbacks cb 0x150c2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:25:49.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 0x151ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 0x151ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56254/0 (socket says 172.21.15.139:56254) 2024-09-13T17:25:49.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 -- 172.21.15.139:0/2661794296 learned_addr learned my addr 172.21.15.139:0/2661794296 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f6400700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514b6c0 0x151ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5a00700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 -- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514b6c0 msgr2=0x151ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514b6c0 0x151ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 -- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 msgr2=0x15164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 -- 172.21.15.139:0/2661794296 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc011b10 con 0x1514ada0 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45f5000700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 0x151ac240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x151055d0 tx=0x7f45dc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4b0a49b3f64d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45d6a00700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T17:25:49.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.618+0000 7f45d6a00700 1 -- 172.21.15.139:0/2661794296 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0043a0 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45e8016450 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 1 -- 172.21.15.139:0/2661794296 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45dc01c040 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 1 -- 172.21.15.139:0/2661794296 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45dc0293e0 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 10 client.5469 fetch_fsmap learned FSMap version 16 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x1500c720 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 1 -- 172.21.15.139:0/2661794296 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8016450 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 1 -- 172.21.15.139:0/2661794296 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f45dc029540 con 0x1514ada0 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 10 client.5469 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 10 client.5469 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 20 client.5469 populate_metadata read hostname 'smithi139' 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151add90 0x15161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 4 client.5469 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:25:49.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 --> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14f0f1e0 con 0x151add90 2024-09-13T17:25:49.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45f5a00700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151add90 0x15161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 10 client.5469 ms_handle_connect on v2:172.21.15.176:6832/501919372 2024-09-13T17:25:49.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45f5a00700 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151add90 0x15161ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f8e708f22c77102 server_cookie=db75eea549391df1 in_seq=0 out_seq=0 2024-09-13T17:25:49.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 1 -- 172.21.15.139:0/2661794296 <== mds.0 v2:172.21.15.176:6832/501919372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x14f0f1e0 con 0x151add90 2024-09-13T17:25:49.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45d6a00700 10 client.5469 handle_command_reply: tid=0 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 client.5469 shutdown 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 msgr2=0x151ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 0x151ac240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x151055d0 tx=0x7f45dc0047e0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 shutdown_connections 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1514b6c0 0x151ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:6832/501919372,v1:172.21.15.176:6833/501919372] conn(0x151add90 0x15161ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x1514ada0 0x151ac240 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.622+0000 7f45fb7ac740 1 --2- 172.21.15.139:0/2661794296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15129d00 0x15164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45d6a00700 0 client.5469 ms_handle_reset on v2:172.21.15.176:6832/501919372 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 >> 172.21.15.139:0/2661794296 conn(0x14e934d0 msgr2=0x150fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 shutdown_connections 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45fb7ac740 1 -- 172.21.15.139:0/2661794296 wait complete. 2024-09-13T17:25:49.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45fb7ac740 20 client.5469 trim_cache size 0 max 16384 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "a6cff629-1d3c-470e-abc7-14e2fbc4e0ad", 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 5298, 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 6.4429366210000003, 2024-09-13T17:25:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 16, 2024-09-13T17:25:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 40, 2024-09-13T17:25:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 40, 2024-09-13T17:25:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 15.013692548 2024-09-13T17:25:49.632 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f45d0066730 msgr2=0x7f45d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f45d0066730 0x7f45d0068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ab190 tx=0x7f45dc009240 comp rx=0 tx=0).stop 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 msgr2=0x7f45f00cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 0x7f45f00cc620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f45e4000c00 tx=0x7f45e4004770 comp rx=0 tx=0).stop 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 shutdown_connections 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f45d0066730 0x7f45d0068bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015aff0 0x7f45f01f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f0144300 0x7f45f00c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 --2- 172.21.15.139:0/3167708668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f006db60 0x7f45f00cc620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 >> 172.21.15.139:0/3167708668 conn(0x7f45f00ce9d0 msgr2=0x7f45f0141f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 shutdown_connections 2024-09-13T17:25:49.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.626+0000 7f45f6e00700 1 -- 172.21.15.139:0/3167708668 wait complete. 2024-09-13T17:25:49.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:25:49.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.814+0000 7f5b42a00700 1 Processor -- start 2024-09-13T17:25:49.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.814+0000 7f5b42a00700 1 -- start start 2024-09-13T17:25:49.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5b3c14a6d0 0x7f5b3c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c0cd450 0x7f5b3c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c071ff0 con 0x7f5b3c0b2b70 2024-09-13T17:25:49.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c0cd890 con 0x7f5b3c14a6d0 2024-09-13T17:25:49.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c14aab0 con 0x7f5b3c0cd450 2024-09-13T17:25:49.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f5b3c0b2b70 0x7f5b3c06fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45466/0 (socket says 172.21.15.139:45466) 2024-09-13T17:25:49.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b42000700 1 -- 172.21.15.139:0/3776418565 learned_addr learned my addr 172.21.15.139:0/3776418565 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:49.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b41600700 1 --2- 172.21.15.139:0/3776418565 >> v2:172.21.15.139:3300/0 conn(0x7f5b3c14a6d0 0x7f5b3c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b40c00700 1 --2- 172.21.15.139:0/3776418565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c0cd450 0x7f5b3c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b3be00700 1 -- 172.21.15.139:0/3776418565 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680651086 0 0) 0x7f5b34001490 con 0x7f5b3c0b2b70 2024-09-13T17:25:49.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b3be00700 1 -- 172.21.15.139:0/3776418565 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b240035d0 con 0x7f5b3c0b2b70 2024-09-13T17:25:49.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b40c00700 1 -- 172.21.15.139:0/3776418565 >> v2:172.21.15.139:3300/0 conn(0x7f5b3c14a6d0 msgr2=0x7f5b3c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:49.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b40c00700 1 --2- 172.21.15.139:0/3776418565 >> v2:172.21.15.139:3300/0 conn(0x7f5b3c14a6d0 0x7f5b3c0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b40c00700 1 -- 172.21.15.139:0/3776418565 >> v1:172.21.15.139:6789/0 conn(0x7f5b3c0b2b70 legacy=0x7f5b3c06fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.818+0000 7f5b40c00700 1 -- 172.21.15.139:0/3776418565 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0cc3b0 con 0x7f5b3c0cd450 2024-09-13T17:25:49.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b40c00700 1 --2- 172.21.15.139:0/3776418565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c0cd450 0x7f5b3c071ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009850 tx=0x7f5b28009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ca0c4486af4256 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b3be00700 1 -- 172.21.15.139:0/3776418565 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28011830 con 0x7f5b3c0cd450 2024-09-13T17:25:49.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b3be00700 1 -- 172.21.15.139:0/3776418565 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b28011990 con 0x7f5b3c0cd450 2024-09-13T17:25:49.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b3be00700 1 -- 172.21.15.139:0/3776418565 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28011d40 con 0x7f5b3c0cd450 2024-09-13T17:25:49.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 -- 172.21.15.139:0/3776418565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c0cd450 msgr2=0x7f5b3c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 --2- 172.21.15.139:0/3776418565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c0cd450 0x7f5b3c071ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009850 tx=0x7f5b28009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 -- 172.21.15.139:0/3776418565 shutdown_connections 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 --2- 172.21.15.139:0/3776418565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c0cd450 0x7f5b3c071ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 --2- 172.21.15.139:0/3776418565 >> v2:172.21.15.139:3300/0 conn(0x7f5b3c14a6d0 0x7f5b3c0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 -- 172.21.15.139:0/3776418565 >> 172.21.15.139:0/3776418565 conn(0x7f5b3c0ce9d0 msgr2=0x7f5b3c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 -- 172.21.15.139:0/3776418565 shutdown_connections 2024-09-13T17:25:49.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.822+0000 7f5b42a00700 1 -- 172.21.15.139:0/3776418565 wait complete. 2024-09-13T17:25:49.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 Processor -- start 2024-09-13T17:25:49.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 -- start start 2024-09-13T17:25:49.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b3c0b2b70 0x7f5b3c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 0x7f5b3c13f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c14a6d0 0x7f5b3c141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c06c1c0 con 0x7f5b3c0cd450 2024-09-13T17:25:49.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c06c4a0 con 0x7f5b3c0b2b70 2024-09-13T17:25:49.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c06c780 con 0x7f5b3c14a6d0 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b40c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 0x7f5b3c13f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b40c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 0x7f5b3c13f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56278/0 (socket says 172.21.15.139:56278) 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b40c00700 1 -- 172.21.15.139:0/2182913047 learned_addr learned my addr 172.21.15.139:0/2182913047 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b42000700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c14a6d0 0x7f5b3c141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.826+0000 7f5b41600700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b3c0b2b70 0x7f5b3c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b40c00700 1 -- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c14a6d0 msgr2=0x7f5b3c141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b40c00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c14a6d0 0x7f5b3c141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b40c00700 1 -- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b3c0b2b70 msgr2=0x7f5b3c06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b40c00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b3c0b2b70 0x7f5b3c06d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:49.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b40c00700 1 -- 172.21.15.139:0/2182913047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280094b0 con 0x7f5b3c0cd450 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b42000700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c14a6d0 0x7f5b3c141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b40c00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 0x7f5b3c13f7b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b280090b0 tx=0x7f5b28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28004610 con 0x7f5b3c0cd450 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2801e070 con 0x7f5b3c0cd450 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c06ca60 con 0x7f5b3c0cd450 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280038c0 con 0x7f5b3c0cd450 2024-09-13T17:25:49.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c06be50 con 0x7f5b3c0cd450 2024-09-13T17:25:49.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c06cf80 con 0x7f5b3c0cd450 2024-09-13T17:25:49.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.830+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b28003a20 con 0x7f5b3c0cd450 2024-09-13T17:25:49.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.834+0000 7f5b39600700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b1c066760 0x7f5b1c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:49.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.834+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b28020070 con 0x7f5b3c0cd450 2024-09-13T17:25:49.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.834+0000 7f5b41600700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b1c066760 0x7f5b1c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:49.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.834+0000 7f5b41600700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b1c066760 0x7f5b1c068c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009b80 tx=0x7f5b30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:49.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:49.838+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b3c06cf80 con 0x7f5b3c0cd450 2024-09-13T17:25:50.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.062+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b3c06cf80 con 0x7f5b3c0cd450 2024-09-13T17:25:50.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b39600700 1 -- 172.21.15.139:0/2182913047 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b3c06cf80 con 0x7f5b3c0cd450 2024-09-13T17:25:50.069 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:25:50.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b1c066760 msgr2=0x7f5b1c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:50.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b1c066760 0x7f5b1c068c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009b80 tx=0x7f5b30008040 comp rx=0 tx=0).stop 2024-09-13T17:25:50.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 msgr2=0x7f5b3c13f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:50.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 0x7f5b3c13f7b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b280090b0 tx=0x7f5b28004770 comp rx=0 tx=0).stop 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 shutdown_connections 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5b1c066760 0x7f5b1c068c20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b3c14a6d0 0x7f5b3c141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b3c0cd450 0x7f5b3c13f7b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 --2- 172.21.15.139:0/2182913047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b3c0b2b70 0x7f5b3c06d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 >> 172.21.15.139:0/2182913047 conn(0x7f5b3c0ce9d0 msgr2=0x7f5b3c0cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 shutdown_connections 2024-09-13T17:25:50.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:50.066+0000 7f5b42a00700 1 -- 172.21.15.139:0/2182913047 wait complete. 2024-09-13T17:25:50.093 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:25:50.093 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:25:50.094 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:25:50.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.094 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-13T17:25:50.112 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:25:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-13T17:25:50.113 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42369sec preferred_lft 42369sec 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:42:b9:61:11:da brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.114 INFO:teuthology.orchestra.run.smithi139.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:4c:5d:43:32:1f brd ff:ff:ff:ff:ff:ff 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::a889:91ff:fe7a:9b84/64 scope link 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 02:4c:5d:43:32:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::4c:5dff:fe43:321f/64 scope link 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 6a:c5:df:f7:40:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::68c5:dfff:fef7:4090/64 scope link 2024-09-13T17:25:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:25:50.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.117 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:25:50.199 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-13T17:25:50.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.202 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:25:50.263 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:25:50.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.264 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-13T17:25:50.265 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-13T17:25:50.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:25:50.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:25:50.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:25:50.265 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-13T17:25:50.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.399 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:25:50.414 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:25:50.414 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:25:50.415 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:25:50.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.415 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-09-13T17:25:50.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:25:50.491 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:25:50.550 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:25:50.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:25:50.551 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:25:50.609 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T17:25:50.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:50.750 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:50.751 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:25:50.778 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-13T17:25:50.778 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-13T17:25:50.778 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-13T17:25:50.779 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with new device syntax: 0@a6cff629-1d3c-470e-abc7-14e2fbc4e0ad.cephfs=/ 2024-09-13T17:25:50.779 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.139:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-13T17:25:50.785 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:25:50.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:25:50.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:50.817 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:25:50.901 INFO:teuthology.orchestra.run.smithi139.stdout:client5078 2024-09-13T17:25:50.901 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:25:50.901 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:25:50.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T17:25:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569b000700 1 Processor -- start 2024-09-13T17:25:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569b000700 1 -- start start 2024-09-13T17:25:51.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569b000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f569406fe10 0x7f56940ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569b000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940cd160 con 0x7f56940b2b70 2024-09-13T17:25:51.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569b000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940aceb0 con 0x7f569415cc00 2024-09-13T17:25:51.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569b000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56940ad190 con 0x7f569406fe10 2024-09-13T17:25:51.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f5699200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f569406fe10 0x7f56940ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569a600700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f56940b2b70 0x7f569415cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45468/0 (socket says 172.21.15.139:45468) 2024-09-13T17:25:51.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.174+0000 7f569a600700 1 -- 172.21.15.139:0/759572306 learned_addr learned my addr 172.21.15.139:0/759572306 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:51.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5699200700 1 -- 172.21.15.139:0/759572306 >> v1:172.21.15.176:6789/0 conn(0x7f569415cc00 legacy=0x7f56940adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5699200700 1 -- 172.21.15.139:0/759572306 >> v1:172.21.15.139:6789/0 conn(0x7f56940b2b70 legacy=0x7f569415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5699200700 1 -- 172.21.15.139:0/759572306 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940ad470 con 0x7f569406fe10 2024-09-13T17:25:51.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5699200700 1 --2- 172.21.15.139:0/759572306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569406fe10 0x7f56940ac890 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5680009850 tx=0x7f5680009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c206e3499dc5cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:51.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5693e00700 1 -- 172.21.15.139:0/759572306 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680011830 con 0x7f569406fe10 2024-09-13T17:25:51.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5693e00700 1 -- 172.21.15.139:0/759572306 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680011990 con 0x7f569406fe10 2024-09-13T17:25:51.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f5693e00700 1 -- 172.21.15.139:0/759572306 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680011d20 con 0x7f569406fe10 2024-09-13T17:25:51.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 -- 172.21.15.139:0/759572306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569406fe10 msgr2=0x7f56940ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 --2- 172.21.15.139:0/759572306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569406fe10 0x7f56940ac890 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5680009850 tx=0x7f5680009b60 comp rx=0 tx=0).stop 2024-09-13T17:25:51.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 -- 172.21.15.139:0/759572306 shutdown_connections 2024-09-13T17:25:51.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 --2- 172.21.15.139:0/759572306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569406fe10 0x7f56940ac890 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 -- 172.21.15.139:0/759572306 >> 172.21.15.139:0/759572306 conn(0x7f56940ce9d0 msgr2=0x7f56940cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:51.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 -- 172.21.15.139:0/759572306 shutdown_connections 2024-09-13T17:25:51.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.178+0000 7f569b000700 1 -- 172.21.15.139:0/759572306 wait complete. 2024-09-13T17:25:51.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.182+0000 7f569b000700 1 Processor -- start 2024-09-13T17:25:51.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.182+0000 7f569b000700 1 -- start start 2024-09-13T17:25:51.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569406fe10 0x7f56941536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56940b2b70 0x7f569415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 0x7f569415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5694153bf0 con 0x7f569415cc00 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569406dc10 con 0x7f56940b2b70 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569406d070 con 0x7f569406fe10 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 0x7f569415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 0x7f569415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56304/0 (socket says 172.21.15.139:56304) 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 -- 172.21.15.139:0/3160929374 learned_addr learned my addr 172.21.15.139:0/3160929374 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f5699200700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56940b2b70 0x7f569415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f5699c00700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569406fe10 0x7f56941536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 -- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569406fe10 msgr2=0x7f56941536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569406fe10 0x7f56941536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 -- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56940b2b70 msgr2=0x7f569415e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56940b2b70 0x7f569415e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 -- 172.21.15.139:0/3160929374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800094b0 con 0x7f569415cc00 2024-09-13T17:25:51.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569a600700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 0x7f569415e570 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f568c00cbf0 tx=0x7f568c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:51.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00a7a0 con 0x7f569415cc00 2024-09-13T17:25:51.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c00a900 con 0x7f569415cc00 2024-09-13T17:25:51.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00ac70 con 0x7f569415cc00 2024-09-13T17:25:51.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569406d2e0 con 0x7f569415cc00 2024-09-13T17:25:51.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569406d8a0 con 0x7f569415cc00 2024-09-13T17:25:51.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.186+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56940ac890 con 0x7f569415cc00 2024-09-13T17:25:51.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.190+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f568c01b3b0 con 0x7f569415cc00 2024-09-13T17:25:51.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.190+0000 7f5691600700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5674066730 0x7f5674068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.190+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f568c083ba0 con 0x7f569415cc00 2024-09-13T17:25:51.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.194+0000 7f5699c00700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5674066730 0x7f5674068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.194+0000 7f5699c00700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5674066730 0x7f5674068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f569415f710 tx=0x7f5688009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:51.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.198+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f568c050e70 con 0x7f569415cc00 2024-09-13T17:25:51.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.402+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f56940ae770 con 0x7f5674066730 2024-09-13T17:25:51.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f5691600700 1 -- 172.21.15.139:0/3160929374 <== mgr.4100 v2:172.21.15.139:6832/3612810800 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f56940ae770 con 0x7f5674066730 2024-09-13T17:25:51.410 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2024-09-13T17:25:51.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T17:25:51.410 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephfs" 2024-09-13T17:25:51.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T17:25:51.410 INFO:teuthology.orchestra.run.smithi139.stdout:] 2024-09-13T17:25:51.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5674066730 msgr2=0x7f5674068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5674066730 0x7f5674068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f569415f710 tx=0x7f5688009040 comp rx=0 tx=0).stop 2024-09-13T17:25:51.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 msgr2=0x7f569415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 0x7f569415e570 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f568c00cbf0 tx=0x7f568c00cc20 comp rx=0 tx=0).stop 2024-09-13T17:25:51.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 shutdown_connections 2024-09-13T17:25:51.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5674066730 0x7f5674068bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f569415cc00 0x7f569415e570 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56940b2b70 0x7f569415e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 --2- 172.21.15.139:0/3160929374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569406fe10 0x7f56941536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.406+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 >> 172.21.15.139:0/3160929374 conn(0x7f56940ce9d0 msgr2=0x7f56940701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:51.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.410+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 shutdown_connections 2024-09-13T17:25:51.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.410+0000 7f569b000700 1 -- 172.21.15.139:0/3160929374 wait complete. 2024-09-13T17:25:51.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-09-13T17:25:51.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff83e600700 1 Processor -- start 2024-09-13T17:25:51.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff83e600700 1 -- start start 2024-09-13T17:25:51.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff83e600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff8380ce5f0 0x7ff83815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff83e600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815c160 con 0x7ff838144770 2024-09-13T17:25:51.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff83e600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815c540 con 0x7ff83806d9b0 2024-09-13T17:25:51.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff83e600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380cea20 con 0x7ff8380ce5f0 2024-09-13T17:25:51.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff837400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff838144770 0x7ff83806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45472/0 (socket says 172.21.15.139:45472) 2024-09-13T17:25:51.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff837400700 1 -- 172.21.15.139:0/2301019663 learned_addr learned my addr 172.21.15.139:0/2301019663 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:51.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.606+0000 7ff837e00700 1 --2- 172.21.15.139:0/2301019663 >> v2:172.21.15.176:3300/0 conn(0x7ff8380ce5f0 0x7ff83815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882924660 0 0) 0x7ff83815c160 con 0x7ff838144770 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff81c0035d0 con 0x7ff838144770 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828105056 0 0) 0x7ff83815c540 con 0x7ff83806d9b0 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83815c160 con 0x7ff83806d9b0 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff837e00700 1 -- 172.21.15.139:0/2301019663 >> v1:172.21.15.176:6789/0 conn(0x7ff83806d9b0 legacy=0x7ff83815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff837e00700 1 -- 172.21.15.139:0/2301019663 >> v1:172.21.15.139:6789/0 conn(0x7ff838144770 legacy=0x7ff83806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff837e00700 1 -- 172.21.15.139:0/2301019663 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838144b50 con 0x7ff8380ce5f0 2024-09-13T17:25:51.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff837e00700 1 --2- 172.21.15.139:0/2301019663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8380ce5f0 0x7ff83815b1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff830009d90 tx=0x7ff83000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c7c6b4586dd4a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:51.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000e070 con 0x7ff8380ce5f0 2024-09-13T17:25:51.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000bb20 con 0x7ff8380ce5f0 2024-09-13T17:25:51.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff836000700 1 -- 172.21.15.139:0/2301019663 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830012430 con 0x7ff8380ce5f0 2024-09-13T17:25:51.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 -- 172.21.15.139:0/2301019663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8380ce5f0 msgr2=0x7ff83815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 --2- 172.21.15.139:0/2301019663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8380ce5f0 0x7ff83815b1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff830009d90 tx=0x7ff83000b330 comp rx=0 tx=0).stop 2024-09-13T17:25:51.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 -- 172.21.15.139:0/2301019663 shutdown_connections 2024-09-13T17:25:51.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 --2- 172.21.15.139:0/2301019663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8380ce5f0 0x7ff83815b1c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 -- 172.21.15.139:0/2301019663 >> 172.21.15.139:0/2301019663 conn(0x7ff83806b1e0 msgr2=0x7ff83806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:51.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 -- 172.21.15.139:0/2301019663 shutdown_connections 2024-09-13T17:25:51.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.610+0000 7ff83e600700 1 -- 172.21.15.139:0/2301019663 wait complete. 2024-09-13T17:25:51.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 Processor -- start 2024-09-13T17:25:51.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 -- start start 2024-09-13T17:25:51.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff83806d9b0 0x7ff8380712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 0x7ff8380aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff838144770 0x7ff8380ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83815ad70 con 0x7ff8380ce5f0 2024-09-13T17:25:51.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8381337f0 con 0x7ff838144770 2024-09-13T17:25:51.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff83e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838133ad0 con 0x7ff83806d9b0 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.614+0000 7ff836a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 0x7ff8380aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 0x7ff8380aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56310/0 (socket says 172.21.15.139:56310) 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 -- 172.21.15.139:0/2801585362 learned_addr learned my addr 172.21.15.139:0/2801585362 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff837e00700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff838144770 0x7ff8380ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff837400700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff83806d9b0 0x7ff8380712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 -- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff83806d9b0 msgr2=0x7ff8380712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff83806d9b0 0x7ff8380712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 -- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff838144770 msgr2=0x7ff8380ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:51.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff838144770 0x7ff8380ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:51.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 -- 172.21.15.139:0/2801585362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830009a70 con 0x7ff8380ce5f0 2024-09-13T17:25:51.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff836a00700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 0x7ff8380aae10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c490 tx=0x7ff82400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:51.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400cea0 con 0x7ff8380ce5f0 2024-09-13T17:25:51.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8240052f0 con 0x7ff8380ce5f0 2024-09-13T17:25:51.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff838133db0 con 0x7ff8380ce5f0 2024-09-13T17:25:51.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240036a0 con 0x7ff8380ce5f0 2024-09-13T17:25:51.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff838134370 con 0x7ff8380ce5f0 2024-09-13T17:25:51.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.618+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83806d120 con 0x7ff8380ce5f0 2024-09-13T17:25:51.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.622+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff824003800 con 0x7ff8380ce5f0 2024-09-13T17:25:51.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.622+0000 7ff82f400700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff818066760 0x7ff818068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:51.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.622+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff8240836b0 con 0x7ff8380ce5f0 2024-09-13T17:25:51.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.622+0000 7ff837400700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff818066760 0x7ff818068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:51.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.626+0000 7ff837400700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff818066760 0x7ff818068c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff828007fd0 tx=0x7ff828007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:51.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.630+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff824050840 con 0x7ff8380ce5f0 2024-09-13T17:25:51.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:51.862+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff8380ce1d0 con 0x7ff8380ce5f0 2024-09-13T17:25:52.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.246+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 6) v1 ==== 86109+0+0 (secure 0 0 0) 0x7ff824050c10 con 0x7ff8380ce5f0 2024-09-13T17:25:52.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.246+0000 7ff82f400700 1 -- 172.21.15.139:0/2801585362 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff8240528a0 con 0x7ff8380ce5f0 2024-09-13T17:25:52.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff818066760 msgr2=0x7ff818068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff818066760 0x7ff818068c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff828007fd0 tx=0x7ff828007de0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 msgr2=0x7ff8380aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 0x7ff8380aae10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c490 tx=0x7ff82400c7a0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 shutdown_connections 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7ff818066760 0x7ff818068c20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff838144770 0x7ff8380ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8380ce5f0 0x7ff8380aae10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 --2- 172.21.15.139:0/2801585362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff83806d9b0 0x7ff8380712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 >> 172.21.15.139:0/2801585362 conn(0x7ff83806b1e0 msgr2=0x7ff8380b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 shutdown_connections 2024-09-13T17:25:52.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.250+0000 7ff83e600700 1 -- 172.21.15.139:0/2801585362 wait complete. 2024-09-13T17:25:52.274 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-13T17:25:52.449 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:52.444+0000 7f12d844b2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:25:52.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 Processor -- start 2024-09-13T17:25:52.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 -- start start 2024-09-13T17:25:52.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5b1c144300 0x7f5b1c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b1c0cddd0 0x7f5b1c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c070140 con 0x7f5b1c15aff0 2024-09-13T17:25:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c070420 con 0x7f5b1c144300 2024-09-13T17:25:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.474+0000 7f5b1b200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c070700 con 0x7f5b1c0cddd0 2024-09-13T17:25:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b19400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f5b1c15aff0 0x7f5b1c0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45484/0 (socket says 172.21.15.139:45484) 2024-09-13T17:25:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b19400700 1 -- 172.21.15.139:0/2641748806 learned_addr learned my addr 172.21.15.139:0/2641748806 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b19e00700 1 --2- 172.21.15.139:0/2641748806 >> v2:172.21.15.139:3300/0 conn(0x7f5b1c144300 0x7f5b1c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 --2- 172.21.15.139:0/2641748806 >> v2:172.21.15.176:3300/0 conn(0x7f5b1c0cddd0 0x7f5b1c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296970281 0 0) 0x7f5b1c070140 con 0x7f5b1c15aff0 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b000035d0 con 0x7f5b1c15aff0 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92742573 0 0) 0x7f5b000035d0 con 0x7f5b1c15aff0 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 >> v2:172.21.15.176:3300/0 conn(0x7f5b1c0cddd0 msgr2=0x7f5b1c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 --2- 172.21.15.139:0/2641748806 >> v2:172.21.15.176:3300/0 conn(0x7f5b1c0cddd0 0x7f5b1c0711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 >> v2:172.21.15.139:3300/0 conn(0x7f5b1c144300 msgr2=0x7f5b1c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:52.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 --2- 172.21.15.139:0/2641748806 >> v2:172.21.15.139:3300/0 conn(0x7f5b1c144300 0x7f5b1c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0709e0 con 0x7f5b1c15aff0 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391557367 0 0) 0x7f5b08001670 con 0x7f5b1c15aff0 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 >> v1:172.21.15.139:6789/0 conn(0x7f5b1c15aff0 legacy=0x7f5b1c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00003a20 0x7f5b00003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b00004870 0x7f5b00004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b00005230 0x7f5b0000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c070420 con 0x7f5b00005230 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c070700 con 0x7f5b00003a20 2024-09-13T17:25:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0000c100 con 0x7f5b00004870 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b19e00700 1 --2- 172.21.15.139:0/2641748806 >> v2:172.21.15.139:3300/0 conn(0x7f5b1c144300 0x7f5b1c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b00005230 0x7f5b0000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b19400700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b00004870 0x7f5b00004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b19e00700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00003a20 0x7f5b00003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 -- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b00004870 msgr2=0x7f5b00004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b00004870 0x7f5b00004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 -- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00003a20 msgr2=0x7f5b00003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00003a20 0x7f5b00003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 -- 172.21.15.139:0/2641748806 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000035d0 con 0x7f5b00005230 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 -- 172.21.15.139:0/2641748806 reap_dead start 2024-09-13T17:25:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b1a800700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b00005230 0x7f5b0000ba30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009fc0 tx=0x7f5b000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc202f6759927894 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:52.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14003a40 con 0x7f5b00005230 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400f040 con 0x7f5b00005230 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.478+0000 7f5b18a00700 1 -- 172.21.15.139:0/2641748806 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14003e00 con 0x7f5b00005230 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 -- 172.21.15.139:0/2641748806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b00005230 msgr2=0x7f5b0000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b00005230 0x7f5b0000ba30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009fc0 tx=0x7f5b000058a0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 -- 172.21.15.139:0/2641748806 shutdown_connections 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 --2- 172.21.15.139:0/2641748806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b00005230 0x7f5b0000ba30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 -- 172.21.15.139:0/2641748806 >> 172.21.15.139:0/2641748806 conn(0x7f5b1c0ce9d0 msgr2=0x7f5b1c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 -- 172.21.15.139:0/2641748806 shutdown_connections 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 -- 172.21.15.139:0/2641748806 wait complete. 2024-09-13T17:25:52.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 Processor -- start 2024-09-13T17:25:52.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 -- start start 2024-09-13T17:25:52.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.482+0000 7f5b1b200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00005230 0x7f5b1c142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b1c0c7b80 0x7f5b1c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 0x7f5b1c13e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c44d0 con 0x7f5b1c13e030 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c48f0 con 0x7f5b00005230 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c3b70 con 0x7f5b1c0c7b80 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 0x7f5b1c13e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 0x7f5b1c13e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56356/0 (socket says 172.21.15.139:56356) 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 -- 172.21.15.139:0/820112187 learned_addr learned my addr 172.21.15.139:0/820112187 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b19e00700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00005230 0x7f5b1c142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b19400700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b1c0c7b80 0x7f5b1c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 -- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b1c0c7b80 msgr2=0x7f5b1c0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b1c0c7b80 0x7f5b1c0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 -- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00005230 msgr2=0x7f5b1c142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00005230 0x7f5b1c142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 -- 172.21.15.139:0/820112187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0c86d0 con 0x7f5b1c13e030 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1a800700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 0x7f5b1c13e4c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400e700 tx=0x7f5b14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14003e30 con 0x7f5b1c13e030 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14004230 con 0x7f5b1c13e030 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c0c3e10 con 0x7f5b1c13e030 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140043e0 con 0x7f5b1c13e030 2024-09-13T17:25:52.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c13ea00 con 0x7f5b1c13e030 2024-09-13T17:25:52.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.486+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c0c4610 con 0x7f5b1c13e030 2024-09-13T17:25:52.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.490+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 6) v1 ==== 86109+0+0 (secure 0 0 0) 0x7f5b14004540 con 0x7f5b1c13e030 2024-09-13T17:25:52.494 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:52.490+0000 7ff8044dc2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:25:52.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.490+0000 7f5b12000700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 0x7f5afc068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:52.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.490+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b140859c0 con 0x7f5b1c13e030 2024-09-13T17:25:52.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.490+0000 7f5b19e00700 1 -- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 msgr2=0x7f5afc068c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:52.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.490+0000 7f5b19e00700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 0x7f5afc068c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:25:52.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.498+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b1c0c4610 con 0x7f5b1c13e030 2024-09-13T17:25:52.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.690+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5b1c0c4610 con 0x7f5b1c13e030 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.694+0000 7f5b19e00700 1 -- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 msgr2=0x7f5afc068c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.694+0000 7f5b19e00700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 0x7f5afc068c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.694+0000 7f5b12000700 1 -- 172.21.15.139:0/820112187 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5b1c0c4610 con 0x7f5b1c13e030 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 msgr2=0x7f5afc068c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 0x7f5afc068c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 msgr2=0x7f5b1c13e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 0x7f5b1c13e4c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400e700 tx=0x7f5b14009750 comp rx=0 tx=0).stop 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 shutdown_connections 2024-09-13T17:25:52.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f5afc066780 0x7f5afc068c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.698+0000 7f5b1b200700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b1c13e030 0x7f5b1c13e4c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.702+0000 7f5b1b200700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b1c0c7b80 0x7f5b1c0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.702+0000 7f5b1b200700 1 --2- 172.21.15.139:0/820112187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b00005230 0x7f5b1c142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:52.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.702+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 >> 172.21.15.139:0/820112187 conn(0x7f5b1c0ce9d0 msgr2=0x7f5b1c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:52.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.702+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 shutdown_connections 2024-09-13T17:25:52.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:52.702+0000 7f5b1b200700 1 -- 172.21.15.139:0/820112187 wait complete. 2024-09-13T17:25:52.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-13T17:25:52.999 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:52.996+0000 7f12d844b2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:25:53.077 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:53.076+0000 7f12d844b2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:25:53.078 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:53.074+0000 7ff8044dc2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:25:53.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.106+0000 7fbc7fe00700 1 Processor -- start 2024-09-13T17:25:53.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.106+0000 7fbc7fe00700 1 -- start start 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc8015f5c0 0x7fbc80143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ef90 0x7fbc800b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7fe00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc800b41a0 con 0x7fbc8015ebb0 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7fe00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800b6370 con 0x7fbc8015f5c0 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800b6650 con 0x7fbc8015ef90 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc8015f5c0 0x7fbc80143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbc8015f5c0 0x7fbc80143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56360/0 (socket says 172.21.15.139:56360) 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 -- 172.21.15.139:0/3517530921 learned_addr learned my addr 172.21.15.139:0/3517530921 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7f400700 1 --2- 172.21.15.139:0/3517530921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ef90 0x7fbc800b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 -- 172.21.15.139:0/3517530921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ef90 msgr2=0x7fbc800b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:53.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 --2- 172.21.15.139:0/3517530921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ef90 0x7fbc800b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 -- 172.21.15.139:0/3517530921 >> v1:172.21.15.176:6789/0 conn(0x7fbc8015ebb0 legacy=0x7fbc801434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:53.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 -- 172.21.15.139:0/3517530921 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800b6930 con 0x7fbc8015f5c0 2024-09-13T17:25:53.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.110+0000 7fbc7e000700 1 --2- 172.21.15.139:0/3517530921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015f5c0 0x7fbc80143be0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009910 tx=0x7fbc6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f4800c8c35bd09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:53.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7d600700 1 -- 172.21.15.139:0/3517530921 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c004230 con 0x7fbc8015f5c0 2024-09-13T17:25:53.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7d600700 1 -- 172.21.15.139:0/3517530921 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c004390 con 0x7fbc8015f5c0 2024-09-13T17:25:53.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7d600700 1 -- 172.21.15.139:0/3517530921 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c009e60 con 0x7fbc8015f5c0 2024-09-13T17:25:53.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3517530921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015f5c0 msgr2=0x7fbc80143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3517530921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015f5c0 0x7fbc80143be0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009910 tx=0x7fbc6c009c20 comp rx=0 tx=0).stop 2024-09-13T17:25:53.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3517530921 shutdown_connections 2024-09-13T17:25:53.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3517530921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ef90 0x7fbc800b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3517530921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015f5c0 0x7fbc80143be0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3517530921 >> 172.21.15.139:0/3517530921 conn(0x7fbc80071fa0 msgr2=0x7fbc80072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:53.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3517530921 shutdown_connections 2024-09-13T17:25:53.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.114+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3517530921 wait complete. 2024-09-13T17:25:53.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 Processor -- start 2024-09-13T17:25:53.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 -- start start 2024-09-13T17:25:53.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ebb0 0x7fbc801594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 0x7fbc800ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc8015f5c0 0x7fbc8006bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800cc420 con 0x7fbc8015ef90 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800cab50 con 0x7fbc8015f5c0 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8006c270 con 0x7fbc8015ebb0 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 0x7fbc800ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 0x7fbc800ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56362/0 (socket says 172.21.15.139:56362) 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 -- 172.21.15.139:0/3396327921 learned_addr learned my addr 172.21.15.139:0/3396327921 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7f400700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc8015f5c0 0x7fbc8006bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7ea00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ebb0 0x7fbc801594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 -- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ebb0 msgr2=0x7fbc801594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ebb0 0x7fbc801594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 -- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc8015f5c0 msgr2=0x7fbc8006bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc8015f5c0 0x7fbc8006bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 -- 172.21.15.139:0/3396327921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009570 con 0x7fbc8015ef90 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.118+0000 7fbc7e000700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 0x7fbc800ca610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbc800b34b0 tx=0x7fbc6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c009e80 con 0x7fbc8015ef90 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00be60 con 0x7fbc8015ef90 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8006cdb0 con 0x7fbc8015ef90 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c003900 con 0x7fbc8015ef90 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8006c7f0 con 0x7fbc8015ef90 2024-09-13T17:25:53.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc800677e0 con 0x7fbc8015ef90 2024-09-13T17:25:53.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.122+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 6) v1 ==== 86109+0+0 (secure 0 0 0) 0x7fbc6c003a60 con 0x7fbc8015ef90 2024-09-13T17:25:53.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.126+0000 7fbc77400700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbc60066780 0x7fbc60068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.126+0000 7fbc7ea00700 1 -- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbc60066780 msgr2=0x7fbc60068c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:53.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.126+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc6c0858d0 con 0x7fbc8015ef90 2024-09-13T17:25:53.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.126+0000 7fbc7ea00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbc60066780 0x7fbc60068c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:25:53.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.130+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc6c052af0 con 0x7fbc8015ef90 2024-09-13T17:25:53.157 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:53.154+0000 7ff8044dc2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:25:53.301 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:53.296+0000 7f12d844b2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:25:53.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.314+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fbc800b41a0 con 0x7fbc8015ef90 2024-09-13T17:25:53.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.322+0000 7fbc77400700 1 -- 172.21.15.139:0/3396327921 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbc800b41a0 con 0x7fbc8015ef90 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbc60066780 msgr2=0x7fbc60068c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbc60066780 0x7fbc60068c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 msgr2=0x7fbc800ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 0x7fbc800ca610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbc800b34b0 tx=0x7fbc6c004770 comp rx=0 tx=0).stop 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 shutdown_connections 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7fbc60066780 0x7fbc60068c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc8015f5c0 0x7fbc8006bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc8015ef90 0x7fbc800ca610 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 --2- 172.21.15.139:0/3396327921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc8015ebb0 0x7fbc801594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 >> 172.21.15.139:0/3396327921 conn(0x7fbc80071fa0 msgr2=0x7fbc801432a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 shutdown_connections 2024-09-13T17:25:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.326+0000 7fbc7fe00700 1 -- 172.21.15.139:0/3396327921 wait complete. 2024-09-13T17:25:53.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:25:53.352 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-09-13T17:25:53.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add snap_test_dir1 1m 2024-09-13T17:25:53.387 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:53.382+0000 7ff8044dc2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:25:53.572 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:53.568+0000 7f12d844b2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:25:53.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.590+0000 7f9179400700 1 Processor -- start 2024-09-13T17:25:53.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.590+0000 7f9179400700 1 -- start start 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9179400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91740cddd0 0x7f9174165680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9179400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9174070140 con 0x7f9174144300 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9179400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9174070420 con 0x7f917415aff0 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9179400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9174070700 con 0x7f91740cddd0 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9173e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f9174144300 0x7f917406d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45500/0 (socket says 172.21.15.139:45500) 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9173e00700 1 -- 172.21.15.139:0/839681393 learned_addr learned my addr 172.21.15.139:0/839681393 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9178a00700 1 --2- 172.21.15.139:0/839681393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91740cddd0 0x7f9174165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9172a00700 1 -- 172.21.15.139:0/839681393 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196329790 0 0) 0x7f9174070140 con 0x7f9174144300 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9172a00700 1 -- 172.21.15.139:0/839681393 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91580035d0 con 0x7f9174144300 2024-09-13T17:25:53.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9178a00700 1 -- 172.21.15.139:0/839681393 >> v1:172.21.15.176:6789/0 conn(0x7f917415aff0 legacy=0x7f91740cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9178a00700 1 -- 172.21.15.139:0/839681393 >> v1:172.21.15.139:6789/0 conn(0x7f9174144300 legacy=0x7f917406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.594+0000 7f9178a00700 1 -- 172.21.15.139:0/839681393 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740709e0 con 0x7f91740cddd0 2024-09-13T17:25:53.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9178a00700 1 --2- 172.21.15.139:0/839681393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91740cddd0 0x7f9174165680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f916c009df0 tx=0x7f916c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32718127a9e742f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:53.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9172a00700 1 -- 172.21.15.139:0/839681393 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00e070 con 0x7f91740cddd0 2024-09-13T17:25:53.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9172a00700 1 -- 172.21.15.139:0/839681393 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00bae0 con 0x7f91740cddd0 2024-09-13T17:25:53.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9172a00700 1 -- 172.21.15.139:0/839681393 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00be90 con 0x7f91740cddd0 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 -- 172.21.15.139:0/839681393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91740cddd0 msgr2=0x7f9174165680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 --2- 172.21.15.139:0/839681393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91740cddd0 0x7f9174165680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f916c009df0 tx=0x7f916c00b330 comp rx=0 tx=0).stop 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 -- 172.21.15.139:0/839681393 shutdown_connections 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 --2- 172.21.15.139:0/839681393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91740cddd0 0x7f9174165680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 -- 172.21.15.139:0/839681393 >> 172.21.15.139:0/839681393 conn(0x7f91740ce9d0 msgr2=0x7f91740cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 -- 172.21.15.139:0/839681393 shutdown_connections 2024-09-13T17:25:53.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 -- 172.21.15.139:0/839681393 wait complete. 2024-09-13T17:25:53.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.598+0000 7f9179400700 1 Processor -- start 2024-09-13T17:25:53.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 -- start start 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91740cddd0 0x7f91740cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9174144300 0x7f91740b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f917415aff0 0x7f917413b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91740aca30 con 0x7f91740cddd0 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174151ff0 con 0x7f917415aff0 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91741522d0 con 0x7f9174144300 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91740cddd0 0x7f91740cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91740cddd0 0x7f91740cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56376/0 (socket says 172.21.15.139:56376) 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 -- 172.21.15.139:0/2987527252 learned_addr learned my addr 172.21.15.139:0/2987527252 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9178a00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f917415aff0 0x7f917413b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9174144300 0x7f91740b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9174144300 msgr2=0x7f91740b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9174144300 0x7f91740b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f917415aff0 msgr2=0x7f917413b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f917415aff0 0x7f917413b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 -- 172.21.15.139:0/2987527252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009a70 con 0x7f91740cddd0 2024-09-13T17:25:53.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9173e00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91740cddd0 0x7f91740cb760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f916400c700 tx=0x7f916400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:53.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164005d90 con 0x7f91740cddd0 2024-09-13T17:25:53.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640070d0 con 0x7f91740cddd0 2024-09-13T17:25:53.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917406deb0 con 0x7f91740cddd0 2024-09-13T17:25:53.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164007480 con 0x7f91740cddd0 2024-09-13T17:25:53.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.602+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9174152890 con 0x7f91740cddd0 2024-09-13T17:25:53.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.606+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91741446e0 con 0x7f91740cddd0 2024-09-13T17:25:53.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.606+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 6) v1 ==== 86109+0+0 (secure 0 0 0) 0x7f91640075e0 con 0x7f91740cddd0 2024-09-13T17:25:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.606+0000 7f916be00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.606+0000 7f9173400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 msgr2=0x7f9154068c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.606+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9164083990 con 0x7f91740cddd0 2024-09-13T17:25:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.606+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:25:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.610+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9164050b30 con 0x7f91740cddd0 2024-09-13T17:25:53.663 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:53.660+0000 7f12d844b2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:25:53.666 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:53.662+0000 7ff8044dc2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:25:53.747 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:53.742+0000 7ff8044dc2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:25:53.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.810+0000 7f9173400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 msgr2=0x7f9154068c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:53.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.810+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:25:53.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:53.818+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 --> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "snap_test_dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f917406dd30 con 0x7f91540667b0 2024-09-13T17:25:53.891 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:53.888+0000 7f12d844b2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:25:53.979 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:53.976+0000 7f12d844b2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:25:53.980 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:53.974+0000 7ff8044dc2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:25:54.069 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:54.064+0000 7f12d844b2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:25:54.070 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:54.066+0000 7ff8044dc2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:25:54.168 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:54.162+0000 7ff8044dc2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:25:54.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:54.214+0000 7f9173400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 msgr2=0x7f9154068c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:54.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:54.214+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:25:54.477 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:54.472+0000 7f12d844b2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:25:54.586 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:54.582+0000 7ff8044dc2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:25:54.656 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:54.652+0000 7f12d844b2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:25:54.769 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:54.762+0000 7ff8044dc2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:25:55.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:55.018+0000 7f9173400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 msgr2=0x7f9154068c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:55.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:55.018+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:25:55.075 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.072+0000 7f12d844b2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:25:55.204 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:55.198+0000 7ff8044dc2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:25:55.318 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.315+0000 7f12d844b2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:25:55.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.407+0000 7f12d844b2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:25:55.483 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:55.478+0000 7ff8044dc2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:25:55.586 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:55.582+0000 7ff8044dc2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:25:55.609 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.603+0000 7f12d844b2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:25:55.794 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.791+0000 7f12d844b2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:25:55.810 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:55.806+0000 7ff8044dc2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:25:55.877 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.871+0000 7f12d844b2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:25:55.977 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:55.971+0000 7f12d844b2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:25:56.022 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.018+0000 7ff8044dc2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:25:56.061 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:56.055+0000 7f12d844b2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:25:56.113 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.106+0000 7ff8044dc2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:25:56.149 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:56.143+0000 7f12d844b2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:25:56.223 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.218+0000 7ff8044dc2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:25:56.317 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.314+0000 7ff8044dc2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:25:56.417 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.414+0000 7ff8044dc2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:25:56.495 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:56.491+0000 7f12d844b2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:25:56.583 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:56.579+0000 7f12d844b2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:25:56.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:56.622+0000 7f9173400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 msgr2=0x7f9154068c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/3612810800 2024-09-13T17:25:56.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:56.622+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T17:25:56.798 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.794+0000 7ff8044dc2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:25:56.889 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:56.882+0000 7ff8044dc2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:25:57.294 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:25:57.291+0000 7f12d844b2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:25:57.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:57.358+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 7) v1 ==== 86109+0+0 (secure 0 0 0) 0x7f9164050f00 con 0x7f91740cddd0 2024-09-13T17:25:57.624 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.618+0000 7ff8044dc2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:25:57.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:57.642+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mgrmap(e 8) v1 ==== 85820+0+0 (secure 0 0 0) 0x7f9164012400 con 0x7f91740cddd0 2024-09-13T17:25:57.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:57.642+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 msgr2=0x7f9154068c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:25:57.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:57.642+0000 7f916be00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/3612810800,v1:172.21.15.139:6833/3612810800] conn(0x7f91540667b0 0x7f9154068c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:57.942 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7c0600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7c0600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7c0600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7c0600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7c0600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7bb600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7bb600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7bb600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7bb600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:57.943 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:25:57.938+0000 7ff7bb600700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:25:58.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.654+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mon.0 v2:172.21.15.139:3300/0 9 ==== mgrmap(e 9) v1 ==== 85947+0+0 (secure 0 0 0) 0x7f91640517d0 con 0x7f91740cddd0 2024-09-13T17:25:58.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.654+0000 7f916be00700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f915401c570 0x7f9154070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:58.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.654+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 --> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "snap_test_dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f915401c950 con 0x7f915401c570 2024-09-13T17:25:58.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.658+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f915401c570 0x7f9154070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:58.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.662+0000 7f9173400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f915401c570 0x7f9154070b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f91741f5c10 tx=0x7f9160001240 comp rx=0 tx=0).ready entity=mgr.5093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:58.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.782+0000 7f916be00700 1 -- 172.21.15.139:0/2987527252 <== mgr.5093 v2:172.21.15.139:6832/2501085087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f915401c950 con 0x7f915401c570 2024-09-13T17:25:58.787 INFO:teuthology.orchestra.run.smithi139.stdout:Schedule set for path snap_test_dir1 2024-09-13T17:25:58.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f915401c570 msgr2=0x7f9154070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:58.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f915401c570 0x7f9154070b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f91741f5c10 tx=0x7f9160001240 comp rx=0 tx=0).stop 2024-09-13T17:25:58.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91740cddd0 msgr2=0x7f91740cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:58.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 --2- 172.21.15.139:0/2987527252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91740cddd0 0x7f91740cb760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f916400c700 tx=0x7f916400cac0 comp rx=0 tx=0).stop 2024-09-13T17:25:58.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9178a00700 1 -- 172.21.15.139:0/2987527252 reap_dead start 2024-09-13T17:25:58.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 shutdown_connections 2024-09-13T17:25:58.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 >> 172.21.15.139:0/2987527252 conn(0x7f91740ce9d0 msgr2=0x7f9174141390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:58.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 shutdown_connections 2024-09-13T17:25:58.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.786+0000 7f9179400700 1 -- 172.21.15.139:0/2987527252 wait complete. 2024-09-13T17:25:58.815 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-09-13T17:25:58.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add snap_test_dir1 1m 2024-09-13T17:25:58.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.986+0000 7fbeeea00700 1 Processor -- start 2024-09-13T17:25:58.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.986+0000 7fbeeea00700 1 -- start start 2024-09-13T17:25:58.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbee81610b0 0x7fbee80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:58.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbee8165590 0x7fbee806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:58.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee80d2280 con 0x7fbee806a8d0 2024-09-13T17:25:58.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee806ad60 con 0x7fbee81610b0 2024-09-13T17:25:58.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee806b180 con 0x7fbee8165590 2024-09-13T17:25:58.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbee81610b0 0x7fbee80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbee81610b0 0x7fbee80d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47194/0 (socket says 172.21.15.139:47194) 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 -- 172.21.15.139:0/2023857460 learned_addr learned my addr 172.21.15.139:0/2023857460 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeecc00700 1 --2- 172.21.15.139:0/2023857460 >> v2:172.21.15.176:3300/0 conn(0x7fbee8165590 0x7fbee806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 -- 172.21.15.139:0/2023857460 >> v2:172.21.15.176:3300/0 conn(0x7fbee8165590 msgr2=0x7fbee806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 --2- 172.21.15.139:0/2023857460 >> v2:172.21.15.176:3300/0 conn(0x7fbee8165590 0x7fbee806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 -- 172.21.15.139:0/2023857460 >> v1:172.21.15.176:6789/0 conn(0x7fbee806a8d0 legacy=0x7fbee80cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:58.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 -- 172.21.15.139:0/2023857460 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee81624a0 con 0x7fbee81610b0 2024-09-13T17:25:58.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeed600700 1 --2- 172.21.15.139:0/2023857460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80d2710 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbee8072320 tx=0x7fbedc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc85c08d705f71a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:58.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbee7e00700 1 -- 172.21.15.139:0/2023857460 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00b8a0 con 0x7fbee81610b0 2024-09-13T17:25:58.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbee7e00700 1 -- 172.21.15.139:0/2023857460 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00ba00 con 0x7fbee81610b0 2024-09-13T17:25:58.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbee7e00700 1 -- 172.21.15.139:0/2023857460 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00bd90 con 0x7fbee81610b0 2024-09-13T17:25:58.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 -- 172.21.15.139:0/2023857460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 msgr2=0x7fbee80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:58.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 --2- 172.21.15.139:0/2023857460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80d2710 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbee8072320 tx=0x7fbedc009bf0 comp rx=0 tx=0).stop 2024-09-13T17:25:58.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 -- 172.21.15.139:0/2023857460 shutdown_connections 2024-09-13T17:25:58.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 --2- 172.21.15.139:0/2023857460 >> v2:172.21.15.176:3300/0 conn(0x7fbee8165590 0x7fbee806a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:58.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 --2- 172.21.15.139:0/2023857460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80d2710 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:58.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.990+0000 7fbeeea00700 1 -- 172.21.15.139:0/2023857460 >> 172.21.15.139:0/2023857460 conn(0x7fbee80d33a0 msgr2=0x7fbee80b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:58.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 -- 172.21.15.139:0/2023857460 shutdown_connections 2024-09-13T17:25:58.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 -- 172.21.15.139:0/2023857460 wait complete. 2024-09-13T17:25:58.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 Processor -- start 2024-09-13T17:25:58.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 -- start start 2024-09-13T17:25:59.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee806a8d0 0x7fbee80c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbee8165590 0x7fbee80c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80c70f0 con 0x7fbee81610b0 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80cc9c0 con 0x7fbee806a8d0 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeeea00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80c90d0 con 0x7fbee8165590 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeecc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeecc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47202/0 (socket says 172.21.15.139:47202) 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeecc00700 1 -- 172.21.15.139:0/3974743817 learned_addr learned my addr 172.21.15.139:0/3974743817 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.994+0000 7fbeed600700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee806a8d0 0x7fbee80c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeee000700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbee8165590 0x7fbee80c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeecc00700 1 -- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbee8165590 msgr2=0x7fbee80c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeecc00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbee8165590 0x7fbee80c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeecc00700 1 -- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee806a8d0 msgr2=0x7fbee80c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeecc00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee806a8d0 0x7fbee80c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeecc00700 1 -- 172.21.15.139:0/3974743817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc009570 con 0x7fbee81610b0 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeecc00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80c8510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbed400d800 tx=0x7fbed400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40125f0 con 0x7fbee81610b0 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4012750 con 0x7fbee81610b0 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee80c67c0 con 0x7fbee81610b0 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4012ac0 con 0x7fbee81610b0 2024-09-13T17:25:59.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee80c6d80 con 0x7fbee81610b0 2024-09-13T17:25:59.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:58.998+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee81659f0 con 0x7fbee81610b0 2024-09-13T17:25:59.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.002+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 9) v1 ==== 85947+0+0 (secure 0 0 0) 0x7fbed4012c20 con 0x7fbee81610b0 2024-09-13T17:25:59.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.002+0000 7fbee5600700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbec80665d0 0x7fbec8068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.002+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7fbed40840b0 con 0x7fbee81610b0 2024-09-13T17:25:59.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.002+0000 7fbeed600700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbec80665d0 0x7fbec8068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.006+0000 7fbeed600700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbec80665d0 0x7fbec8068a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbedc000c00 tx=0x7fbedc008030 comp rx=0 tx=0).ready entity=mgr.5093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:59.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.010+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbed4051450 con 0x7fbee81610b0 2024-09-13T17:25:59.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.222+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 --> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "path": "snap_test_dir1", "retention_spec_or_period": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fbee80d1c30 con 0x7fbec80665d0 2024-09-13T17:25:59.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.338+0000 7fbee5600700 1 -- 172.21.15.139:0/3974743817 <== mgr.5093 v2:172.21.15.139:6832/2501085087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fbedc004040 con 0x7fbec80665d0 2024-09-13T17:25:59.342 INFO:teuthology.orchestra.run.smithi139.stdout:Retention added to path snap_test_dir1 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbec80665d0 msgr2=0x7fbec8068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbec80665d0 0x7fbec8068a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbedc000c00 tx=0x7fbedc008030 comp rx=0 tx=0).stop 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 msgr2=0x7fbee80c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80c8510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbed400d800 tx=0x7fbed400db10 comp rx=0 tx=0).stop 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 shutdown_connections 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbec80665d0 0x7fbec8068a90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbee8165590 0x7fbee80c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbee81610b0 0x7fbee80c8510 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 --2- 172.21.15.139:0/3974743817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee806a8d0 0x7fbee80c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 >> 172.21.15.139:0/3974743817 conn(0x7fbee80d33a0 msgr2=0x7fbee8162780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:59.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 shutdown_connections 2024-09-13T17:25:59.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.342+0000 7fbeeea00700 1 -- 172.21.15.139:0/3974743817 wait complete. 2024-09-13T17:25:59.370 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2024-09-13T17:25:59.370 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.customsnapkernel/scheduled-2024-09-13-17_26_00 in ~1s... 2024-09-13T17:25:59.370 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1m'], expected_retention: [{'m': 1}] 2024-09-13T17:25:59.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --format json snap_test_dir1 2024-09-13T17:25:59.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.546+0000 7f6aa6200700 1 Processor -- start 2024-09-13T17:25:59.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.546+0000 7f6aa6200700 1 -- start start 2024-09-13T17:25:59.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6aa00b4fd0 0x7f6aa00cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6aa00ce390 0x7f6aa006e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa00b4d00 con 0x7f6aa0159c60 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa015e890 con 0x7f6aa00ce390 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa00b3850 con 0x7f6aa00b4fd0 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9f400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6aa0159c60 0x7f6aa00b45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45282/0 (socket says 172.21.15.139:45282) 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9f400700 1 -- 172.21.15.139:0/2174847988 learned_addr learned my addr 172.21.15.139:0/2174847988 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9fe00700 1 --2- 172.21.15.139:0/2174847988 >> v2:172.21.15.139:3300/0 conn(0x7f6aa00ce390 0x7f6aa006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9ea00700 1 --2- 172.21.15.139:0/2174847988 >> v2:172.21.15.176:3300/0 conn(0x7f6aa00b4fd0 0x7f6aa00cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9fe00700 1 -- 172.21.15.139:0/2174847988 >> v2:172.21.15.176:3300/0 conn(0x7f6aa00b4fd0 msgr2=0x7f6aa00cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:25:59.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9fe00700 1 --2- 172.21.15.139:0/2174847988 >> v2:172.21.15.176:3300/0 conn(0x7f6aa00b4fd0 0x7f6aa00cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9fe00700 1 -- 172.21.15.139:0/2174847988 >> v1:172.21.15.139:6789/0 conn(0x7f6aa0159c60 legacy=0x7f6aa00b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9fe00700 1 -- 172.21.15.139:0/2174847988 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa006f9a0 con 0x7f6aa00ce390 2024-09-13T17:25:59.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9fe00700 1 --2- 172.21.15.139:0/2174847988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa006e540 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6aa006dfd0 tx=0x7f6a9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e81d7f9030d9c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:59.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9e000700 1 -- 172.21.15.139:0/2174847988 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800e070 con 0x7f6aa00ce390 2024-09-13T17:25:59.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9e000700 1 -- 172.21.15.139:0/2174847988 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9800bb20 con 0x7f6aa00ce390 2024-09-13T17:25:59.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6a9e000700 1 -- 172.21.15.139:0/2174847988 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98012430 con 0x7f6aa00ce390 2024-09-13T17:25:59.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 -- 172.21.15.139:0/2174847988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 msgr2=0x7f6aa006e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.550+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2174847988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa006e540 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6aa006dfd0 tx=0x7f6a9800b330 comp rx=0 tx=0).stop 2024-09-13T17:25:59.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- 172.21.15.139:0/2174847988 shutdown_connections 2024-09-13T17:25:59.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2174847988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa006e540 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2174847988 >> v2:172.21.15.176:3300/0 conn(0x7f6aa00b4fd0 0x7f6aa00cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- 172.21.15.139:0/2174847988 >> 172.21.15.139:0/2174847988 conn(0x7f6aa00cca50 msgr2=0x7f6aa00cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:59.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- 172.21.15.139:0/2174847988 shutdown_connections 2024-09-13T17:25:59.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- 172.21.15.139:0/2174847988 wait complete. 2024-09-13T17:25:59.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 Processor -- start 2024-09-13T17:25:59.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- start start 2024-09-13T17:25:59.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aa00b4fd0 0x7f6aa015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa01e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aa0159c60 0x7f6aa01e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa015aac0 con 0x7f6aa00ce390 2024-09-13T17:25:59.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa015ada0 con 0x7f6aa00b4fd0 2024-09-13T17:25:59.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6aa6200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa015b080 con 0x7f6aa0159c60 2024-09-13T17:25:59.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6a9ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa01e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6a9ea00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa01e4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47218/0 (socket says 172.21.15.139:47218) 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.554+0000 7f6a9ea00700 1 -- 172.21.15.139:0/2977059189 learned_addr learned my addr 172.21.15.139:0/2977059189 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9fe00700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aa0159c60 0x7f6aa01e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9f400700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aa00b4fd0 0x7f6aa015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9ea00700 1 -- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aa0159c60 msgr2=0x7f6aa01e51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9ea00700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aa0159c60 0x7f6aa01e51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9ea00700 1 -- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aa00b4fd0 msgr2=0x7f6aa015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9ea00700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aa00b4fd0 0x7f6aa015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9ea00700 1 -- 172.21.15.139:0/2977059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98009a70 con 0x7f6aa00ce390 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9fe00700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aa0159c60 0x7f6aa01e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9f400700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aa00b4fd0 0x7f6aa015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:25:59.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a9ea00700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa01e4c60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00e9d0 tx=0x7f6a8c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:59.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c009720 con 0x7f6aa00ce390 2024-09-13T17:25:59.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00c850 con 0x7f6aa00ce390 2024-09-13T17:25:59.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa015b360 con 0x7f6aa00ce390 2024-09-13T17:25:59.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00cbc0 con 0x7f6aa00ce390 2024-09-13T17:25:59.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa015a790 con 0x7f6aa00ce390 2024-09-13T17:25:59.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.558+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa015a040 con 0x7f6aa00ce390 2024-09-13T17:25:59.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.562+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 9) v1 ==== 85947+0+0 (secure 0 0 0) 0x7f6a8c00cd20 con 0x7f6aa00ce390 2024-09-13T17:25:59.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.562+0000 7f6a97400700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f6a800665d0 0x7f6a80068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:59.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.562+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f6a8c084310 con 0x7f6aa00ce390 2024-09-13T17:25:59.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.562+0000 7f6a9f400700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f6a800665d0 0x7f6a80068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:59.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.562+0000 7f6a9f400700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f6a800665d0 0x7f6a80068a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).ready entity=mgr.5093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:59.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.570+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6a8c051620 con 0x7f6aa00ce390 2024-09-13T17:25:59.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.662+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 10) v1 ==== 86212+0+0 (secure 0 0 0) 0x7f6a8c0519f0 con 0x7f6aa00ce390 2024-09-13T17:25:59.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.786+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 --> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6aa006f790 con 0x7f6a800665d0 2024-09-13T17:25:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.798+0000 7f6a97400700 1 -- 172.21.15.139:0/2977059189 <== mgr.5093 v2:172.21.15.139:6832/2501085087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f6aa006f790 con 0x7f6a800665d0 2024-09-13T17:25:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:25:59.802 INFO:teuthology.orchestra.run.smithi139.stdout:{"path": "snap_test_dir1", "schedule": ["1m"], "retention": [{"m": 1}]} 2024-09-13T17:25:59.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f6a800665d0 msgr2=0x7f6a80068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f6a800665d0 0x7f6a80068a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).stop 2024-09-13T17:25:59.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 msgr2=0x7f6aa01e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa01e4c60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00e9d0 tx=0x7f6a8c00ed90 comp rx=0 tx=0).stop 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 shutdown_connections 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f6a800665d0 0x7f6a80068a90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6aa0159c60 0x7f6aa01e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aa00ce390 0x7f6aa01e4c60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 --2- 172.21.15.139:0/2977059189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6aa00b4fd0 0x7f6aa015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 >> 172.21.15.139:0/2977059189 conn(0x7f6aa00cca50 msgr2=0x7f6aa006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 shutdown_connections 2024-09-13T17:25:59.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:25:59.802+0000 7f6aa6200700 1 -- 172.21.15.139:0/2977059189 wait complete. 2024-09-13T17:25:59.833 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1m"], "retention": [{"m": 1}]} 2024-09-13T17:25:59.833 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1m'], 'retention': [{'m': 1}]} 2024-09-13T17:25:59.833 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove snap_test_dir1 2024-09-13T17:26:00.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.002+0000 7f0a87a00700 1 Processor -- start 2024-09-13T17:26:00.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.002+0000 7f0a87a00700 1 -- start start 2024-09-13T17:26:00.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.002+0000 7f0a87a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a8015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.002+0000 7f0a87a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0a8006f030 0x7f0a8006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a87a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8006f9d0 con 0x7f0a80160a20 2024-09-13T17:26:00.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a87a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8015ece0 con 0x7f0a8006f030 2024-09-13T17:26:00.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a87a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015e3f0 con 0x7f0a800ce6e0 2024-09-13T17:26:00.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0a8006f030 0x7f0a8006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0a8006f030 0x7f0a8006f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47248/0 (socket says 172.21.15.139:47248) 2024-09-13T17:26:00.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 -- 172.21.15.139:0/1557031403 learned_addr learned my addr 172.21.15.139:0/1557031403 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:00.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a85000700 1 --2- 172.21.15.139:0/1557031403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a8015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 -- 172.21.15.139:0/1557031403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 msgr2=0x7f0a8015deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:00.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 --2- 172.21.15.139:0/1557031403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a8015deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 -- 172.21.15.139:0/1557031403 >> v1:172.21.15.139:6789/0 conn(0x7f0a80160a20 legacy=0x7f0a80160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 -- 172.21.15.139:0/1557031403 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800a8730 con 0x7f0a8006f030 2024-09-13T17:26:00.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7f400700 1 -- 172.21.15.139:0/1557031403 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198354289 0 0) 0x7f0a8006f9d0 con 0x7f0a80160a20 2024-09-13T17:26:00.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7fe00700 1 --2- 172.21.15.139:0/1557031403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a8006f490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009910 tx=0x7f0a6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a15d231f4e01ded server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:00.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7f400700 1 -- 172.21.15.139:0/1557031403 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011830 con 0x7f0a8006f030 2024-09-13T17:26:00.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7f400700 1 -- 172.21.15.139:0/1557031403 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c011990 con 0x7f0a8006f030 2024-09-13T17:26:00.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a7f400700 1 -- 172.21.15.139:0/1557031403 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011d40 con 0x7f0a8006f030 2024-09-13T17:26:00.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a87a00700 1 -- 172.21.15.139:0/1557031403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 msgr2=0x7f0a8006f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.006+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1557031403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a8006f490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009910 tx=0x7f0a6c009c20 comp rx=0 tx=0).stop 2024-09-13T17:26:00.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 -- 172.21.15.139:0/1557031403 shutdown_connections 2024-09-13T17:26:00.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1557031403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a8006f490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1557031403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a8015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 -- 172.21.15.139:0/1557031403 >> 172.21.15.139:0/1557031403 conn(0x7f0a800720d0 msgr2=0x7f0a800b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:00.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 -- 172.21.15.139:0/1557031403 shutdown_connections 2024-09-13T17:26:00.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 -- 172.21.15.139:0/1557031403 wait complete. 2024-09-13T17:26:00.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 Processor -- start 2024-09-13T17:26:00.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.010+0000 7f0a87a00700 1 -- start start 2024-09-13T17:26:00.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a801f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a80157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a80160a20 0x7f0a8015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015ae70 con 0x7f0a8006f030 2024-09-13T17:26:00.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015a260 con 0x7f0a80160a20 2024-09-13T17:26:00.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015a540 con 0x7f0a800ce6e0 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a801f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a801f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47254/0 (socket says 172.21.15.139:47254) 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 -- 172.21.15.139:0/1283163984 learned_addr learned my addr 172.21.15.139:0/1283163984 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a7fe00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a80157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a80160a20 0x7f0a8015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 -- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 msgr2=0x7f0a80157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a80157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 -- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a80160a20 msgr2=0x7f0a8015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a80160a20 0x7f0a8015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 -- 172.21.15.139:0/1283163984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009570 con 0x7f0a8006f030 2024-09-13T17:26:00.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a85000700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a801f2290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400e9d0 tx=0x7f0a7400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:00.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74009720 con 0x7f0a8006f030 2024-09-13T17:26:00.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7400c850 con 0x7f0a8006f030 2024-09-13T17:26:00.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400cbc0 con 0x7f0a8006f030 2024-09-13T17:26:00.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8015a820 con 0x7f0a8006f030 2024-09-13T17:26:00.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.014+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a80157ff0 con 0x7f0a8006f030 2024-09-13T17:26:00.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.018+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800ceac0 con 0x7f0a8006f030 2024-09-13T17:26:00.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.018+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 10) v1 ==== 86212+0+0 (secure 0 0 0) 0x7f0a7400cd20 con 0x7f0a8006f030 2024-09-13T17:26:00.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.018+0000 7f0a7cc00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f0a600668a0 0x7f0a60068d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.018+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f0a74084650 con 0x7f0a8006f030 2024-09-13T17:26:00.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.022+0000 7f0a7fe00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f0a600668a0 0x7f0a60068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.022+0000 7f0a7fe00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f0a600668a0 0x7f0a60068d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a80159260 tx=0x7f0a6c008030 comp rx=0 tx=0).ready entity=mgr.5093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:00.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.026+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a74051660 con 0x7f0a8006f030 2024-09-13T17:26:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.222+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 --> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a8015e690 con 0x7f0a600668a0 2024-09-13T17:26:00.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.338+0000 7f0a7cc00700 1 -- 172.21.15.139:0/1283163984 <== mgr.5093 v2:172.21.15.139:6832/2501085087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0a6c011c00 con 0x7f0a600668a0 2024-09-13T17:26:00.344 INFO:teuthology.orchestra.run.smithi139.stdout:Schedule removed for path snap_test_dir1 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f0a600668a0 msgr2=0x7f0a60068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f0a600668a0 0x7f0a60068d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a80159260 tx=0x7f0a6c008030 comp rx=0 tx=0).stop 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 msgr2=0x7f0a801f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a801f2290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400e9d0 tx=0x7f0a7400ece0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 shutdown_connections 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f0a600668a0 0x7f0a60068d60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a80160a20 0x7f0a8015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a800ce6e0 0x7f0a80157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 --2- 172.21.15.139:0/1283163984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a8006f030 0x7f0a801f2290 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 >> 172.21.15.139:0/1283163984 conn(0x7f0a800720d0 msgr2=0x7f0a8015f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 shutdown_connections 2024-09-13T17:26:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.342+0000 7f0a87a00700 1 -- 172.21.15.139:0/1283163984 wait complete. 2024-09-13T17:26:00.369 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-09-13T17:26:00.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:00.370 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.customsnapkernel) 2024-09-13T17:26:00.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:00.389 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr:Exception in thread Thread-5: 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr:Traceback (most recent call last): 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr: File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr: self.run() 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr: File "/usr/lib/python3.8/threading.py", line 1254, in run 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr: self.function(*self.args, **self.kwargs) 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr: File "/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py", line 355, in create_scheduled_snapshot 2024-09-13T17:26:00.441 INFO:tasks.ceph.mgr.y.smithi139.stderr: self.prune_snapshots(sched) 2024-09-13T17:26:00.442 INFO:tasks.ceph.mgr.y.smithi139.stderr:UnboundLocalError: local variable 'sched' referenced before assignment 2024-09-13T17:26:00.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-09-13T17:26:00.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.662+0000 7f8d70e00700 1 Processor -- start 2024-09-13T17:26:00.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.662+0000 7f8d70e00700 1 -- start start 2024-09-13T17:26:00.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d70e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d6c144770 0x7f8d6c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d70e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15b1c0 0x7f8d6c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d70e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c15c160 con 0x7f8d6c06d7e0 2024-09-13T17:26:00.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d70e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c06dc90 con 0x7f8d6c144770 2024-09-13T17:26:00.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d70e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c15c540 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d6a800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8d6c06d7e0 0x7f8d6c15e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45306/0 (socket says 172.21.15.139:45306) 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d6a800700 1 -- 172.21.15.139:0/4187997370 learned_addr learned my addr 172.21.15.139:0/4187997370 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69400700 1 --2- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15b1c0 0x7f8d6c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69e00700 1 --2- 172.21.15.139:0/4187997370 >> v2:172.21.15.176:3300/0 conn(0x7f8d6c144770 0x7f8d6c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69e00700 1 -- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15b1c0 msgr2=0x7f8d6c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69e00700 1 --2- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15b1c0 0x7f8d6c06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69e00700 1 -- 172.21.15.139:0/4187997370 >> v1:172.21.15.139:6789/0 conn(0x7f8d6c06d7e0 legacy=0x7f8d6c15e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69e00700 1 -- 172.21.15.139:0/4187997370 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c144b50 con 0x7f8d6c144770 2024-09-13T17:26:00.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.666+0000 7f8d69e00700 1 --2- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c144770 0x7f8d6c0ce5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009850 tx=0x7f8d5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad2ad0b5f730356d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:00.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d68a00700 1 -- 172.21.15.139:0/4187997370 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c011830 con 0x7f8d6c144770 2024-09-13T17:26:00.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d68a00700 1 -- 172.21.15.139:0/4187997370 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c011990 con 0x7f8d6c144770 2024-09-13T17:26:00.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d68a00700 1 -- 172.21.15.139:0/4187997370 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c011d40 con 0x7f8d6c144770 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 -- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c144770 msgr2=0x7f8d6c0ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 --2- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c144770 0x7f8d6c0ce5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009850 tx=0x7f8d5c009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 -- 172.21.15.139:0/4187997370 shutdown_connections 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 --2- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15b1c0 0x7f8d6c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 --2- 172.21.15.139:0/4187997370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c144770 0x7f8d6c0ce5f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 -- 172.21.15.139:0/4187997370 >> 172.21.15.139:0/4187997370 conn(0x7f8d6c06b1e0 msgr2=0x7f8d6c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 -- 172.21.15.139:0/4187997370 shutdown_connections 2024-09-13T17:26:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.670+0000 7f8d70e00700 1 -- 172.21.15.139:0/4187997370 wait complete. 2024-09-13T17:26:00.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 Processor -- start 2024-09-13T17:26:00.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 -- start start 2024-09-13T17:26:00.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c06d7e0 0x7f8d6c0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c144770 0x7f8d6c13cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 0x7f8d6c0715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c071160 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c070550 con 0x7f8d6c06d7e0 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d70e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c070830 con 0x7f8d6c144770 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d6a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 0x7f8d6c0715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d6a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 0x7f8d6c0715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47256/0 (socket says 172.21.15.139:47256) 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d6a800700 1 -- 172.21.15.139:0/2192831270 learned_addr learned my addr 172.21.15.139:0/2192831270 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d69e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c06d7e0 0x7f8d6c0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.674+0000 7f8d69400700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c144770 0x7f8d6c13cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d6a800700 1 -- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c144770 msgr2=0x7f8d6c13cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d6a800700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c144770 0x7f8d6c13cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d6a800700 1 -- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c06d7e0 msgr2=0x7f8d6c0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d6a800700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c06d7e0 0x7f8d6c0adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d6a800700 1 -- 172.21.15.139:0/2192831270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0094b0 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d6a800700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 0x7f8d6c0715f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400ca80 tx=0x7f8d6400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:00.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007480 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d640075e0 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c070b10 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007950 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c0ae1b0 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.678+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c071310 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.682+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 10) v1 ==== 86212+0+0 (secure 0 0 0) 0x7f8d6401b3b0 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.682+0000 7f8d62000700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f8d4c0668d0 0x7f8d4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:00.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.682+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f8d64083c70 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.682+0000 7f8d69e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f8d4c0668d0 0x7f8d4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:00.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.682+0000 7f8d69e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f8d4c0668d0 0x7f8d4c068d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0090b0 tx=0x7f8d5c008030 comp rx=0 tx=0).ready entity=mgr.5093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.686+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d6c071310 con 0x7f8d6c15b1c0 2024-09-13T17:26:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:00.910+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8d6c0cd6b0 con 0x7f8d6c15b1c0 2024-09-13T17:26:01.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.686+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f8d64051100 con 0x7f8d6c15b1c0 2024-09-13T17:26:01.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d62000700 1 -- 172.21.15.139:0/2192831270 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8d6404e310 con 0x7f8d6c15b1c0 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f8d4c0668d0 msgr2=0x7f8d4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f8d4c0668d0 0x7f8d4c068d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0090b0 tx=0x7f8d5c008030 comp rx=0 tx=0).stop 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 msgr2=0x7f8d6c0715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 0x7f8d6c0715f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400ca80 tx=0x7f8d6400cab0 comp rx=0 tx=0).stop 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 shutdown_connections 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f8d4c0668d0 0x7f8d4c068d90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6c15b1c0 0x7f8d6c0715f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c144770 0x7f8d6c13cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 --2- 172.21.15.139:0/2192831270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c06d7e0 0x7f8d6c0adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:01.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 >> 172.21.15.139:0/2192831270 conn(0x7f8d6c06b1e0 msgr2=0x7f8d6c15c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:01.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 shutdown_connections 2024-09-13T17:26:01.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:01.690+0000 7f8d70e00700 1 -- 172.21.15.139:0/2192831270 wait complete. 2024-09-13T17:26:01.715 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:26:01.715 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:26:01.755 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:26:01.791 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:26:01.791 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:26:01.791 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:01.809 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:26:01.810 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:01.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:26:01.896 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:01.891+0000 7fc1e85852c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:26:01.916 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:01.910+0000 7fc01ffaf2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:26:02.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.074+0000 7f14aaa00700 1 Processor -- start 2024-09-13T17:26:02.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.074+0000 7f14aaa00700 1 -- start start 2024-09-13T17:26:02.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14aaa00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a41554d0 0x7f14a406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14aaa00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14a40cf300 0x7f14a406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14aaa00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a406ad70 con 0x7f14a415b2b0 2024-09-13T17:26:02.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14aaa00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a40af210 con 0x7f14a40cf300 2024-09-13T17:26:02.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14aaa00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a415bb70 con 0x7f14a41554d0 2024-09-13T17:26:02.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f14a415b2b0 0x7f14a40cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45332/0 (socket says 172.21.15.139:45332) 2024-09-13T17:26:02.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a8a00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14a40cf300 0x7f14a406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3400700 1 -- 172.21.15.139:0/256464312 learned_addr learned my addr 172.21.15.139:0/256464312 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:02.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3e00700 1 --2- 172.21.15.139:0/256464312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a41554d0 0x7f14a406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a2a00700 1 -- 172.21.15.139:0/256464312 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021982078 0 0) 0x7f14a406ad70 con 0x7f14a415b2b0 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a2a00700 1 -- 172.21.15.139:0/256464312 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14880035d0 con 0x7f14a415b2b0 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3e00700 1 -- 172.21.15.139:0/256464312 >> v2:172.21.15.176:3300/0 conn(0x7f14a40cf300 msgr2=0x7f14a406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3e00700 1 --2- 172.21.15.139:0/256464312 >> v2:172.21.15.176:3300/0 conn(0x7f14a40cf300 0x7f14a406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3e00700 1 -- 172.21.15.139:0/256464312 >> v1:172.21.15.139:6789/0 conn(0x7f14a415b2b0 legacy=0x7f14a40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a3e00700 1 -- 172.21.15.139:0/256464312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a415be50 con 0x7f14a41554d0 2024-09-13T17:26:02.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.078+0000 7f14a8a00700 1 --2- 172.21.15.139:0/256464312 >> v2:172.21.15.176:3300/0 conn(0x7f14a40cf300 0x7f14a406b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:02.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14a3e00700 1 --2- 172.21.15.139:0/256464312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a41554d0 0x7f14a406dd80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1494009850 tx=0x7f1494009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7ca4446e1841da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:02.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14a2a00700 1 -- 172.21.15.139:0/256464312 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494011830 con 0x7f14a41554d0 2024-09-13T17:26:02.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14a2a00700 1 -- 172.21.15.139:0/256464312 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1494011990 con 0x7f14a41554d0 2024-09-13T17:26:02.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14a2a00700 1 -- 172.21.15.139:0/256464312 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494011d40 con 0x7f14a41554d0 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 -- 172.21.15.139:0/256464312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a41554d0 msgr2=0x7f14a406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 --2- 172.21.15.139:0/256464312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a41554d0 0x7f14a406dd80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1494009850 tx=0x7f1494009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 -- 172.21.15.139:0/256464312 shutdown_connections 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 --2- 172.21.15.139:0/256464312 >> v2:172.21.15.176:3300/0 conn(0x7f14a40cf300 0x7f14a406b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 --2- 172.21.15.139:0/256464312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a41554d0 0x7f14a406dd80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 -- 172.21.15.139:0/256464312 >> 172.21.15.139:0/256464312 conn(0x7f14a4071170 msgr2=0x7f14a4071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 -- 172.21.15.139:0/256464312 shutdown_connections 2024-09-13T17:26:02.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.082+0000 7f14aaa00700 1 -- 172.21.15.139:0/256464312 wait complete. 2024-09-13T17:26:02.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.086+0000 7f14aaa00700 1 Processor -- start 2024-09-13T17:26:02.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.086+0000 7f14aaa00700 1 -- start start 2024-09-13T17:26:02.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.086+0000 7f14aaa00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a40cf300 0x7f14a41f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a41554d0 0x7f14a4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 0x7f14a4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4154400 con 0x7f14a415b2b0 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4154660 con 0x7f14a41554d0 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40a8480 con 0x7f14a40cf300 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 0x7f14a4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 0x7f14a4149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47284/0 (socket says 172.21.15.139:47284) 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 -- 172.21.15.139:0/4152198656 learned_addr learned my addr 172.21.15.139:0/4152198656 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a3e00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a40cf300 0x7f14a41f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a3400700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a41554d0 0x7f14a4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 -- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a40cf300 msgr2=0x7f14a41f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a40cf300 0x7f14a41f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 -- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a41554d0 msgr2=0x7f14a4153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a41554d0 0x7f14a4153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 -- 172.21.15.139:0/4152198656 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009a70 con 0x7f14a415b2b0 2024-09-13T17:26:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14a8a00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 0x7f14a4149730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f149c00efc0 tx=0x7f149c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00ca90 con 0x7f14a415b2b0 2024-09-13T17:26:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c00f040 con 0x7f14a415b2b0 2024-09-13T17:26:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14940094b0 con 0x7f14a415b2b0 2024-09-13T17:26:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00ce10 con 0x7f14a415b2b0 2024-09-13T17:26:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a40a8a40 con 0x7f14a415b2b0 2024-09-13T17:26:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.090+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a406dd80 con 0x7f14a415b2b0 2024-09-13T17:26:02.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.094+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f149c014480 con 0x7f14a415b2b0 2024-09-13T17:26:02.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.094+0000 7f149be00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 0x7f1484068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.094+0000 7f14a3e00700 1 -- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 msgr2=0x7f1484068dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:02.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.094+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f149c084dc0 con 0x7f14a415b2b0 2024-09-13T17:26:02.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.094+0000 7f14a3e00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 0x7f1484068dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:02.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.102+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f149c051b50 con 0x7f14a415b2b0 2024-09-13T17:26:02.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.294+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14a40b53d0 con 0x7f14a415b2b0 2024-09-13T17:26:02.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.298+0000 7f14a3e00700 1 -- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 msgr2=0x7f1484068dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:02.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.298+0000 7f14a3e00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 0x7f1484068dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:26:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.298+0000 7f149be00700 1 -- 172.21.15.139:0/4152198656 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17204 (secure 0 0 0) 0x7f149c009d70 con 0x7f14a415b2b0 2024-09-13T17:26:02.303 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:02.303 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":41,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:25:57.627647+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/3153492983":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/1151495076":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/312835695":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6833/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6832/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/2707869445":"2024-09-14T17:25:57.627576+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:26:02.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 msgr2=0x7f1484068dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:02.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 0x7f1484068dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 msgr2=0x7f14a4149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 0x7f14a4149730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f149c00efc0 tx=0x7f149c00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 shutdown_connections 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1484066910 0x7f1484068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14a415b2b0 0x7f14a4149730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14a41554d0 0x7f14a4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 --2- 172.21.15.139:0/4152198656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14a40cf300 0x7f14a41f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 >> 172.21.15.139:0/4152198656 conn(0x7f14a4071170 msgr2=0x7f14a4071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 shutdown_connections 2024-09-13T17:26:02.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.302+0000 7f14aaa00700 1 -- 172.21.15.139:0/4152198656 wait complete. 2024-09-13T17:26:02.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:25:40.803876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:25:42.171875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:26:02.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:26:02.460 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:02.455+0000 7fc1e85852c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:26:02.496 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:02.490+0000 7fc01ffaf2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:26:02.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.542+0000 7f291e400700 1 Processor -- start 2024-09-13T17:26:02.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.542+0000 7f291e400700 1 -- start start 2024-09-13T17:26:02.547 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:02.543+0000 7fc1e85852c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:26:02.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291e400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291e400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f291806cfa0 0x7f291813f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291e400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2918071820 con 0x7f29180b4250 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291e400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2918071b00 con 0x7f291806cfa0 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291e400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2918071de0 con 0x7f29180b3e70 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291d000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291d000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291815a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:51476/0 (socket says 172.21.15.139:51476) 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291d000700 1 -- 172.21.15.139:0/3786696673 learned_addr learned my addr 172.21.15.139:0/3786696673 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917e00700 1 --2- 172.21.15.139:0/3786696673 >> v2:172.21.15.176:3300/0 conn(0x7f291806cfa0 0x7f291813f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917e00700 1 -- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 msgr2=0x7f291815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917e00700 1 --2- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291815a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917e00700 1 -- 172.21.15.139:0/3786696673 >> v1:172.21.15.176:6789/0 conn(0x7f29180b4250 legacy=0x7f291815d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917e00700 1 -- 172.21.15.139:0/3786696673 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180720c0 con 0x7f291806cfa0 2024-09-13T17:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f291d000700 1 --2- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291815a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917e00700 1 --2- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f291813f780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2904009850 tx=0x7f2904009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f26a6f928c8503 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917400700 1 -- 172.21.15.139:0/3786696673 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904004230 con 0x7f291806cfa0 2024-09-13T17:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917400700 1 -- 172.21.15.139:0/3786696673 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904004390 con 0x7f291806cfa0 2024-09-13T17:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.546+0000 7f2917400700 1 -- 172.21.15.139:0/3786696673 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040036c0 con 0x7f291806cfa0 2024-09-13T17:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 -- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 msgr2=0x7f291813f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 --2- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f291813f780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2904009850 tx=0x7f2904009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 -- 172.21.15.139:0/3786696673 shutdown_connections 2024-09-13T17:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 --2- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f291813f780 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 --2- 172.21.15.139:0/3786696673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291815a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 -- 172.21.15.139:0/3786696673 >> 172.21.15.139:0/3786696673 conn(0x7f291806ece0 msgr2=0x7f29180b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:02.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 -- 172.21.15.139:0/3786696673 shutdown_connections 2024-09-13T17:26:02.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.550+0000 7f291e400700 1 -- 172.21.15.139:0/3786696673 wait complete. 2024-09-13T17:26:02.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 Processor -- start 2024-09-13T17:26:02.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 -- start start 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f2918156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291813bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 0x7f291806c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181565c0 con 0x7f29180b4250 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291813d2d0 con 0x7f291806cfa0 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291813c750 con 0x7f29180b3e70 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 0x7f291806c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 0x7f291806c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47288/0 (socket says 172.21.15.139:47288) 2024-09-13T17:26:02.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 -- 172.21.15.139:0/3007666290 learned_addr learned my addr 172.21.15.139:0/3007666290 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:02.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291d000700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f2918156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f2917e00700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291813bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 -- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 msgr2=0x7f291813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291813bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 -- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 msgr2=0x7f2918156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f2918156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 -- 172.21.15.139:0/3007666290 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c009570 con 0x7f29180b4250 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291d000700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f2918156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291da00700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 0x7f291806c240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f291000cc40 tx=0x7f291000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000aba0 con 0x7f29180b4250 2024-09-13T17:26:02.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000ad00 con 0x7f29180b4250 2024-09-13T17:26:02.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910012660 con 0x7f29180b4250 2024-09-13T17:26:02.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29040094b0 con 0x7f29180b4250 2024-09-13T17:26:02.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.554+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291813cd10 con 0x7f29180b4250 2024-09-13T17:26:02.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.558+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291815a8d0 con 0x7f29180b4250 2024-09-13T17:26:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.558+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f29100127c0 con 0x7f29180b4250 2024-09-13T17:26:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.562+0000 7f2914c00700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f28f80668e0 0x7f28f8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.562+0000 7f291d000700 1 -- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f28f80668e0 msgr2=0x7f28f8068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.562+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f2910084ed0 con 0x7f29180b4250 2024-09-13T17:26:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.562+0000 7f291d000700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f28f80668e0 0x7f28f8068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:02.571 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:02.566+0000 7fc01ffaf2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:26:02.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.570+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2910051ce0 con 0x7f29180b4250 2024-09-13T17:26:02.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.750+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29180b35a0 con 0x7f29180b4250 2024-09-13T17:26:02.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.750+0000 7f2914c00700 1 -- 172.21.15.139:0/3007666290 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2910016020 con 0x7f29180b4250 2024-09-13T17:26:02.756 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:26:02.756 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:02.751+0000 7fc1e85852c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:26:02.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f28f80668e0 msgr2=0x7f28f8068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:02.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f28f80668e0 0x7f28f8068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 msgr2=0x7f291806c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 0x7f291806c240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f291000cc40 tx=0x7f291000a060 comp rx=0 tx=0).stop 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 shutdown_connections 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f28f80668e0 0x7f28f8068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29180b4250 0x7f291806c240 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29180b3e70 0x7f291813bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 --2- 172.21.15.139:0/3007666290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291806cfa0 0x7f2918156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 >> 172.21.15.139:0/3007666290 conn(0x7f291806ece0 msgr2=0x7f291813ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 shutdown_connections 2024-09-13T17:26:02.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.754+0000 7f291e400700 1 -- 172.21.15.139:0/3007666290 wait complete. 2024-09-13T17:26:02.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:26:02.787 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:02.782+0000 7fc01ffaf2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:26:02.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.938+0000 7f7edc600700 1 Processor -- start 2024-09-13T17:26:02.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.938+0000 7f7edc600700 1 -- start start 2024-09-13T17:26:02.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7ed406d9b0 0x7f7ed40706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7ed4162550 0x7f7ed4070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed40cb580 con 0x7f7ed40702c0 2024-09-13T17:26:02.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed4071e30 con 0x7f7ed4162550 2024-09-13T17:26:02.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed40712b0 con 0x7f7ed406d9b0 2024-09-13T17:26:02.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7ed4162550 0x7f7ed4070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7ed4162550 0x7f7ed4070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47298/0 (socket says 172.21.15.139:47298) 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 -- 172.21.15.139:0/2716047944 learned_addr learned my addr 172.21.15.139:0/2716047944 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 -- 172.21.15.139:0/2716047944 >> v2:172.21.15.176:3300/0 conn(0x7f7ed406d9b0 msgr2=0x7f7ed40706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7ed9200700 1 --2- 172.21.15.139:0/2716047944 >> v2:172.21.15.176:3300/0 conn(0x7f7ed406d9b0 0x7f7ed40706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 --2- 172.21.15.139:0/2716047944 >> v2:172.21.15.176:3300/0 conn(0x7f7ed406d9b0 0x7f7ed40706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 -- 172.21.15.139:0/2716047944 >> v1:172.21.15.139:6789/0 conn(0x7f7ed40702c0 legacy=0x7f7ed406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 -- 172.21.15.139:0/2716047944 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4071590 con 0x7f7ed4162550 2024-09-13T17:26:02.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7ed9200700 1 --2- 172.21.15.139:0/2716047944 >> v2:172.21.15.176:3300/0 conn(0x7f7ed406d9b0 0x7f7ed40706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:02.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7eda600700 1 --2- 172.21.15.139:0/2716047944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed4070be0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40726d0 tx=0x7f7ecc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51cc3cef28743fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:02.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7ed3e00700 1 -- 172.21.15.139:0/2716047944 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc00e070 con 0x7f7ed4162550 2024-09-13T17:26:02.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7ed3e00700 1 -- 172.21.15.139:0/2716047944 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc003a40 con 0x7f7ed4162550 2024-09-13T17:26:02.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7ed3e00700 1 -- 172.21.15.139:0/2716047944 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc003df0 con 0x7f7ed4162550 2024-09-13T17:26:02.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 -- 172.21.15.139:0/2716047944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 msgr2=0x7f7ed4070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.942+0000 7f7edc600700 1 --2- 172.21.15.139:0/2716047944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed4070be0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40726d0 tx=0x7f7ecc00b330 comp rx=0 tx=0).stop 2024-09-13T17:26:02.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 -- 172.21.15.139:0/2716047944 shutdown_connections 2024-09-13T17:26:02.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 --2- 172.21.15.139:0/2716047944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed4070be0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 --2- 172.21.15.139:0/2716047944 >> v2:172.21.15.176:3300/0 conn(0x7f7ed406d9b0 0x7f7ed40706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 -- 172.21.15.139:0/2716047944 >> 172.21.15.139:0/2716047944 conn(0x7f7ed406b1e0 msgr2=0x7f7ed406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:02.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 -- 172.21.15.139:0/2716047944 shutdown_connections 2024-09-13T17:26:02.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 -- 172.21.15.139:0/2716047944 wait complete. 2024-09-13T17:26:02.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 Processor -- start 2024-09-13T17:26:02.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.946+0000 7f7edc600700 1 -- start start 2024-09-13T17:26:02.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ed406d9b0 0x7f7ed4143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ed40702c0 0x7f7ed415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed415de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40cc6a0 con 0x7f7ed4162550 2024-09-13T17:26:02.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40a8760 con 0x7f7ed406d9b0 2024-09-13T17:26:02.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40cc390 con 0x7f7ed40702c0 2024-09-13T17:26:02.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed415de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47306/0 (socket says 172.21.15.139:47306) 2024-09-13T17:26:02.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 -- 172.21.15.139:0/3246177129 learned_addr learned my addr 172.21.15.139:0/3246177129 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:02.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7ed9c00700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ed406d9b0 0x7f7ed4143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7ed9200700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ed40702c0 0x7f7ed415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 -- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ed40702c0 msgr2=0x7f7ed415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ed40702c0 0x7f7ed415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 -- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ed406d9b0 msgr2=0x7f7ed4143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ed406d9b0 0x7f7ed4143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 -- 172.21.15.139:0/3246177129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc009b30 con 0x7f7ed4162550 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7ed9200700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ed40702c0 0x7f7ed415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7eda600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed415de40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc015040 tx=0x7f7ecc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:02.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc004440 con 0x7f7ed4162550 2024-09-13T17:26:02.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0045a0 con 0x7f7ed4162550 2024-09-13T17:26:02.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed41f6750 con 0x7f7ed4162550 2024-09-13T17:26:02.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc004950 con 0x7f7ed4162550 2024-09-13T17:26:02.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.950+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed415c980 con 0x7f7ed4162550 2024-09-13T17:26:02.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.954+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4073160 con 0x7f7ed4162550 2024-09-13T17:26:02.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.954+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f7ecc012430 con 0x7f7ed4162550 2024-09-13T17:26:02.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.954+0000 7f7ed1600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7eb40668e0 0x7f7eb4068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:02.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.954+0000 7f7ed9c00700 1 -- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7eb40668e0 msgr2=0x7f7eb4068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:02.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.954+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f7ecc085a60 con 0x7f7ed4162550 2024-09-13T17:26:02.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.954+0000 7f7ed9c00700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7eb40668e0 0x7f7eb4068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:02.962+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ecc052910 con 0x7f7ed4162550 2024-09-13T17:26:03.021 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:03.019+0000 7fc1e85852c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:26:03.068 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:03.062+0000 7fc01ffaf2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:26:03.102 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:03.099+0000 7fc1e85852c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:26:03.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.142+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ed406d2a0 con 0x7f7ed4162550 2024-09-13T17:26:03.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7ed1600700 1 -- 172.21.15.139:0/3246177129 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ecc017020 con 0x7f7ed4162550 2024-09-13T17:26:03.149 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:26:03.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7eb40668e0 msgr2=0x7f7eb4068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7eb40668e0 0x7f7eb4068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 msgr2=0x7f7ed415de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed415de40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc015040 tx=0x7f7ecc004af0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 shutdown_connections 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7eb40668e0 0x7f7eb4068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed4162550 0x7f7ed415de40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ed40702c0 0x7f7ed415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 --2- 172.21.15.139:0/3246177129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ed406d9b0 0x7f7ed4143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 >> 172.21.15.139:0/3246177129 conn(0x7f7ed406b1e0 msgr2=0x7f7ed406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 shutdown_connections 2024-09-13T17:26:03.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.146+0000 7f7edc600700 1 -- 172.21.15.139:0/3246177129 wait complete. 2024-09-13T17:26:03.155 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:03.150+0000 7fc01ffaf2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:26:03.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:26:03.330 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:03.327+0000 7fc1e85852c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:26:03.381 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:03.374+0000 7fc01ffaf2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:26:03.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 Processor -- start 2024-09-13T17:26:03.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 -- start start 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff04c15cc00 0x7ff04c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c0adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0cd160 con 0x7ff04c0b2b70 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c0ae100 con 0x7ff04c15cc00 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0aceb0 con 0x7ff04c06fe10 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff04c0b2b70 0x7ff04c0cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45356/0 (socket says 172.21.15.139:45356) 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff052400700 1 -- 172.21.15.139:0/2913628131 learned_addr learned my addr 172.21.15.139:0/2913628131 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff051a00700 1 --2- 172.21.15.139:0/2913628131 >> v2:172.21.15.139:3300/0 conn(0x7ff04c15cc00 0x7ff04c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff051000700 1 --2- 172.21.15.139:0/2913628131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c0adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff051000700 1 -- 172.21.15.139:0/2913628131 >> v2:172.21.15.139:3300/0 conn(0x7ff04c15cc00 msgr2=0x7ff04c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff051000700 1 --2- 172.21.15.139:0/2913628131 >> v2:172.21.15.139:3300/0 conn(0x7ff04c15cc00 0x7ff04c0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff051000700 1 -- 172.21.15.139:0/2913628131 >> v1:172.21.15.139:6789/0 conn(0x7ff04c0b2b70 legacy=0x7ff04c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff051000700 1 -- 172.21.15.139:0/2913628131 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0ad190 con 0x7ff04c06fe10 2024-09-13T17:26:03.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.386+0000 7ff04be00700 1 -- 172.21.15.139:0/2913628131 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841213470 0 0) 0x7ff04c0cd160 con 0x7ff04c0b2b70 2024-09-13T17:26:03.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff051000700 1 --2- 172.21.15.139:0/2913628131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c0adbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff038009850 tx=0x7ff038009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ab49668c1613b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff04be00700 1 -- 172.21.15.139:0/2913628131 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011830 con 0x7ff04c06fe10 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff04be00700 1 -- 172.21.15.139:0/2913628131 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038011990 con 0x7ff04c06fe10 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff04be00700 1 -- 172.21.15.139:0/2913628131 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011d40 con 0x7ff04c06fe10 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 -- 172.21.15.139:0/2913628131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 msgr2=0x7ff04c0adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 --2- 172.21.15.139:0/2913628131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c0adbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff038009850 tx=0x7ff038009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 -- 172.21.15.139:0/2913628131 shutdown_connections 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 --2- 172.21.15.139:0/2913628131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c0adbc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 --2- 172.21.15.139:0/2913628131 >> v2:172.21.15.139:3300/0 conn(0x7ff04c15cc00 0x7ff04c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 -- 172.21.15.139:0/2913628131 >> 172.21.15.139:0/2913628131 conn(0x7ff04c0ce9d0 msgr2=0x7ff04c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 -- 172.21.15.139:0/2913628131 shutdown_connections 2024-09-13T17:26:03.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.390+0000 7ff052e00700 1 -- 172.21.15.139:0/2913628131 wait complete. 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 Processor -- start 2024-09-13T17:26:03.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 -- start start 2024-09-13T17:26:03.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff04c0b2b70 0x7ff04c06ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 0x7ff04c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1f2200 con 0x7ff04c15cc00 2024-09-13T17:26:03.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c06d880 con 0x7ff04c0b2b70 2024-09-13T17:26:03.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c06b240 con 0x7ff04c06fe10 2024-09-13T17:26:03.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 0x7ff04c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff051a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 0x7ff04c146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47316/0 (socket says 172.21.15.139:47316) 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052400700 1 -- 172.21.15.139:0/840804767 learned_addr learned my addr 172.21.15.139:0/840804767 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff051000700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff04c0b2b70 0x7ff04c06ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052400700 1 -- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 msgr2=0x7ff04c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.394+0000 7ff052400700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052400700 1 -- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff04c0b2b70 msgr2=0x7ff04c06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052400700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff04c0b2b70 0x7ff04c06ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052400700 1 -- 172.21.15.139:0/840804767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380094b0 con 0x7ff04c15cc00 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff051a00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:03.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052400700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 0x7ff04c146530 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff044002230 tx=0x7ff04400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400aac0 con 0x7ff04c15cc00 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04400ac40 con 0x7ff04c15cc00 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c143e00 con 0x7ff04c15cc00 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440070d0 con 0x7ff04c15cc00 2024-09-13T17:26:03.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c1443c0 con 0x7ff04c15cc00 2024-09-13T17:26:03.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.398+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c0adbc0 con 0x7ff04c15cc00 2024-09-13T17:26:03.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.402+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7ff044007250 con 0x7ff04c15cc00 2024-09-13T17:26:03.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.402+0000 7ff049600700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7ff02c0668e0 0x7ff02c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.402+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7ff044084460 con 0x7ff04c15cc00 2024-09-13T17:26:03.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.402+0000 7ff051a00700 1 -- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7ff02c0668e0 msgr2=0x7ff02c068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:03.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.402+0000 7ff051a00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7ff02c0668e0 0x7ff02c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:03.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.410+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff044051310 con 0x7ff04c15cc00 2024-09-13T17:26:03.419 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:03.415+0000 7fc1e85852c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:26:03.477 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:03.474+0000 7fc01ffaf2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:26:03.512 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:03.507+0000 7fc1e85852c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:26:03.575 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:03.570+0000 7fc01ffaf2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:26:03.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.590+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff04c070350 con 0x7ff04c15cc00 2024-09-13T17:26:03.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.590+0000 7ff049600700 1 -- 172.21.15.139:0/840804767 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff044054930 con 0x7ff04c15cc00 2024-09-13T17:26:03.596 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7ff02c0668e0 msgr2=0x7ff02c068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7ff02c0668e0 0x7ff02c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 msgr2=0x7ff04c146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 0x7ff04c146530 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff044002230 tx=0x7ff04400cf50 comp rx=0 tx=0).stop 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 shutdown_connections 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7ff02c0668e0 0x7ff02c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff04c15cc00 0x7ff04c146530 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff04c0b2b70 0x7ff04c06ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 --2- 172.21.15.139:0/840804767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff04c06fe10 0x7ff04c06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 >> 172.21.15.139:0/840804767 conn(0x7ff04c0ce9d0 msgr2=0x7ff04c070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 shutdown_connections 2024-09-13T17:26:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.594+0000 7ff052e00700 1 -- 172.21.15.139:0/840804767 wait complete. 2024-09-13T17:26:03.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:26:03.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.786+0000 7f4b63400700 1 Processor -- start 2024-09-13T17:26:03.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.786+0000 7f4b63400700 1 -- start start 2024-09-13T17:26:03.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b63400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b5c06d2a0 0x7f4b5c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b63400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b5c072120 0x7f4b5c070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b63400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c159f10 0x7f4b5c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b63400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cd860 con 0x7f4b5c06d2a0 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b63400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c06dbc0 con 0x7f4b5c072120 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b63400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cb840 con 0x7f4b5c159f10 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b5c06d2a0 0x7f4b5c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b5be00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b5c072120 0x7f4b5c070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b5c06d2a0 0x7f4b5c06d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47320/0 (socket says 172.21.15.139:47320) 2024-09-13T17:26:03.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 -- 172.21.15.139:0/2205067769 learned_addr learned my addr 172.21.15.139:0/2205067769 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:03.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b61400700 1 --2- 172.21.15.139:0/2205067769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c159f10 0x7f4b5c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 -- 172.21.15.139:0/2205067769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c159f10 msgr2=0x7f4b5c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 --2- 172.21.15.139:0/2205067769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c159f10 0x7f4b5c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 -- 172.21.15.139:0/2205067769 >> v2:172.21.15.176:3300/0 conn(0x7f4b5c072120 msgr2=0x7f4b5c070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:03.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 --2- 172.21.15.139:0/2205067769 >> v2:172.21.15.176:3300/0 conn(0x7f4b5c072120 0x7f4b5c070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 -- 172.21.15.139:0/2205067769 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0cbb20 con 0x7f4b5c06d2a0 2024-09-13T17:26:03.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b5be00700 1 --2- 172.21.15.139:0/2205067769 >> v2:172.21.15.176:3300/0 conn(0x7f4b5c072120 0x7f4b5c070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:03.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b60a00700 1 --2- 172.21.15.139:0/2205067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c06d2a0 0x7f4b5c06d680 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c06bf10 tx=0x7f4b50009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e4a5a0b4da502f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b5b400700 1 -- 172.21.15.139:0/2205067769 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011830 con 0x7f4b5c06d2a0 2024-09-13T17:26:03.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b5b400700 1 -- 172.21.15.139:0/2205067769 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50011990 con 0x7f4b5c06d2a0 2024-09-13T17:26:03.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.790+0000 7f4b5b400700 1 -- 172.21.15.139:0/2205067769 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011d20 con 0x7f4b5c06d2a0 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 -- 172.21.15.139:0/2205067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c06d2a0 msgr2=0x7f4b5c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 --2- 172.21.15.139:0/2205067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c06d2a0 0x7f4b5c06d680 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c06bf10 tx=0x7f4b50009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 -- 172.21.15.139:0/2205067769 shutdown_connections 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 --2- 172.21.15.139:0/2205067769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c159f10 0x7f4b5c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 --2- 172.21.15.139:0/2205067769 >> v2:172.21.15.176:3300/0 conn(0x7f4b5c072120 0x7f4b5c070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 --2- 172.21.15.139:0/2205067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c06d2a0 0x7f4b5c06d680 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 -- 172.21.15.139:0/2205067769 >> 172.21.15.139:0/2205067769 conn(0x7f4b5c06b1e0 msgr2=0x7f4b5c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:03.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 -- 172.21.15.139:0/2205067769 shutdown_connections 2024-09-13T17:26:03.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.794+0000 7f4b63400700 1 -- 172.21.15.139:0/2205067769 wait complete. 2024-09-13T17:26:03.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 Processor -- start 2024-09-13T17:26:03.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 -- start start 2024-09-13T17:26:03.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c06d2a0 0x7f4b5c0aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b5c072120 0x7f4b5c0a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 0x7f4b5c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0a8f40 con 0x7f4b5c159f10 2024-09-13T17:26:03.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0a8950 con 0x7f4b5c072120 2024-09-13T17:26:03.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b63400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0aa410 con 0x7f4b5c06d2a0 2024-09-13T17:26:03.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 0x7f4b5c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b60a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c06d2a0 0x7f4b5c0aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 0x7f4b5c0a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47332/0 (socket says 172.21.15.139:47332) 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 -- 172.21.15.139:0/3844666039 learned_addr learned my addr 172.21.15.139:0/3844666039 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b5be00700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b5c072120 0x7f4b5c0a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 -- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c06d2a0 msgr2=0x7f4b5c0aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c06d2a0 0x7f4b5c0aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 -- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b5c072120 msgr2=0x7f4b5c0a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b5c072120 0x7f4b5c0a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 -- 172.21.15.139:0/3844666039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480094b0 con 0x7f4b5c159f10 2024-09-13T17:26:03.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.798+0000 7f4b61400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 0x7f4b5c0a9ed0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400efc0 tx=0x7f4b5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:03.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54009ea0 con 0x7f4b5c159f10 2024-09-13T17:26:03.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400f040 con 0x7f4b5c159f10 2024-09-13T17:26:03.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b50009570 con 0x7f4b5c159f10 2024-09-13T17:26:03.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400ced0 con 0x7f4b5c159f10 2024-09-13T17:26:03.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c157b20 con 0x7f4b5c159f10 2024-09-13T17:26:03.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c0a9080 con 0x7f4b5c159f10 2024-09-13T17:26:03.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.802+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f4b54014480 con 0x7f4b5c159f10 2024-09-13T17:26:03.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.806+0000 7f4b58c00700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f4b3c0668e0 0x7f4b3c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:03.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.806+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f4b540852a0 con 0x7f4b5c159f10 2024-09-13T17:26:03.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.806+0000 7f4b60a00700 1 -- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f4b3c0668e0 msgr2=0x7f4b3c068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:03.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.806+0000 7f4b60a00700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f4b3c0668e0 0x7f4b3c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:03.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:03.814+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b5c0a9080 con 0x7f4b5c159f10 2024-09-13T17:26:03.924 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:03.919+0000 7fc1e85852c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:26:03.984 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:03.978+0000 7fc01ffaf2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:26:04.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.002+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b5c0a9080 con 0x7f4b5c159f10 2024-09-13T17:26:04.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.002+0000 7f4b58c00700 1 -- 172.21.15.139:0/3844666039 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v41) v1 ==== 80+0+359 (secure 0 0 0) 0x7f4b5c0a9080 con 0x7f4b5c159f10 2024-09-13T17:26:04.009 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3153492983 2024-09-14T17:25:57.627576+0000 2024-09-13T17:26:04.009 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1151495076 2024-09-14T17:25:57.627576+0000 2024-09-13T17:26:04.009 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/312835695 2024-09-14T17:25:57.627576+0000 2024-09-13T17:26:04.009 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6833/3612810800 2024-09-14T17:25:57.627576+0000 2024-09-13T17:26:04.009 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6832/3612810800 2024-09-14T17:25:57.627576+0000 2024-09-13T17:26:04.009 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/2707869445 2024-09-14T17:25:57.627576+0000 2024-09-13T17:26:04.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.006+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f4b3c0668e0 msgr2=0x7f4b3c068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:04.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.006+0000 7f4b63400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f4b3c0668e0 0x7f4b3c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.006+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 msgr2=0x7f4b5c0a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.006+0000 7f4b63400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 0x7f4b5c0a9ed0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400efc0 tx=0x7f4b5400c3a0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 shutdown_connections 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f4b3c0668e0 0x7f4b3c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b5c159f10 0x7f4b5c0a9ed0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b5c072120 0x7f4b5c0a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 --2- 172.21.15.139:0/3844666039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b5c06d2a0 0x7f4b5c0aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 >> 172.21.15.139:0/3844666039 conn(0x7f4b5c06b1e0 msgr2=0x7f4b5c0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 shutdown_connections 2024-09-13T17:26:04.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.010+0000 7f4b63400700 1 -- 172.21.15.139:0/3844666039 wait complete. 2024-09-13T17:26:04.015 INFO:teuthology.orchestra.run.smithi139.stderr:listed 6 entries 2024-09-13T17:26:04.036 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:26:04.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:04.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T17:26:04.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:26:04.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:04.090 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:26:04.092 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:04.087+0000 7fc1e85852c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:26:04.104 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:26:04.104 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:04.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346852k,nr_inodes=4086713,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:26:04.119 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:26:04.119 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:04.165 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:04.162+0000 7fc01ffaf2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:26:04.167 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346792k,nr_inodes=4086698,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:26:04.167 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:26:04.167 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:04.187 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346852k,nr_inodes=4086713,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:26:04.187 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:04.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.362+0000 7fb5cf000700 1 Processor -- start 2024-09-13T17:26:04.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.362+0000 7fb5cf000700 1 -- start start 2024-09-13T17:26:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cf000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5c8071570 0x7fb5c815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cf000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5c813f810 0x7fb5c813fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cf000700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c813f0c0 con 0x7fb5c8071190 2024-09-13T17:26:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cf000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c815a720 con 0x7fb5c8071570 2024-09-13T17:26:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cf000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c815aa00 con 0x7fb5c813f810 2024-09-13T17:26:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5c8071570 0x7fb5c815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5c8071570 0x7fb5c815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47338/0 (socket says 172.21.15.139:47338) 2024-09-13T17:26:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 -- 172.21.15.139:0/903068217 learned_addr learned my addr 172.21.15.139:0/903068217 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5ce600700 1 --2- 172.21.15.139:0/903068217 >> v2:172.21.15.176:3300/0 conn(0x7fb5c813f810 0x7fb5c813fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 -- 172.21.15.139:0/903068217 >> v2:172.21.15.176:3300/0 conn(0x7fb5c813f810 msgr2=0x7fb5c813fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:04.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 --2- 172.21.15.139:0/903068217 >> v2:172.21.15.176:3300/0 conn(0x7fb5c813f810 0x7fb5c813fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 -- 172.21.15.139:0/903068217 >> v1:172.21.15.176:6789/0 conn(0x7fb5c8071190 legacy=0x7fb5c8159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 -- 172.21.15.139:0/903068217 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c815ace0 con 0x7fb5c8071570 2024-09-13T17:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.366+0000 7fb5cd200700 1 --2- 172.21.15.139:0/903068217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c815dfd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb5c813ced0 tx=0x7fb5b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611ddf3adbdf2245 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5c7e00700 1 -- 172.21.15.139:0/903068217 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011830 con 0x7fb5c8071570 2024-09-13T17:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5c7e00700 1 -- 172.21.15.139:0/903068217 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b8011990 con 0x7fb5c8071570 2024-09-13T17:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5c7e00700 1 -- 172.21.15.139:0/903068217 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011d20 con 0x7fb5c8071570 2024-09-13T17:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 -- 172.21.15.139:0/903068217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 msgr2=0x7fb5c815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 --2- 172.21.15.139:0/903068217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c815dfd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb5c813ced0 tx=0x7fb5b8009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 -- 172.21.15.139:0/903068217 shutdown_connections 2024-09-13T17:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 --2- 172.21.15.139:0/903068217 >> v2:172.21.15.176:3300/0 conn(0x7fb5c813f810 0x7fb5c813fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 --2- 172.21.15.139:0/903068217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c815dfd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 -- 172.21.15.139:0/903068217 >> 172.21.15.139:0/903068217 conn(0x7fb5c80ce9d0 msgr2=0x7fb5c80cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 -- 172.21.15.139:0/903068217 shutdown_connections 2024-09-13T17:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.370+0000 7fb5cf000700 1 -- 172.21.15.139:0/903068217 wait complete. 2024-09-13T17:26:04.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 Processor -- start 2024-09-13T17:26:04.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 -- start start 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5c8071190 0x7fb5c8141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c81f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5c813f810 0x7fb5c8140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c81f61e0 con 0x7fb5c8071570 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c81f64c0 con 0x7fb5c8071190 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c81f67a0 con 0x7fb5c813f810 2024-09-13T17:26:04.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c81f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c81f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47342/0 (socket says 172.21.15.139:47342) 2024-09-13T17:26:04.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 -- 172.21.15.139:0/1799915524 learned_addr learned my addr 172.21.15.139:0/1799915524 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cdc00700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5c8071190 0x7fb5c8141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5ce600700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5c813f810 0x7fb5c8140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 -- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5c813f810 msgr2=0x7fb5c8140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5c813f810 0x7fb5c8140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 -- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5c8071190 msgr2=0x7fb5c8141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5c8071190 0x7fb5c8141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 -- 172.21.15.139:0/1799915524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8009570 con 0x7fb5c8071570 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5ce600700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5c813f810 0x7fb5c8140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cd200700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c81f1fd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80cdc20 tx=0x7fb5b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:04.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8004550 con 0x7fb5c8071570 2024-09-13T17:26:04.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b801f070 con 0x7fb5c8071570 2024-09-13T17:26:04.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c81f6a80 con 0x7fb5c8071570 2024-09-13T17:26:04.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.374+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8003900 con 0x7fb5c8071570 2024-09-13T17:26:04.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.378+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c81f2510 con 0x7fb5c8071570 2024-09-13T17:26:04.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.378+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c813d6f0 con 0x7fb5c8071570 2024-09-13T17:26:04.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.378+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7fb5b8003a60 con 0x7fb5c8071570 2024-09-13T17:26:04.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.378+0000 7fb5c5600700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 0x7fb5ac068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.382+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7fb5b8021070 con 0x7fb5c8071570 2024-09-13T17:26:04.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.382+0000 7fb5cdc00700 1 -- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 msgr2=0x7fb5ac068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:04.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.382+0000 7fb5cdc00700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 0x7fb5ac068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:04.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.386+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5b8052b20 con 0x7fb5c8071570 2024-09-13T17:26:04.496 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:04.491+0000 7fc1e85852c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:26:04.570 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:04.565+0000 7fc01ffaf2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:26:04.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.585+0000 7fb5cdc00700 1 -- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 msgr2=0x7fb5ac068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:04.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.585+0000 7fb5cdc00700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 0x7fb5ac068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:26:04.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.613+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c81f6c70 con 0x7fb5c8071570 2024-09-13T17:26:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5c5600700 1 -- 172.21.15.139:0/1799915524 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fb5b8015090 con 0x7fb5c8071570 2024-09-13T17:26:04.621 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:04.621 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:25:43.178317+0000","modified":"2024-09-13T17:25:46.195947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6833/501919372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":501919372},{"type":"v1","addr":"172.21.15.176:6833","nonce":501919372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:26:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 msgr2=0x7fb5ac068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 0x7fb5ac068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 msgr2=0x7fb5c81f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c81f1fd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80cdc20 tx=0x7fb5b8004770 comp rx=0 tx=0).stop 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 shutdown_connections 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fb5ac0668e0 0x7fb5ac068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5c813f810 0x7fb5c8140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5c8071570 0x7fb5c81f1fd0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 --2- 172.21.15.139:0/1799915524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5c8071190 0x7fb5c8141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 >> 172.21.15.139:0/1799915524 conn(0x7fb5c80ce9d0 msgr2=0x7fb5c813e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 shutdown_connections 2024-09-13T17:26:04.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.617+0000 7fb5cf000700 1 -- 172.21.15.139:0/1799915524 wait complete. 2024-09-13T17:26:04.626 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2024-09-13T17:26:04.644 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:26:04.743 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:04.739+0000 7fc1e85852c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:26:04.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.797+0000 7fdcab200700 1 Processor -- start 2024-09-13T17:26:04.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 -- start start 2024-09-13T17:26:04.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdcac146850 0x7fdcac0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac15e4d0 0x7fdcac0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdcac0ca1b0 0x7fdcac0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac15e0b0 con 0x7fdcac146850 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0ced90 con 0x7fdcac0ca1b0 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcab200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0ce440 con 0x7fdcac15e4d0 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdcac146850 0x7fdcac0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdcac146850 0x7fdcac0cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34620/0 (socket says 172.21.15.139:34620) 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 -- 172.21.15.139:0/2125249550 learned_addr learned my addr 172.21.15.139:0/2125249550 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9400700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac15e4d0 0x7fdcac0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdcaa800700 1 --2- 172.21.15.139:0/2125249550 >> v2:172.21.15.176:3300/0 conn(0x7fdcac0ca1b0 0x7fdcac0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 -- 172.21.15.139:0/2125249550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac15e4d0 msgr2=0x7fdcac0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac15e4d0 0x7fdcac0d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 -- 172.21.15.139:0/2125249550 >> v2:172.21.15.176:3300/0 conn(0x7fdcac0ca1b0 msgr2=0x7fdcac0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 --2- 172.21.15.139:0/2125249550 >> v2:172.21.15.176:3300/0 conn(0x7fdcac0ca1b0 0x7fdcac0d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 -- 172.21.15.139:0/2125249550 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0ca760 con 0x7fdcac146850 2024-09-13T17:26:04.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9400700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac15e4d0 0x7fdcac0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:04.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca9e00700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac146850 0x7fdcac0cdf00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b27c0 tx=0x7fdc9c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8983df0c3b80bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:04.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.801+0000 7fdca8a00700 1 -- 172.21.15.139:0/2125249550 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c011830 con 0x7fdcac146850 2024-09-13T17:26:04.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdca8a00700 1 -- 172.21.15.139:0/2125249550 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c011990 con 0x7fdcac146850 2024-09-13T17:26:04.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdca8a00700 1 -- 172.21.15.139:0/2125249550 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c011d20 con 0x7fdcac146850 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 -- 172.21.15.139:0/2125249550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac146850 msgr2=0x7fdcac0cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac146850 0x7fdcac0cdf00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b27c0 tx=0x7fdc9c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 -- 172.21.15.139:0/2125249550 shutdown_connections 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 --2- 172.21.15.139:0/2125249550 >> v2:172.21.15.176:3300/0 conn(0x7fdcac0ca1b0 0x7fdcac0d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac15e4d0 0x7fdcac0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 --2- 172.21.15.139:0/2125249550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac146850 0x7fdcac0cdf00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 -- 172.21.15.139:0/2125249550 >> 172.21.15.139:0/2125249550 conn(0x7fdcac0721a0 msgr2=0x7fdcac06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 -- 172.21.15.139:0/2125249550 shutdown_connections 2024-09-13T17:26:04.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 -- 172.21.15.139:0/2125249550 wait complete. 2024-09-13T17:26:04.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 Processor -- start 2024-09-13T17:26:04.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.805+0000 7fdcab200700 1 -- start start 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac0ca1b0 0x7fdcac13f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcac146850 0x7fdcac1efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 0x7fdcac1f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1f0320 con 0x7fdcac15e4d0 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac13f8a0 con 0x7fdcac146850 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac13fb80 con 0x7fdcac0ca1b0 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 0x7fdcac1f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 0x7fdcac1f32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34636/0 (socket says 172.21.15.139:34636) 2024-09-13T17:26:04.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 -- 172.21.15.139:0/3566843291 learned_addr learned my addr 172.21.15.139:0/3566843291 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:04.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdca9400700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcac146850 0x7fdcac1efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdca9e00700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac0ca1b0 0x7fdcac13f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:04.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 -- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac0ca1b0 msgr2=0x7fdcac13f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac0ca1b0 0x7fdcac13f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 -- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcac146850 msgr2=0x7fdcac1efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcac146850 0x7fdcac1efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 -- 172.21.15.139:0/3566843291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980094b0 con 0x7fdcac15e4d0 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcaa800700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 0x7fdcac1f32b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdca400eed0 tx=0x7fdca400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4010040 con 0x7fdcac15e4d0 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400bc80 con 0x7fdcac15e4d0 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c009570 con 0x7fdcac15e4d0 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4009e40 con 0x7fdcac15e4d0 2024-09-13T17:26:04.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac1f2d90 con 0x7fdcac15e4d0 2024-09-13T17:26:04.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.809+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac1f2910 con 0x7fdcac15e4d0 2024-09-13T17:26:04.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.813+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7fdca4014400 con 0x7fdcac15e4d0 2024-09-13T17:26:04.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.813+0000 7fdca2000700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fdc8c0668e0 0x7fdc8c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:04.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.813+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7fdca4084b60 con 0x7fdcac15e4d0 2024-09-13T17:26:04.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.813+0000 7fdca9e00700 1 -- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fdc8c0668e0 msgr2=0x7fdc8c068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:04.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.813+0000 7fdca9e00700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fdc8c0668e0 0x7fdc8c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:04.823 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:04.817+0000 7fc01ffaf2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:26:04.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:04.821+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdcac1f2910 con 0x7fdcac15e4d0 2024-09-13T17:26:04.838 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:04.835+0000 7fc1e85852c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:26:04.923 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:04.917+0000 7fc01ffaf2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:26:05.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.009+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcac1f2910 con 0x7fdcac15e4d0 2024-09-13T17:26:05.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdca2000700 1 -- 172.21.15.139:0/3566843291 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17204 (secure 0 0 0) 0x7fdcac1f2910 con 0x7fdcac15e4d0 2024-09-13T17:26:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:05.018 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":41,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:25:57.627647+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/3153492983":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/1151495076":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/312835695":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6833/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6832/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/2707869445":"2024-09-14T17:25:57.627576+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:26:05.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fdc8c0668e0 msgr2=0x7fdc8c068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:05.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fdc8c0668e0 0x7fdc8c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 msgr2=0x7fdcac1f32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 0x7fdcac1f32b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdca400eed0 tx=0x7fdca400b390 comp rx=0 tx=0).stop 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 shutdown_connections 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fdc8c0668e0 0x7fdc8c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcac15e4d0 0x7fdcac1f32b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcac146850 0x7fdcac1efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 --2- 172.21.15.139:0/3566843291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcac0ca1b0 0x7fdcac13f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 >> 172.21.15.139:0/3566843291 conn(0x7fdcac0721a0 msgr2=0x7fdcac0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 shutdown_connections 2024-09-13T17:26:05.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.013+0000 7fdcab200700 1 -- 172.21.15.139:0/3566843291 wait complete. 2024-09-13T17:26:05.036 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.031+0000 7fc1e85852c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:26:05.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:24:06.171629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:25:40.803876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:25:42.171875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:26:05.045 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:26:05.125 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:05.121+0000 7fc01ffaf2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:26:05.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 Processor -- start 2024-09-13T17:26:05.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 -- start start 2024-09-13T17:26:05.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7b6c0b4b10 0x7f7b6c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c070e60 0x7f7b6c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7b6c161680 0x7f7b6c161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c1626f0 con 0x7f7b6c161680 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c071810 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c162410 con 0x7f7b6c070e60 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b6a800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7b6c161680 0x7f7b6c161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b69e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7b6c0b4b10 0x7f7b6c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b69e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7b6c0b4b10 0x7f7b6c0ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:45630/0 (socket says 172.21.15.139:45630) 2024-09-13T17:26:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.217+0000 7f7b69e00700 1 -- 172.21.15.139:0/570403371 learned_addr learned my addr 172.21.15.139:0/570403371 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:05.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69400700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c070e60 0x7f7b6c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69e00700 1 -- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c070e60 msgr2=0x7f7b6c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:05.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69e00700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c070e60 0x7f7b6c0712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69e00700 1 -- 172.21.15.139:0/570403371 >> v2:172.21.15.139:3300/0 conn(0x7f7b6c161680 msgr2=0x7f7b6c161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69e00700 1 --2- 172.21.15.139:0/570403371 >> v2:172.21.15.139:3300/0 conn(0x7f7b6c161680 0x7f7b6c161aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69e00700 1 -- 172.21.15.139:0/570403371 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0cde30 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6a800700 1 --2- 172.21.15.139:0/570403371 >> v2:172.21.15.139:3300/0 conn(0x7f7b6c161680 0x7f7b6c161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69400700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c070e60 0x7f7b6c0712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b69e00700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ce8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c06f7d0 tx=0x7f7b5c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7677ca998d4998 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b68a00700 1 -- 172.21.15.139:0/570403371 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011830 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b68a00700 1 -- 172.21.15.139:0/570403371 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c011990 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b68a00700 1 -- 172.21.15.139:0/570403371 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011d20 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 -- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c0b4b10 msgr2=0x7f7b6c0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ce8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c06f7d0 tx=0x7f7b5c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 -- 172.21.15.139:0/570403371 shutdown_connections 2024-09-13T17:26:05.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 --2- 172.21.15.139:0/570403371 >> v2:172.21.15.139:3300/0 conn(0x7f7b6c161680 0x7f7b6c161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c070e60 0x7f7b6c0712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 --2- 172.21.15.139:0/570403371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ce8f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 -- 172.21.15.139:0/570403371 >> 172.21.15.139:0/570403371 conn(0x7f7b6c06efa0 msgr2=0x7f7b6c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:05.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 -- 172.21.15.139:0/570403371 shutdown_connections 2024-09-13T17:26:05.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.221+0000 7f7b6b200700 1 -- 172.21.15.139:0/570403371 wait complete. 2024-09-13T17:26:05.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 Processor -- start 2024-09-13T17:26:05.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 -- start start 2024-09-13T17:26:05.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c070e60 0x7f7b6c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c161680 0x7f7b6c0af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c157060 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0ac7c0 con 0x7f7b6c070e60 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0ada90 con 0x7f7b6c161680 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34658/0 (socket says 172.21.15.139:34658) 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c070e60 0x7f7b6c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 -- 172.21.15.139:0/4255572176 learned_addr learned my addr 172.21.15.139:0/4255572176 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:05.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6a800700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c161680 0x7f7b6c0af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.232 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.227+0000 7fc1e85852c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:26:05.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 -- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c161680 msgr2=0x7f7b6c0af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c161680 0x7f7b6c0af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 -- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c070e60 msgr2=0x7f7b6c156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c070e60 0x7f7b6c156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 -- 172.21.15.139:0/4255572176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009a70 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b69400700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ac280 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c7a0 tx=0x7f7b5800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:05.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011800 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58011960 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011d10 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c009570 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.225+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c0accd0 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.229+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c0712d0 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.229+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f7b58018360 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.229+0000 7f7b62000700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7b4c0668e0 0x7f7b4c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.229+0000 7f7b69e00700 1 -- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7b4c0668e0 msgr2=0x7f7b4c068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:05.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.229+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f7b58084760 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.229+0000 7f7b69e00700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7b4c0668e0 0x7f7b4c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.237+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b58051460 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.318 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.315+0000 7fc1e85852c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:26:05.325 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:05.317+0000 7fc01ffaf2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:26:05.411 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:05.405+0000 7fc01ffaf2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:26:05.416 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.411+0000 7fc1e85852c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:26:05.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.413+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b6c0cef50 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.417+0000 7f7b62000700 1 -- 172.21.15.139:0/4255572176 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b58054a80 con 0x7f7b6c0b4b10 2024-09-13T17:26:05.421 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7b4c0668e0 msgr2=0x7f7b4c068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7b4c0668e0 0x7f7b4c068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 msgr2=0x7f7b6c0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ac280 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c7a0 tx=0x7f7b5800cab0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 shutdown_connections 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f7b4c0668e0 0x7f7b4c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b6c161680 0x7f7b6c0af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b6c0b4b10 0x7f7b6c0ac280 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 --2- 172.21.15.139:0/4255572176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b6c070e60 0x7f7b6c156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 >> 172.21.15.139:0/4255572176 conn(0x7f7b6c06efa0 msgr2=0x7f7b6c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:05.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 shutdown_connections 2024-09-13T17:26:05.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.421+0000 7f7b6b200700 1 -- 172.21.15.139:0/4255572176 wait complete. 2024-09-13T17:26:05.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:26:05.498 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.495+0000 7fc1e85852c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:26:05.516 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:05.509+0000 7fc01ffaf2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:26:05.591 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.587+0000 7fc1e85852c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:26:05.610 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:05.605+0000 7fc01ffaf2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:26:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 Processor -- start 2024-09-13T17:26:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 -- start start 2024-09-13T17:26:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 0x7f6850140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6850071570 0x7f685006b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6850140cb0 con 0x7f6850140750 2024-09-13T17:26:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685006ac20 con 0x7f6850071570 2024-09-13T17:26:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6855600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6850140f90 con 0x7f685013d9e0 2024-09-13T17:26:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f684fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 0x7f6850140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f684fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 0x7f6850140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52516/0 (socket says 172.21.15.139:52516) 2024-09-13T17:26:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f684fe00700 1 -- 172.21.15.139:0/3961169173 learned_addr learned my addr 172.21.15.139:0/3961169173 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.617+0000 7f6854c00700 1 --2- 172.21.15.139:0/3961169173 >> v2:172.21.15.176:3300/0 conn(0x7f6850071570 0x7f685006b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684fe00700 1 -- 172.21.15.139:0/3961169173 >> v2:172.21.15.176:3300/0 conn(0x7f6850071570 msgr2=0x7f685006b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:05.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684fe00700 1 --2- 172.21.15.139:0/3961169173 >> v2:172.21.15.176:3300/0 conn(0x7f6850071570 0x7f685006b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684fe00700 1 -- 172.21.15.139:0/3961169173 >> v1:172.21.15.176:6789/0 conn(0x7f6850140750 legacy=0x7f6850070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684fe00700 1 -- 172.21.15.139:0/3961169173 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685006ae30 con 0x7f685013d9e0 2024-09-13T17:26:05.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684fe00700 1 --2- 172.21.15.139:0/3961169173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 0x7f6850140210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6840009910 tx=0x7f6840009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7b2cb1c17a73cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:05.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684ea00700 1 -- 172.21.15.139:0/3961169173 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840011830 con 0x7f685013d9e0 2024-09-13T17:26:05.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684ea00700 1 -- 172.21.15.139:0/3961169173 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840011990 con 0x7f685013d9e0 2024-09-13T17:26:05.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f684ea00700 1 -- 172.21.15.139:0/3961169173 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840011d40 con 0x7f685013d9e0 2024-09-13T17:26:05.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 -- 172.21.15.139:0/3961169173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 msgr2=0x7f6850140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 --2- 172.21.15.139:0/3961169173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 0x7f6850140210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6840009910 tx=0x7f6840009c20 comp rx=0 tx=0).stop 2024-09-13T17:26:05.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 -- 172.21.15.139:0/3961169173 shutdown_connections 2024-09-13T17:26:05.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 --2- 172.21.15.139:0/3961169173 >> v2:172.21.15.176:3300/0 conn(0x7f6850071570 0x7f685006b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 --2- 172.21.15.139:0/3961169173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f685013d9e0 0x7f6850140210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 -- 172.21.15.139:0/3961169173 >> 172.21.15.139:0/3961169173 conn(0x7f685006efa0 msgr2=0x7f68500b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:05.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 -- 172.21.15.139:0/3961169173 shutdown_connections 2024-09-13T17:26:05.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.621+0000 7f6855600700 1 -- 172.21.15.139:0/3961169173 wait complete. 2024-09-13T17:26:05.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 Processor -- start 2024-09-13T17:26:05.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 -- start start 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 0x7f68500b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f685013d9e0 0x7f685015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6850140750 0x7f68501f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68500b47a0 con 0x7f6850071570 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685015e5f0 con 0x7f685013d9e0 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.625+0000 7f6855600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68500b4f40 con 0x7f6850140750 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 0x7f68500b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 0x7f68500b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34662/0 (socket says 172.21.15.139:34662) 2024-09-13T17:26:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 -- 172.21.15.139:0/2028214688 learned_addr learned my addr 172.21.15.139:0/2028214688 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684f400700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f685013d9e0 0x7f685015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f6854c00700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6850140750 0x7f68501f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 -- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6850140750 msgr2=0x7f68501f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6850140750 0x7f68501f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 -- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f685013d9e0 msgr2=0x7f685015ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f685013d9e0 0x7f685015ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 -- 172.21.15.139:0/2028214688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009570 con 0x7f6850071570 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684f400700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f685013d9e0 0x7f685015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f684fe00700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 0x7f68500b1d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6840000c00 tx=0x7f6840004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840004590 con 0x7f6850071570 2024-09-13T17:26:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68400036c0 con 0x7f6850071570 2024-09-13T17:26:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68500b4980 con 0x7f6850071570 2024-09-13T17:26:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840003a70 con 0x7f6850071570 2024-09-13T17:26:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.629+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685015ddf0 con 0x7f6850071570 2024-09-13T17:26:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.633+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68500b27a0 con 0x7f6850071570 2024-09-13T17:26:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.633+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f6840003bd0 con 0x7f6850071570 2024-09-13T17:26:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.633+0000 7f6847e00700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f68300668e0 0x7f6830068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.633+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f6840021030 con 0x7f6850071570 2024-09-13T17:26:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.633+0000 7f684f400700 1 -- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f68300668e0 msgr2=0x7f6830068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.633+0000 7f684f400700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f68300668e0 0x7f6830068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:05.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.641+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6840052c60 con 0x7f6850071570 2024-09-13T17:26:05.708 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:05.701+0000 7fc01ffaf2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:26:05.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.821+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68501e5760 con 0x7f6850071570 2024-09-13T17:26:05.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.821+0000 7f6847e00700 1 -- 172.21.15.139:0/2028214688 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f684002b020 con 0x7f6850071570 2024-09-13T17:26:05.827 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f68300668e0 msgr2=0x7f6830068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f68300668e0 0x7f6830068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 msgr2=0x7f68500b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 0x7f68500b1d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6840000c00 tx=0x7f6840004770 comp rx=0 tx=0).stop 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 shutdown_connections 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f68300668e0 0x7f6830068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6850140750 0x7f68501f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f685013d9e0 0x7f685015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 --2- 172.21.15.139:0/2028214688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6850071570 0x7f68500b1d80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 >> 172.21.15.139:0/2028214688 conn(0x7f685006efa0 msgr2=0x7f685013f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 shutdown_connections 2024-09-13T17:26:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:05.825+0000 7f6855600700 1 -- 172.21.15.139:0/2028214688 wait complete. 2024-09-13T17:26:05.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:26:05.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:05.963+0000 7fc1e85852c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:26:06.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.021+0000 7f1d6e000700 1 Processor -- start 2024-09-13T17:26:06.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.021+0000 7f1d6e000700 1 -- start start 2024-09-13T17:26:06.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.021+0000 7f1d6e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d6815a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.021+0000 7f1d6e000700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1d6815a640 0x7f1d680cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.021+0000 7f1d6e000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680b38a0 con 0x7f1d680b4c90 2024-09-13T17:26:06.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d680b5070 con 0x7f1d6815a640 2024-09-13T17:26:06.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6815ae80 con 0x7f1d68071570 2024-09-13T17:26:06.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6cc00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1d680b4c90 0x7f1d68070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50734/0 (socket says 172.21.15.139:50734) 2024-09-13T17:26:06.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6cc00700 1 -- 172.21.15.139:0/940445898 learned_addr learned my addr 172.21.15.139:0/940445898 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:06.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67e00700 1 --2- 172.21.15.139:0/940445898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d6815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6d600700 1 --2- 172.21.15.139:0/940445898 >> v2:172.21.15.176:3300/0 conn(0x7f1d6815a640 0x7f1d680cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67400700 1 -- 172.21.15.139:0/940445898 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764392339 0 0) 0x7f1d680b38a0 con 0x7f1d680b4c90 2024-09-13T17:26:06.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67400700 1 -- 172.21.15.139:0/940445898 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d500035d0 con 0x7f1d680b4c90 2024-09-13T17:26:06.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67e00700 1 -- 172.21.15.139:0/940445898 >> v2:172.21.15.176:3300/0 conn(0x7f1d6815a640 msgr2=0x7f1d680cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:06.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67e00700 1 --2- 172.21.15.139:0/940445898 >> v2:172.21.15.176:3300/0 conn(0x7f1d6815a640 0x7f1d680cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67e00700 1 -- 172.21.15.139:0/940445898 >> v1:172.21.15.139:6789/0 conn(0x7f1d680b4c90 legacy=0x7f1d68070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67e00700 1 -- 172.21.15.139:0/940445898 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680b2f70 con 0x7f1d68071570 2024-09-13T17:26:06.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67e00700 1 --2- 172.21.15.139:0/940445898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d6815a100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009850 tx=0x7f1d54009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0c8e64cc7ef7052 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:06.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67400700 1 -- 172.21.15.139:0/940445898 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54011830 con 0x7f1d68071570 2024-09-13T17:26:06.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67400700 1 -- 172.21.15.139:0/940445898 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d54011990 con 0x7f1d68071570 2024-09-13T17:26:06.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d67400700 1 -- 172.21.15.139:0/940445898 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54011d00 con 0x7f1d68071570 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 -- 172.21.15.139:0/940445898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 msgr2=0x7f1d6815a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 --2- 172.21.15.139:0/940445898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d6815a100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009850 tx=0x7f1d54009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 -- 172.21.15.139:0/940445898 shutdown_connections 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 --2- 172.21.15.139:0/940445898 >> v2:172.21.15.176:3300/0 conn(0x7f1d6815a640 0x7f1d680cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 --2- 172.21.15.139:0/940445898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d6815a100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.025+0000 7f1d6e000700 1 -- 172.21.15.139:0/940445898 >> 172.21.15.139:0/940445898 conn(0x7f1d6806efa0 msgr2=0x7f1d680b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.029+0000 7f1d6e000700 1 -- 172.21.15.139:0/940445898 shutdown_connections 2024-09-13T17:26:06.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.029+0000 7f1d6e000700 1 -- 172.21.15.139:0/940445898 wait complete. 2024-09-13T17:26:06.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.029+0000 7f1d6e000700 1 Processor -- start 2024-09-13T17:26:06.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 -- start start 2024-09-13T17:26:06.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d680cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d680b4c90 0x7f1d680cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 0x7f1d68151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681476f0 con 0x7f1d6815a640 2024-09-13T17:26:06.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68151f80 con 0x7f1d680b4c90 2024-09-13T17:26:06.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68152260 con 0x7f1d68071570 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 0x7f1d68151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6cc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d680cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6cc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d680cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52550/0 (socket says 172.21.15.139:52550) 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6cc00700 1 -- 172.21.15.139:0/20792012 learned_addr learned my addr 172.21.15.139:0/20792012 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 0x7f1d68151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34668/0 (socket says 172.21.15.139:34668) 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d67e00700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d680b4c90 0x7f1d680cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 -- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 msgr2=0x7f1d680cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d680cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 -- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d680b4c90 msgr2=0x7f1d680cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d680b4c90 0x7f1d680cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 -- 172.21.15.139:0/20792012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540094b0 con 0x7f1d6815a640 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6d600700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 0x7f1d68151250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000eba0 tx=0x7f1d6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60009a80 con 0x7f1d6815a640 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d68152540 con 0x7f1d6815a640 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000f040 con 0x7f1d6815a640 2024-09-13T17:26:06.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.033+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000cc40 con 0x7f1d6815a640 2024-09-13T17:26:06.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.037+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d68151790 con 0x7f1d6815a640 2024-09-13T17:26:06.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.037+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d68152a60 con 0x7f1d6815a640 2024-09-13T17:26:06.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.041+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7f1d60014480 con 0x7f1d6815a640 2024-09-13T17:26:06.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.041+0000 7f1d64c00700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1d480668e0 0x7f1d48068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.041+0000 7f1d6cc00700 1 -- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1d480668e0 msgr2=0x7f1d48068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:06.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.041+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f1d600856e0 con 0x7f1d6815a640 2024-09-13T17:26:06.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.041+0000 7f1d6cc00700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1d480668e0 0x7f1d48068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:06.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.041+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d60052470 con 0x7f1d6815a640 2024-09-13T17:26:06.061 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.057+0000 7fc01ffaf2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:26:06.062 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:06.059+0000 7fc1e85852c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:26:06.156 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.149+0000 7fc01ffaf2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:26:06.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.229+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d6815a100 con 0x7f1d6815a640 2024-09-13T17:26:06.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.229+0000 7f1d64c00700 1 -- 172.21.15.139:0/20792012 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d60018020 con 0x7f1d6815a640 2024-09-13T17:26:06.236 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1d480668e0 msgr2=0x7f1d48068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1d480668e0 0x7f1d48068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 msgr2=0x7f1d68151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 0x7f1d68151250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000eba0 tx=0x7f1d6000eeb0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 shutdown_connections 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7f1d480668e0 0x7f1d48068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d6815a640 0x7f1d68151250 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d680b4c90 0x7f1d680cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 --2- 172.21.15.139:0/20792012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d68071570 0x7f1d680cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 >> 172.21.15.139:0/20792012 conn(0x7f1d6806efa0 msgr2=0x7f1d68070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:06.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 shutdown_connections 2024-09-13T17:26:06.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.233+0000 7f1d6e000700 1 -- 172.21.15.139:0/20792012 wait complete. 2024-09-13T17:26:06.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:06.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.429+0000 7fbf5c400700 1 Processor -- start 2024-09-13T17:26:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.429+0000 7fbf5c400700 1 -- start start 2024-09-13T17:26:06.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5c400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf540ce5f0 0x7fbf5415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5c400700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5415c160 con 0x7fbf5406d9b0 2024-09-13T17:26:06.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5c400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5415c540 con 0x7fbf54144770 2024-09-13T17:26:06.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5c400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf540cea20 con 0x7fbf540ce5f0 2024-09-13T17:26:06.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf59000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbf5406d9b0 0x7fbf5415c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50740/0 (socket says 172.21.15.139:50740) 2024-09-13T17:26:06.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf59000700 1 -- 172.21.15.139:0/3050965336 learned_addr learned my addr 172.21.15.139:0/3050965336 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:06.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5a400700 1 --2- 172.21.15.139:0/3050965336 >> v2:172.21.15.176:3300/0 conn(0x7fbf540ce5f0 0x7fbf5415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5a400700 1 -- 172.21.15.139:0/3050965336 >> v1:172.21.15.176:6789/0 conn(0x7fbf54144770 legacy=0x7fbf5406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5a400700 1 -- 172.21.15.139:0/3050965336 >> v1:172.21.15.139:6789/0 conn(0x7fbf5406d9b0 legacy=0x7fbf5415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.433+0000 7fbf5a400700 1 -- 172.21.15.139:0/3050965336 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54144b50 con 0x7fbf540ce5f0 2024-09-13T17:26:06.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5a400700 1 --2- 172.21.15.139:0/3050965336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf540ce5f0 0x7fbf5415b1c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009850 tx=0x7fbf4c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876dc12ecf96f966 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:06.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf53e00700 1 -- 172.21.15.139:0/3050965336 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c011830 con 0x7fbf540ce5f0 2024-09-13T17:26:06.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf53e00700 1 -- 172.21.15.139:0/3050965336 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c011990 con 0x7fbf540ce5f0 2024-09-13T17:26:06.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf53e00700 1 -- 172.21.15.139:0/3050965336 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c011d20 con 0x7fbf540ce5f0 2024-09-13T17:26:06.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 -- 172.21.15.139:0/3050965336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf540ce5f0 msgr2=0x7fbf5415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3050965336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf540ce5f0 0x7fbf5415b1c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009850 tx=0x7fbf4c009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:06.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 -- 172.21.15.139:0/3050965336 shutdown_connections 2024-09-13T17:26:06.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3050965336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf540ce5f0 0x7fbf5415b1c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 -- 172.21.15.139:0/3050965336 >> 172.21.15.139:0/3050965336 conn(0x7fbf5406b1e0 msgr2=0x7fbf5406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:06.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 -- 172.21.15.139:0/3050965336 shutdown_connections 2024-09-13T17:26:06.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 -- 172.21.15.139:0/3050965336 wait complete. 2024-09-13T17:26:06.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 Processor -- start 2024-09-13T17:26:06.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.437+0000 7fbf5c400700 1 -- start start 2024-09-13T17:26:06.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf5406d9b0 0x7fbf540c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 0x7fbf540c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf54144770 0x7fbf540c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54140970 con 0x7fbf540ce5f0 2024-09-13T17:26:06.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c4910 con 0x7fbf54144770 2024-09-13T17:26:06.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c4bf0 con 0x7fbf5406d9b0 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 0x7fbf540c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 0x7fbf540c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34678/0 (socket says 172.21.15.139:34678) 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5a400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf54144770 0x7fbf540c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 -- 172.21.15.139:0/3632976515 learned_addr learned my addr 172.21.15.139:0/3632976515 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59a00700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf5406d9b0 0x7fbf540c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 -- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf5406d9b0 msgr2=0x7fbf540c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf5406d9b0 0x7fbf540c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 -- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf54144770 msgr2=0x7fbf540c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf54144770 0x7fbf540c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 -- 172.21.15.139:0/3632976515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0094b0 con 0x7fbf540ce5f0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf59000700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 0x7fbf540c3d30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbf40001eb0 tx=0x7fbf4000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40005d90 con 0x7fbf540ce5f0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf400070d0 con 0x7fbf540ce5f0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf540c4ed0 con 0x7fbf540ce5f0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40007440 con 0x7fbf540ce5f0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.441+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf540c5490 con 0x7fbf540ce5f0 2024-09-13T17:26:06.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.445+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5406d120 con 0x7fbf540ce5f0 2024-09-13T17:26:06.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.445+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 11) v1 ==== 86251+0+0 (secure 0 0 0) 0x7fbf400075a0 con 0x7fbf540ce5f0 2024-09-13T17:26:06.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.445+0000 7fbf51600700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 0x7fbf34068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.445+0000 7fbf59a00700 1 -- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 msgr2=0x7fbf34068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:06.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.445+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6287+0+0 (secure 0 0 0) 0x7fbf400838c0 con 0x7fbf540ce5f0 2024-09-13T17:26:06.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.445+0000 7fbf59a00700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 0x7fbf34068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:26:06.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.453+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf40050820 con 0x7fbf540ce5f0 2024-09-13T17:26:06.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.649+0000 7fbf59a00700 1 -- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 msgr2=0x7fbf34068da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:6832/2501085087 2024-09-13T17:26:06.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.649+0000 7fbf59a00700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 0x7fbf34068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:26:06.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.673+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf540c5680 con 0x7fbf540ce5f0 2024-09-13T17:26:06.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.673+0000 7fbf51600700 1 -- 172.21.15.139:0/3632976515 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fbf40053e40 con 0x7fbf540ce5f0 2024-09-13T17:26:06.679 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:06.680 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:25:43.178317+0000","modified":"2024-09-13T17:25:46.195947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6833/501919372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":501919372},{"type":"v1","addr":"172.21.15.176:6833","nonce":501919372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:26:06.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 msgr2=0x7fbf34068da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 0x7fbf34068da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 msgr2=0x7fbf540c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 0x7fbf540c3d30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbf40001eb0 tx=0x7fbf4000c7b0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 shutdown_connections 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:6832/2501085087,v1:172.21.15.139:6833/2501085087] conn(0x7fbf340668e0 0x7fbf34068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf54144770 0x7fbf540c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf540ce5f0 0x7fbf540c3d30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 --2- 172.21.15.139:0/3632976515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf5406d9b0 0x7fbf540c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 >> 172.21.15.139:0/3632976515 conn(0x7fbf5406b1e0 msgr2=0x7fbf540ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 shutdown_connections 2024-09-13T17:26:06.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.677+0000 7fbf5c400700 1 -- 172.21.15.139:0/3632976515 wait complete. 2024-09-13T17:26:06.687 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2024-09-13T17:26:06.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:26:06.755 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-13T17:26:06.751+0000 7fc1e85852c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:26:06.847 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.841+0000 7fc01ffaf2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:26:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.857+0000 7f6adf200700 1 Processor -- start 2024-09-13T17:26:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.857+0000 7f6adf200700 1 -- start start 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 0x7f6ae00cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adf200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ae00b3e20 0x7f6ae00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adf200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ae00b4260 0x7f6ae00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adf200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00cec10 con 0x7f6ae00b4260 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adf200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00b5de0 con 0x7f6ae00b3e20 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0161710 con 0x7f6ae0161330 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adde00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 0x7f6ae00cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ae00b3e20 0x7f6ae00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6ade800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6ae00b4260 0x7f6ae00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adde00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 0x7f6ae00cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52588/0 (socket says 172.21.15.139:52588) 2024-09-13T17:26:06.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adde00700 1 -- 172.21.15.139:0/645806920 learned_addr learned my addr 172.21.15.139:0/645806920 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:06.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 -- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 msgr2=0x7f6ae00cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 --2- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 0x7f6ae00cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 -- 172.21.15.139:0/645806920 >> v2:172.21.15.139:3300/0 conn(0x7f6ae00b4260 msgr2=0x7f6ae00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 --2- 172.21.15.139:0/645806920 >> v2:172.21.15.139:3300/0 conn(0x7f6ae00b4260 0x7f6ae00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 -- 172.21.15.139:0/645806920 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00ce000 con 0x7f6ae00b3e20 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adde00700 1 --2- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 0x7f6ae00cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6ade800700 1 --2- 172.21.15.139:0/645806920 >> v2:172.21.15.139:3300/0 conn(0x7f6ae00b4260 0x7f6ae00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6add400700 1 --2- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b3e20 0x7f6ae00b4f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0066ff0 tx=0x7f6acc009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72cc2b362922dd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adca00700 1 -- 172.21.15.139:0/645806920 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc005e50 con 0x7f6ae00b3e20 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adca00700 1 -- 172.21.15.139:0/645806920 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc006030 con 0x7f6ae00b3e20 2024-09-13T17:26:06.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.861+0000 7f6adca00700 1 -- 172.21.15.139:0/645806920 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0063c0 con 0x7f6ae00b3e20 2024-09-13T17:26:06.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 -- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b3e20 msgr2=0x7f6ae00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 --2- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b3e20 0x7f6ae00b4f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0066ff0 tx=0x7f6acc009b20 comp rx=0 tx=0).stop 2024-09-13T17:26:06.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 -- 172.21.15.139:0/645806920 shutdown_connections 2024-09-13T17:26:06.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 --2- 172.21.15.139:0/645806920 >> v2:172.21.15.139:3300/0 conn(0x7f6ae00b4260 0x7f6ae00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 --2- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b3e20 0x7f6ae00b4f80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 --2- 172.21.15.139:0/645806920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae0161330 0x7f6ae00cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 -- 172.21.15.139:0/645806920 >> 172.21.15.139:0/645806920 conn(0x7f6ae00cc890 msgr2=0x7f6ae00ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:06.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 -- 172.21.15.139:0/645806920 shutdown_connections 2024-09-13T17:26:06.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 -- 172.21.15.139:0/645806920 wait complete. 2024-09-13T17:26:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 Processor -- start 2024-09-13T17:26:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.865+0000 7f6adf200700 1 -- start start 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 0x7f6ae01f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b4260 0x7f6ae00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ae0161330 0x7f6ae014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c5df0 con 0x7f6ae0161330 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae01f7eb0 con 0x7f6ae00b4260 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c5170 con 0x7f6ae00b3e20 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6ade800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ae0161330 0x7f6ae014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 0x7f6ae01f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6add400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b4260 0x7f6ae00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 0x7f6ae01f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52602/0 (socket says 172.21.15.139:52602) 2024-09-13T17:26:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 -- 172.21.15.139:0/3745399793 learned_addr learned my addr 172.21.15.139:0/3745399793 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 -- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b4260 msgr2=0x7f6ae00c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b4260 0x7f6ae00c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 -- 172.21.15.139:0/3745399793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ae0161330 msgr2=0x7f6ae014eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ae0161330 0x7f6ae014eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 -- 172.21.15.139:0/3745399793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad8009a70 con 0x7f6ae00b3e20 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6ade800700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ae0161330 0x7f6ae014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adde00700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 0x7f6ae01f7970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000e9d0 tx=0x7f6ad000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000ee70 con 0x7f6ae00b3e20 2024-09-13T17:26:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad000c850 con 0x7f6ae00b3e20 2024-09-13T17:26:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000cbc0 con 0x7f6ae00b3e20 2024-09-13T17:26:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad0009570 con 0x7f6ae00b3e20 2024-09-13T17:26:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc009450 con 0x7f6ae00b3e20 2024-09-13T17:26:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.869+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae00677e0 con 0x7f6ae00b3e20 2024-09-13T17:26:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.873+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 12) v1 ==== 85803+0+0 (secure 0 0 0) 0x7f6ad000cd20 con 0x7f6ae00b3e20 2024-09-13T17:26:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.873+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f6ad0083ef0 con 0x7f6ae00b3e20 2024-09-13T17:26:06.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:06.881+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ad00512b0 con 0x7f6ae00b3e20 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfdf200700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfdf200700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfdf200700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfdf200700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfe3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfdf200700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.953 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfe3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.954 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfe3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.954 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfe3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:06.954 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-09-13T17:26:06.945+0000 7fbfe3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:26:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.077+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ae00cf0a0 con 0x7f6ae00b3e20 2024-09-13T17:26:07.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.081+0000 7f6ad6000700 1 -- 172.21.15.139:0/3745399793 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17776 (secure 0 0 0) 0x7f6ad00548d0 con 0x7f6ae00b3e20 2024-09-13T17:26:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:07.088 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":42,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:26:06.847765+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/3293474047":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/2733931244":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/2707869445":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6833/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6832/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/312835695":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/1151495076":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/745875968":"2024-09-14T17:26:06.847686+0000","172.21.15.139:6833/2501085087":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/3153492983":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/2233835098":"2024-09-14T17:26:06.847686+0000","172.21.15.139:6832/2501085087":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/1678669475":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/3615204454":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/1509520047":"2024-09-14T17:26:06.847686+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 msgr2=0x7f6ae01f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 0x7f6ae01f7970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000e9d0 tx=0x7f6ad000ece0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 shutdown_connections 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ae0161330 0x7f6ae014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae00b4260 0x7f6ae00c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 --2- 172.21.15.139:0/3745399793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae00b3e20 0x7f6ae01f7970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.085+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 >> 172.21.15.139:0/3745399793 conn(0x7f6ae00cc890 msgr2=0x7f6ae01619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.089+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 shutdown_connections 2024-09-13T17:26:07.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.089+0000 7f6adf200700 1 -- 172.21.15.139:0/3745399793 wait complete. 2024-09-13T17:26:07.117 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:26:07.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:07.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.281+0000 7fd232e00700 1 Processor -- start 2024-09-13T17:26:07.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.281+0000 7fd232e00700 1 -- start start 2024-09-13T17:26:07.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd22c144300 0x7fd22c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd22c06db60 0x7fd22c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c070140 con 0x7fd22c144300 2024-09-13T17:26:07.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c070420 con 0x7fd22c06db60 2024-09-13T17:26:07.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c070700 con 0x7fd22c15aff0 2024-09-13T17:26:07.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd22c144300 0x7fd22c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd22c144300 0x7fd22c06d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34800/0 (socket says 172.21.15.139:34800) 2024-09-13T17:26:07.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 -- 172.21.15.139:0/3839693010 learned_addr learned my addr 172.21.15.139:0/3839693010 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:07.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd232400700 1 --2- 172.21.15.139:0/3839693010 >> v2:172.21.15.176:3300/0 conn(0x7fd22c06db60 0x7fd22c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 -- 172.21.15.139:0/3839693010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 msgr2=0x7fd22c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:07.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 --2- 172.21.15.139:0/3839693010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 -- 172.21.15.139:0/3839693010 >> v2:172.21.15.176:3300/0 conn(0x7fd22c06db60 msgr2=0x7fd22c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:07.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 --2- 172.21.15.139:0/3839693010 >> v2:172.21.15.176:3300/0 conn(0x7fd22c06db60 0x7fd22c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.285+0000 7fd231a00700 1 -- 172.21.15.139:0/3839693010 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0709e0 con 0x7fd22c144300 2024-09-13T17:26:07.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd231a00700 1 --2- 172.21.15.139:0/3839693010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c06d620 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd22c06b5f0 tx=0x7fd220009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e08ec369f7581e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:07.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd22be00700 1 -- 172.21.15.139:0/3839693010 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011830 con 0x7fd22c144300 2024-09-13T17:26:07.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd22be00700 1 -- 172.21.15.139:0/3839693010 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220011990 con 0x7fd22c144300 2024-09-13T17:26:07.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd22be00700 1 -- 172.21.15.139:0/3839693010 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011d20 con 0x7fd22c144300 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 -- 172.21.15.139:0/3839693010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 msgr2=0x7fd22c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 --2- 172.21.15.139:0/3839693010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c06d620 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd22c06b5f0 tx=0x7fd220009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 -- 172.21.15.139:0/3839693010 shutdown_connections 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 --2- 172.21.15.139:0/3839693010 >> v2:172.21.15.176:3300/0 conn(0x7fd22c06db60 0x7fd22c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 --2- 172.21.15.139:0/3839693010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 --2- 172.21.15.139:0/3839693010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c06d620 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 -- 172.21.15.139:0/3839693010 >> 172.21.15.139:0/3839693010 conn(0x7fd22c0ce9d0 msgr2=0x7fd22c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 -- 172.21.15.139:0/3839693010 shutdown_connections 2024-09-13T17:26:07.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.289+0000 7fd232e00700 1 -- 172.21.15.139:0/3839693010 wait complete. 2024-09-13T17:26:07.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 Processor -- start 2024-09-13T17:26:07.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 -- start start 2024-09-13T17:26:07.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd22c06db60 0x7fd22c1f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1f2200 con 0x7fd22c144300 2024-09-13T17:26:07.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1f6780 con 0x7fd22c06db60 2024-09-13T17:26:07.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1f61c0 con 0x7fd22c15aff0 2024-09-13T17:26:07.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c1f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34814/0 (socket says 172.21.15.139:34814) 2024-09-13T17:26:07.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 -- 172.21.15.139:0/681713745 learned_addr learned my addr 172.21.15.139:0/681713745 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:07.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232400700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231a00700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd22c06db60 0x7fd22c1f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 -- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 msgr2=0x7fd22c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 -- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd22c06db60 msgr2=0x7fd22c1f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd22c06db60 0x7fd22c1f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 -- 172.21.15.139:0/681713745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009570 con 0x7fd22c144300 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd232400700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231a00700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd22c06db60 0x7fd22c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd231000700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c1f5850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd21800e9d0 tx=0x7fd21800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.293+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218009720 con 0x7fd22c144300 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.297+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800c850 con 0x7fd22c144300 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.297+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21800cbc0 con 0x7fd22c144300 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.297+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c1f64a0 con 0x7fd22c144300 2024-09-13T17:26:07.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.297+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c1f26e0 con 0x7fd22c144300 2024-09-13T17:26:07.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.297+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c06d620 con 0x7fd22c144300 2024-09-13T17:26:07.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.297+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 12) v1 ==== 85803+0+0 (secure 0 0 0) 0x7fd21800cd20 con 0x7fd22c144300 2024-09-13T17:26:07.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.301+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fd2180841c0 con 0x7fd22c144300 2024-09-13T17:26:07.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.305+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2180514c0 con 0x7fd22c144300 2024-09-13T17:26:07.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.533+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd22c13acc0 con 0x7fd22c144300 2024-09-13T17:26:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd229600700 1 -- 172.21.15.139:0/681713745 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fd218054ae0 con 0x7fd22c144300 2024-09-13T17:26:07.542 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:07.542 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:25:43.178317+0000","modified":"2024-09-13T17:25:46.195947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6833/501919372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":501919372},{"type":"v1","addr":"172.21.15.176:6833","nonce":501919372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 msgr2=0x7fd22c1f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd232e00700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c1f5850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd21800e9d0 tx=0x7fd21800ed90 comp rx=0 tx=0).stop 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 shutdown_connections 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd232e00700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd22c15aff0 0x7fd22c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd232e00700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd22c144300 0x7fd22c1f5850 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.537+0000 7fd232e00700 1 --2- 172.21.15.139:0/681713745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd22c06db60 0x7fd22c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.541+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 >> 172.21.15.139:0/681713745 conn(0x7fd22c0ce9d0 msgr2=0x7fd22c06c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:07.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.541+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 shutdown_connections 2024-09-13T17:26:07.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.541+0000 7fd232e00700 1 -- 172.21.15.139:0/681713745 wait complete. 2024-09-13T17:26:07.547 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2024-09-13T17:26:07.564 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:07.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.725+0000 7fb52e600700 1 Processor -- start 2024-09-13T17:26:07.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.725+0000 7fb52e600700 1 -- start start 2024-09-13T17:26:07.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 0x7fb52806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52e600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb52815aff0 0x7fb5280cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52e600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb52806db60 0x7fb5280cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52e600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb528070140 con 0x7fb52815aff0 2024-09-13T17:26:07.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52e600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb528070420 con 0x7fb52806db60 2024-09-13T17:26:07.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb528070700 con 0x7fb528144300 2024-09-13T17:26:07.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb527e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb52815aff0 0x7fb5280cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 0x7fb52806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52dc00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb52806db60 0x7fb5280cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 0x7fb52806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52732/0 (socket says 172.21.15.139:52732) 2024-09-13T17:26:07.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 -- 172.21.15.139:0/2640566156 learned_addr learned my addr 172.21.15.139:0/2640566156 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:07.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 -- 172.21.15.139:0/2640566156 >> v2:172.21.15.176:3300/0 conn(0x7fb52806db60 msgr2=0x7fb5280cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:07.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 --2- 172.21.15.139:0/2640566156 >> v2:172.21.15.176:3300/0 conn(0x7fb52806db60 0x7fb5280cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 -- 172.21.15.139:0/2640566156 >> v2:172.21.15.139:3300/0 conn(0x7fb52815aff0 msgr2=0x7fb5280cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:07.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 --2- 172.21.15.139:0/2640566156 >> v2:172.21.15.139:3300/0 conn(0x7fb52815aff0 0x7fb5280cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 -- 172.21.15.139:0/2640566156 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280709e0 con 0x7fb528144300 2024-09-13T17:26:07.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb527e00700 1 --2- 172.21.15.139:0/2640566156 >> v2:172.21.15.139:3300/0 conn(0x7fb52815aff0 0x7fb5280cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:07.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb52d200700 1 --2- 172.21.15.139:0/2640566156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 0x7fb52806d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb52806b5f0 tx=0x7fb51c009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee340493f964d541 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:07.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb527400700 1 -- 172.21.15.139:0/2640566156 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c011830 con 0x7fb528144300 2024-09-13T17:26:07.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb527400700 1 -- 172.21.15.139:0/2640566156 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c011990 con 0x7fb528144300 2024-09-13T17:26:07.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.729+0000 7fb527400700 1 -- 172.21.15.139:0/2640566156 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c011d20 con 0x7fb528144300 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 -- 172.21.15.139:0/2640566156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 msgr2=0x7fb52806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 --2- 172.21.15.139:0/2640566156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 0x7fb52806d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb52806b5f0 tx=0x7fb51c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 -- 172.21.15.139:0/2640566156 shutdown_connections 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 --2- 172.21.15.139:0/2640566156 >> v2:172.21.15.176:3300/0 conn(0x7fb52806db60 0x7fb5280cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 --2- 172.21.15.139:0/2640566156 >> v2:172.21.15.139:3300/0 conn(0x7fb52815aff0 0x7fb5280cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 --2- 172.21.15.139:0/2640566156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb528144300 0x7fb52806d620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 -- 172.21.15.139:0/2640566156 >> 172.21.15.139:0/2640566156 conn(0x7fb5280ce9d0 msgr2=0x7fb5280cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 -- 172.21.15.139:0/2640566156 shutdown_connections 2024-09-13T17:26:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 -- 172.21.15.139:0/2640566156 wait complete. 2024-09-13T17:26:07.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 Processor -- start 2024-09-13T17:26:07.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.733+0000 7fb52e600700 1 -- start start 2024-09-13T17:26:07.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 0x7fb5281f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb528144300 0x7fb528159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb52815aff0 0x7fb528159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528142bd0 con 0x7fb52806db60 2024-09-13T17:26:07.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528141fc0 con 0x7fb528144300 2024-09-13T17:26:07.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5281422a0 con 0x7fb52815aff0 2024-09-13T17:26:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 0x7fb5281f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 0x7fb5281f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34822/0 (socket says 172.21.15.139:34822) 2024-09-13T17:26:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 -- 172.21.15.139:0/3801092944 learned_addr learned my addr 172.21.15.139:0/3801092944 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52dc00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb52815aff0 0x7fb528159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb527e00700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb528144300 0x7fb528159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 -- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb52815aff0 msgr2=0x7fb528159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb52815aff0 0x7fb528159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 -- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb528144300 msgr2=0x7fb528159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb528144300 0x7fb528159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 -- 172.21.15.139:0/3801092944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5140094b0 con 0x7fb52806db60 2024-09-13T17:26:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52d200700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 0x7fb5281f1800 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb528070840 tx=0x7fb51c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c004240 con 0x7fb52806db60 2024-09-13T17:26:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c01f070 con 0x7fb52806db60 2024-09-13T17:26:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c004600 con 0x7fb52806db60 2024-09-13T17:26:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c009570 con 0x7fb52806db60 2024-09-13T17:26:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.737+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb528142860 con 0x7fb52806db60 2024-09-13T17:26:07.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.741+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52806d620 con 0x7fb52806db60 2024-09-13T17:26:07.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.741+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 12) v1 ==== 85803+0+0 (secure 0 0 0) 0x7fb51c021030 con 0x7fb52806db60 2024-09-13T17:26:07.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.745+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fb51c084ff0 con 0x7fb52806db60 2024-09-13T17:26:07.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.749+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb51c0b6db0 con 0x7fb52806db60 2024-09-13T17:26:07.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.873+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 13) v1 ==== 85930+0+0 (secure 0 0 0) 0x7fb51c051e80 con 0x7fb52806db60 2024-09-13T17:26:07.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.873+0000 7fb524c00700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb50806c390 0x7fb50806e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:07.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.873+0000 7fb527e00700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb50806c390 0x7fb50806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:07.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.877+0000 7fb527e00700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb50806c390 0x7fb50806e780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb52813bc20 tx=0x7fb514009240 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.997+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5280742b0 con 0x7fb52806db60 2024-09-13T17:26:08.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:07.997+0000 7fb524c00700 1 -- 172.21.15.139:0/3801092944 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fb51c07efa0 con 0x7fb52806db60 2024-09-13T17:26:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:08.003 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:25:43.178317+0000","modified":"2024-09-13T17:25:46.195947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6833/501919372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":501919372},{"type":"v1","addr":"172.21.15.176:6833","nonce":501919372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:26:08.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb50806c390 msgr2=0x7fb50806e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb50806c390 0x7fb50806e780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb52813bc20 tx=0x7fb514009240 comp rx=0 tx=0).stop 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 msgr2=0x7fb5281f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 0x7fb5281f1800 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb528070840 tx=0x7fb51c004770 comp rx=0 tx=0).stop 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 shutdown_connections 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb50806c390 0x7fb50806e780 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb52815aff0 0x7fb528159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb528144300 0x7fb528159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 --2- 172.21.15.139:0/3801092944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb52806db60 0x7fb5281f1800 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 >> 172.21.15.139:0/3801092944 conn(0x7fb5280ce9d0 msgr2=0x7fb5280ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 shutdown_connections 2024-09-13T17:26:08.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.001+0000 7fb52e600700 1 -- 172.21.15.139:0/3801092944 wait complete. 2024-09-13T17:26:08.008 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2024-09-13T17:26:08.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:26:08.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.189+0000 7f2ea1600700 1 Processor -- start 2024-09-13T17:26:08.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.189+0000 7f2ea1600700 1 -- start start 2024-09-13T17:26:08.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea1600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2e9c15ebb0 0x7f2e9c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea1600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2e9c15f5c0 0x7f2e9c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea1600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0b41a0 con 0x7f2e9c15ef90 2024-09-13T17:26:08.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea1600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b6370 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea1600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b6650 con 0x7f2e9c15f5c0 2024-09-13T17:26:08.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2e9be00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2e9c15ebb0 0x7f2e9c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea0c00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2e9c15ef90 0x7f2e9c143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50754/0 (socket says 172.21.15.139:50754) 2024-09-13T17:26:08.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2ea0c00700 1 -- 172.21.15.139:0/2909717713 learned_addr learned my addr 172.21.15.139:0/2909717713 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:08.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.193+0000 7f2e9b400700 1 --2- 172.21.15.139:0/2909717713 >> v2:172.21.15.176:3300/0 conn(0x7f2e9c15f5c0 0x7f2e9c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9be00700 1 -- 172.21.15.139:0/2909717713 >> v2:172.21.15.176:3300/0 conn(0x7f2e9c15f5c0 msgr2=0x7f2e9c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:08.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9be00700 1 --2- 172.21.15.139:0/2909717713 >> v2:172.21.15.176:3300/0 conn(0x7f2e9c15f5c0 0x7f2e9c1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9be00700 1 -- 172.21.15.139:0/2909717713 >> v1:172.21.15.139:6789/0 conn(0x7f2e9c15ef90 legacy=0x7f2e9c143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9be00700 1 -- 172.21.15.139:0/2909717713 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0b6930 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9aa00700 1 -- 172.21.15.139:0/2909717713 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096113153 0 0) 0x7f2e94001490 con 0x7f2e9c15ef90 2024-09-13T17:26:08.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9be00700 1 --2- 172.21.15.139:0/2909717713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c0b3c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0ceb10 tx=0x7f2e8c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522eed74c514ddb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9aa00700 1 -- 172.21.15.139:0/2909717713 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c011830 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9aa00700 1 -- 172.21.15.139:0/2909717713 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c011990 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2e9aa00700 1 -- 172.21.15.139:0/2909717713 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c011d20 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 -- 172.21.15.139:0/2909717713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 msgr2=0x7f2e9c0b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2909717713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c0b3c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0ceb10 tx=0x7f2e8c009b30 comp rx=0 tx=0).stop 2024-09-13T17:26:08.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 -- 172.21.15.139:0/2909717713 shutdown_connections 2024-09-13T17:26:08.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2909717713 >> v2:172.21.15.176:3300/0 conn(0x7f2e9c15f5c0 0x7f2e9c1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2909717713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c0b3c60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 -- 172.21.15.139:0/2909717713 >> 172.21.15.139:0/2909717713 conn(0x7f2e9c071fa0 msgr2=0x7f2e9c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:08.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 -- 172.21.15.139:0/2909717713 shutdown_connections 2024-09-13T17:26:08.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.197+0000 7f2ea1600700 1 -- 172.21.15.139:0/2909717713 wait complete. 2024-09-13T17:26:08.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 Processor -- start 2024-09-13T17:26:08.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 -- start start 2024-09-13T17:26:08.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c1f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9c15ef90 0x7f2e9c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e9c15f5c0 0x7f2e9c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c13fea0 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15b420 con 0x7f2e9c15ef90 2024-09-13T17:26:08.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea1600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c1f6b00 con 0x7f2e9c15f5c0 2024-09-13T17:26:08.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c1f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c1f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34852/0 (socket says 172.21.15.139:34852) 2024-09-13T17:26:08.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 -- 172.21.15.139:0/2063079716 learned_addr learned my addr 172.21.15.139:0/2063079716 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:08.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea0c00700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e9c15f5c0 0x7f2e9c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9b400700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9c15ef90 0x7f2e9c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 -- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e9c15f5c0 msgr2=0x7f2e9c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e9c15f5c0 0x7f2e9c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 -- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9c15ef90 msgr2=0x7f2e9c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9c15ef90 0x7f2e9c06c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2e9be00700 1 -- 172.21.15.139:0/2063079716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0094b0 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.201+0000 7f2ea0c00700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e9c15f5c0 0x7f2e9c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2e9be00700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c1f6520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0090b0 tx=0x7f2e8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c004570 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c01f070 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c1f6de0 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0038e0 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c0c6110 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.205+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0677e0 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.209+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 13) v1 ==== 85930+0+0 (secure 0 0 0) 0x7f2e8c021030 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.209+0000 7f2e93e00700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2e7c066580 0x7f2e7c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.209+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f2e8c085620 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.209+0000 7f2e9b400700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2e7c066580 0x7f2e7c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.209+0000 7f2e9b400700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2e7c066580 0x7f2e7c068a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c140ea0 tx=0x7f2e88008040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.217+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e8c052950 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.401+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e9c0b3c60 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.405+0000 7f2e93e00700 1 -- 172.21.15.139:0/2063079716 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17776 (secure 0 0 0) 0x7f2e8c055f70 con 0x7f2e9c15ebb0 2024-09-13T17:26:08.411 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:08.411 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":42,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:26:06.847765+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:25:40.803876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:25:42.171875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/3293474047":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/2733931244":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/2707869445":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6833/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6832/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/312835695":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/1151495076":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/745875968":"2024-09-14T17:26:06.847686+0000","172.21.15.139:6833/2501085087":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/3153492983":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/2233835098":"2024-09-14T17:26:06.847686+0000","172.21.15.139:6832/2501085087":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/1678669475":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/3615204454":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/1509520047":"2024-09-14T17:26:06.847686+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:26:08.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.405+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2e7c066580 msgr2=0x7f2e7c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2e7c066580 0x7f2e7c068a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c140ea0 tx=0x7f2e88008040 comp rx=0 tx=0).stop 2024-09-13T17:26:08.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 msgr2=0x7f2e9c1f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c1f6520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0090b0 tx=0x7f2e8c004770 comp rx=0 tx=0).stop 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 shutdown_connections 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2e7c066580 0x7f2e7c068a40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e9c15f5c0 0x7f2e9c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9c15ef90 0x7f2e9c06c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 --2- 172.21.15.139:0/2063079716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e9c15ebb0 0x7f2e9c1f6520 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 >> 172.21.15.139:0/2063079716 conn(0x7f2e9c071fa0 msgr2=0x7f2e9c142390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 shutdown_connections 2024-09-13T17:26:08.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.409+0000 7f2ea1600700 1 -- 172.21.15.139:0/2063079716 wait complete. 2024-09-13T17:26:08.438 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:26:08.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.597+0000 7f9aa5c00700 1 Processor -- start 2024-09-13T17:26:08.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.597+0000 7f9aa5c00700 1 -- start start 2024-09-13T17:26:08.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.597+0000 7f9aa5c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9aa00cc370 0x7f9aa00cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9aa5c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa0070410 con 0x7f9aa01612a0 2024-09-13T17:26:08.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9aa5c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00706f0 con 0x7f9aa006d2a0 2024-09-13T17:26:08.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9aa5c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa00ccd20 con 0x7f9aa00cc370 2024-09-13T17:26:08.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9e000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9aa00cc370 0x7f9aa00cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9ea00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f9aa01612a0 0x7f9aa00b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50764/0 (socket says 172.21.15.139:50764) 2024-09-13T17:26:08.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9ea00700 1 -- 172.21.15.139:0/1332600940 learned_addr learned my addr 172.21.15.139:0/1332600940 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:08.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9d600700 1 -- 172.21.15.139:0/1332600940 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381461033 0 0) 0x7f9aa0070410 con 0x7f9aa01612a0 2024-09-13T17:26:08.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9d600700 1 -- 172.21.15.139:0/1332600940 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a840035d0 con 0x7f9aa01612a0 2024-09-13T17:26:08.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9e000700 1 -- 172.21.15.139:0/1332600940 >> v1:172.21.15.176:6789/0 conn(0x7f9aa006d2a0 legacy=0x7f9aa006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9d600700 1 -- 172.21.15.139:0/1332600940 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86653976 0 0) 0x7f9aa00706f0 con 0x7f9aa006d2a0 2024-09-13T17:26:08.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9e000700 1 -- 172.21.15.139:0/1332600940 >> v1:172.21.15.139:6789/0 conn(0x7f9aa01612a0 legacy=0x7f9aa00b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9e000700 1 -- 172.21.15.139:0/1332600940 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00709d0 con 0x7f9aa00cc370 2024-09-13T17:26:08.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9e000700 1 --2- 172.21.15.139:0/1332600940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00cc7e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009850 tx=0x7f9a8c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33823ca888dbd0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9d600700 1 -- 172.21.15.139:0/1332600940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c011830 con 0x7f9aa00cc370 2024-09-13T17:26:08.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9d600700 1 -- 172.21.15.139:0/1332600940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c011990 con 0x7f9aa00cc370 2024-09-13T17:26:08.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.601+0000 7f9a9d600700 1 -- 172.21.15.139:0/1332600940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c011d40 con 0x7f9aa00cc370 2024-09-13T17:26:08.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1332600940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 msgr2=0x7f9aa00cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1332600940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00cc7e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009850 tx=0x7f9a8c009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:08.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1332600940 shutdown_connections 2024-09-13T17:26:08.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1332600940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00cc7e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1332600940 >> 172.21.15.139:0/1332600940 conn(0x7f9aa006b1e0 msgr2=0x7f9aa006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:08.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1332600940 shutdown_connections 2024-09-13T17:26:08.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1332600940 wait complete. 2024-09-13T17:26:08.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 Processor -- start 2024-09-13T17:26:08.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.605+0000 7f9aa5c00700 1 -- start start 2024-09-13T17:26:08.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa006d2a0 0x7f9aa0163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa01612a0 0x7f9aa00b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0161c40 con 0x7f9aa00cc370 2024-09-13T17:26:08.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0163aa0 con 0x7f9aa006d2a0 2024-09-13T17:26:08.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0162ba0 con 0x7f9aa01612a0 2024-09-13T17:26:08.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34874/0 (socket says 172.21.15.139:34874) 2024-09-13T17:26:08.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 -- 172.21.15.139:0/1249308789 learned_addr learned my addr 172.21.15.139:0/1249308789 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9ea00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa006d2a0 0x7f9aa0163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9f400700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa01612a0 0x7f9aa00b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 -- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa01612a0 msgr2=0x7f9aa00b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa01612a0 0x7f9aa00b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 -- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa006d2a0 msgr2=0x7f9aa0163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa006d2a0 0x7f9aa0163f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 -- 172.21.15.139:0/1249308789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c0094b0 con 0x7f9aa00cc370 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a9e000700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00aff20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009eb0 tx=0x7f9a8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c01aba0 con 0x7f9aa00cc370 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c01f070 con 0x7f9aa00cc370 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c01b430 con 0x7f9aa00cc370 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0163730 con 0x7f9aa00cc370 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.609+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa01618f0 con 0x7f9aa00cc370 2024-09-13T17:26:08.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.613+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa0163c30 con 0x7f9aa00cc370 2024-09-13T17:26:08.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.613+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 13) v1 ==== 85930+0+0 (secure 0 0 0) 0x7f9a8c01b590 con 0x7f9aa00cc370 2024-09-13T17:26:08.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.613+0000 7f9a96a00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f9a800665b0 0x7f9a80068a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:08.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.613+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f9a8c0852c0 con 0x7f9aa00cc370 2024-09-13T17:26:08.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.617+0000 7f9a9ea00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f9a800665b0 0x7f9a80068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:08.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.617+0000 7f9a9ea00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f9a800665b0 0x7f9a80068a70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9a90005930 tx=0x7f9a90009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:08.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.621+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a8c0525a0 con 0x7f9aa00cc370 2024-09-13T17:26:08.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.841+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9aa0161e40 con 0x7f9aa00cc370 2024-09-13T17:26:08.849 INFO:tasks.ceph.mon.a.smithi139.stderr:2024-09-13T17:26:08.845+0000 7fc23b800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:26:08.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.861+0000 7f9a96a00700 1 -- 172.21.15.139:0/1249308789 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9a8c021090 con 0x7f9aa00cc370 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f9a800665b0 msgr2=0x7f9a80068a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f9a800665b0 0x7f9a80068a70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9a90005930 tx=0x7f9a90009040 comp rx=0 tx=0).stop 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 msgr2=0x7f9aa00aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00aff20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009eb0 tx=0x7f9a8c004770 comp rx=0 tx=0).stop 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 shutdown_connections 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f9a800665b0 0x7f9a80068a70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa01612a0 0x7f9aa00b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa00cc370 0x7f9aa00aff20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 --2- 172.21.15.139:0/1249308789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa006d2a0 0x7f9aa0163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:08.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 >> 172.21.15.139:0/1249308789 conn(0x7f9aa006b1e0 msgr2=0x7f9aa01495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:08.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 shutdown_connections 2024-09-13T17:26:08.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:08.865+0000 7f9aa5c00700 1 -- 172.21.15.139:0/1249308789 wait complete. 2024-09-13T17:26:08.874 INFO:teuthology.orchestra.run.smithi139.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:26:08.878 INFO:tasks.ceph.mds.b.smithi176.stderr: -4118> 2024-09-13T17:25:45.392+0000 7fe6d4200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:26:08.894 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:26:08.940 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-13T17:26:09.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.057+0000 7fbd04e00700 1 Processor -- start 2024-09-13T17:26:09.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.057+0000 7fbd04e00700 1 -- start start 2024-09-13T17:26:09.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbd04e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbd00144770 0x7fbd000ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:09.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbd04e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0015c160 con 0x7fbd0015b1c0 2024-09-13T17:26:09.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbd04e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0015c540 con 0x7fbd0006d9b0 2024-09-13T17:26:09.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbd04e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd00144b50 con 0x7fbd00144770 2024-09-13T17:26:09.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfde00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbd00144770 0x7fbd000ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:09.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfd400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbd0015b1c0 0x7fbd0006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50766/0 (socket says 172.21.15.139:50766) 2024-09-13T17:26:09.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfd400700 1 -- 172.21.15.139:0/1582666741 learned_addr learned my addr 172.21.15.139:0/1582666741 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:09.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfca00700 1 -- 172.21.15.139:0/1582666741 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242331176 0 0) 0x7fbd0015c540 con 0x7fbd0006d9b0 2024-09-13T17:26:09.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfca00700 1 -- 172.21.15.139:0/1582666741 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce40035d0 con 0x7fbd0006d9b0 2024-09-13T17:26:09.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfde00700 1 -- 172.21.15.139:0/1582666741 >> v1:172.21.15.176:6789/0 conn(0x7fbd0006d9b0 legacy=0x7fbd0015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfde00700 1 -- 172.21.15.139:0/1582666741 >> v1:172.21.15.139:6789/0 conn(0x7fbd0015b1c0 legacy=0x7fbd0006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfca00700 1 -- 172.21.15.139:0/1582666741 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854763266 0 0) 0x7fbd0015c160 con 0x7fbd0015b1c0 2024-09-13T17:26:09.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfde00700 1 -- 172.21.15.139:0/1582666741 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0015b620 con 0x7fbd00144770 2024-09-13T17:26:09.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfde00700 1 --2- 172.21.15.139:0/1582666741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd00144770 0x7fbd000ce5f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009850 tx=0x7fbcf0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27953d294f7054c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:09.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.061+0000 7fbcfca00700 1 -- 172.21.15.139:0/1582666741 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0011830 con 0x7fbd00144770 2024-09-13T17:26:09.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbcfca00700 1 -- 172.21.15.139:0/1582666741 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0011990 con 0x7fbd00144770 2024-09-13T17:26:09.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbcfca00700 1 -- 172.21.15.139:0/1582666741 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0011d00 con 0x7fbd00144770 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 -- 172.21.15.139:0/1582666741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd00144770 msgr2=0x7fbd000ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 --2- 172.21.15.139:0/1582666741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd00144770 0x7fbd000ce5f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009850 tx=0x7fbcf0009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 -- 172.21.15.139:0/1582666741 shutdown_connections 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 --2- 172.21.15.139:0/1582666741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd00144770 0x7fbd000ce5f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 -- 172.21.15.139:0/1582666741 >> 172.21.15.139:0/1582666741 conn(0x7fbd0006b1e0 msgr2=0x7fbd0006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 -- 172.21.15.139:0/1582666741 shutdown_connections 2024-09-13T17:26:09.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 -- 172.21.15.139:0/1582666741 wait complete. 2024-09-13T17:26:09.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 Processor -- start 2024-09-13T17:26:09.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.065+0000 7fbd04e00700 1 -- start start 2024-09-13T17:26:09.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0006d9b0 0x7fbd0015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:09.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 0x7fbd00140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0013fa20 0x7fbd000aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0013fed0 con 0x7fbd0015b1c0 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000aa930 con 0x7fbd0006d9b0 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0013ef80 con 0x7fbd0013fa20 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 0x7fbd00140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 0x7fbd00140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34900/0 (socket says 172.21.15.139:34900) 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 -- 172.21.15.139:0/308182839 learned_addr learned my addr 172.21.15.139:0/308182839 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfde00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0006d9b0 0x7fbd0015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:09.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfe800700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0013fa20 0x7fbd000aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:09.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 -- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0013fa20 msgr2=0x7fbd000aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0013fa20 0x7fbd000aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 -- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0006d9b0 msgr2=0x7fbd0015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0006d9b0 0x7fbd0015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 -- 172.21.15.139:0/308182839 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00094b0 con 0x7fbd0015b1c0 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfde00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0006d9b0 0x7fbd0015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfe800700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0013fa20 0x7fbd000aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcfd400700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 0x7fbd00140dc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00c580 tx=0x7fbcec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec004ca0 con 0x7fbd0015b1c0 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec004e20 con 0x7fbd0015b1c0 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd000aab60 con 0x7fbd0015b1c0 2024-09-13T17:26:09.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec007310 con 0x7fbd0015b1c0 2024-09-13T17:26:09.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.069+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0013f500 con 0x7fbd0015b1c0 2024-09-13T17:26:09.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.073+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0013f720 con 0x7fbd0015b1c0 2024-09-13T17:26:09.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.073+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 14) v1 ==== 86138+0+0 (secure 0 0 0) 0x7fbcec007470 con 0x7fbd0015b1c0 2024-09-13T17:26:09.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.077+0000 7fbcf6000700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbce00667c0 0x7fbce0068c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:09.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.077+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6760+0+0 (secure 0 0 0) 0x7fbcec0843a0 con 0x7fbd0015b1c0 2024-09-13T17:26:09.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.077+0000 7fbcfde00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbce00667c0 0x7fbce0068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:09.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.077+0000 7fbcfde00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbce00667c0 0x7fbce0068c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbd00073500 tx=0x7fbcf0008030 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:09.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.081+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcec051290 con 0x7fbd0015b1c0 2024-09-13T17:26:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.297+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbd000ce5f0 con 0x7fbd0015b1c0 2024-09-13T17:26:09.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.881+0000 7fbcf6000700 1 -- 172.21.15.139:0/308182839 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbcec007720 con 0x7fbd0015b1c0 2024-09-13T17:26:09.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbce00667c0 msgr2=0x7fbce0068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbce00667c0 0x7fbce0068c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbd00073500 tx=0x7fbcf0008030 comp rx=0 tx=0).stop 2024-09-13T17:26:09.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 msgr2=0x7fbd00140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:09.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 0x7fbd00140dc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00c580 tx=0x7fbcec00c940 comp rx=0 tx=0).stop 2024-09-13T17:26:09.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 shutdown_connections 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbce00667c0 0x7fbce0068c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0013fa20 0x7fbd000aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd0015b1c0 0x7fbd00140dc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 --2- 172.21.15.139:0/308182839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0006d9b0 0x7fbd0015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 >> 172.21.15.139:0/308182839 conn(0x7fbd0006b1e0 msgr2=0x7fbd0015d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 shutdown_connections 2024-09-13T17:26:09.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:09.885+0000 7fbd04e00700 1 -- 172.21.15.139:0/308182839 wait complete. 2024-09-13T17:26:09.913 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:26:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 Processor -- start 2024-09-13T17:26:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 -- start start 2024-09-13T17:26:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b4c1598f0 0x7f4b4c06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c157310 con 0x7f4b4c0b3120 2024-09-13T17:26:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0ce720 con 0x7f4b4c1598f0 2024-09-13T17:26:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b52400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c159df0 con 0x7f4b4c156f30 2024-09-13T17:26:10.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.093+0000 7f4b4aa00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b4c1598f0 0x7f4b4c06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:10.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4be00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f4b4c0b3120 0x7f4b4c15cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:50008/0 (socket says 172.21.15.139:50008) 2024-09-13T17:26:10.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4be00700 1 -- 172.21.15.139:0/3404849056 learned_addr learned my addr 172.21.15.139:0/3404849056 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:10.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4b400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:10.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3404849056 >> v2:172.21.15.176:3300/0 conn(0x7f4b4c1598f0 0x7f4b4c06cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:45972/0 (socket says 172.21.15.139:45972) 2024-09-13T17:26:10.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4a000700 1 -- 172.21.15.139:0/3404849056 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743055557 0 0) 0x7f4b4c157310 con 0x7f4b4c0b3120 2024-09-13T17:26:10.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4a000700 1 -- 172.21.15.139:0/3404849056 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b300035d0 con 0x7f4b4c0b3120 2024-09-13T17:26:10.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4aa00700 1 -- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 msgr2=0x7f4b4c0b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:10.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c0b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4aa00700 1 -- 172.21.15.139:0/3404849056 >> v1:172.21.15.176:6789/0 conn(0x7f4b4c0b3120 legacy=0x7f4b4c15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:10.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4aa00700 1 -- 172.21.15.139:0/3404849056 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c15a0d0 con 0x7f4b4c1598f0 2024-09-13T17:26:10.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c06cc30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800baf0 tx=0x7f4b3800be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a090840c5ead82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:10.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4a000700 1 -- 172.21.15.139:0/3404849056 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800dc70 con 0x7f4b4c1598f0 2024-09-13T17:26:10.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4a000700 1 -- 172.21.15.139:0/3404849056 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3800ddd0 con 0x7f4b4c1598f0 2024-09-13T17:26:10.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b4a000700 1 -- 172.21.15.139:0/3404849056 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b38010690 con 0x7f4b4c1598f0 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b52400700 1 -- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 msgr2=0x7f4b4c06cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b52400700 1 --2- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c06cc30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800baf0 tx=0x7f4b3800be00 comp rx=0 tx=0).stop 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b52400700 1 -- 172.21.15.139:0/3404849056 shutdown_connections 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b52400700 1 --2- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c06cc30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b52400700 1 --2- 172.21.15.139:0/3404849056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c0b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.097+0000 7f4b52400700 1 -- 172.21.15.139:0/3404849056 >> 172.21.15.139:0/3404849056 conn(0x7f4b4c0cc7e0 msgr2=0x7f4b4c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:10.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.101+0000 7f4b52400700 1 -- 172.21.15.139:0/3404849056 shutdown_connections 2024-09-13T17:26:10.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.101+0000 7f4b52400700 1 -- 172.21.15.139:0/3404849056 wait complete. 2024-09-13T17:26:10.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 Processor -- start 2024-09-13T17:26:10.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 -- start start 2024-09-13T17:26:10.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 0x7f4b4c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:10.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:10.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:10.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1554f0 con 0x7f4b4c0b3120 2024-09-13T17:26:10.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0722f0 con 0x7f4b4c1598f0 2024-09-13T17:26:10.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b52400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c4bd0 con 0x7f4b4c156f30 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 0x7f4b4c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 0x7f4b4c0c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34914/0 (socket says 172.21.15.139:34914) 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4b400700 1 -- 172.21.15.139:0/3543895415 learned_addr learned my addr 172.21.15.139:0/3543895415 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4be00700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4aa00700 1 -- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 msgr2=0x7f4b4c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4aa00700 1 -- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 msgr2=0x7f4b4c0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 0x7f4b4c0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4aa00700 1 -- 172.21.15.139:0/3543895415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3800b750 con 0x7f4b4c156f30 2024-09-13T17:26:10.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.105+0000 7f4b4b400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 0x7f4b4c0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:10.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b4aa00700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c070f00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c06e460 tx=0x7f4b38004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:10.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b38003b90 con 0x7f4b4c156f30 2024-09-13T17:26:10.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b38003d10 con 0x7f4b4c156f30 2024-09-13T17:26:10.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c154870 con 0x7f4b4c156f30 2024-09-13T17:26:10.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380106b0 con 0x7f4b4c156f30 2024-09-13T17:26:10.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c154e30 con 0x7f4b4c156f30 2024-09-13T17:26:10.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.109+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c067040 con 0x7f4b4c156f30 2024-09-13T17:26:10.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.113+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 14) v1 ==== 86138+0+0 (secure 0 0 0) 0x7f4b38010810 con 0x7f4b4c156f30 2024-09-13T17:26:10.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.113+0000 7f4b43400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4b2c066810 0x7f4b2c068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.113+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6760+0+0 (secure 0 0 0) 0x7f4b38085fe0 con 0x7f4b4c156f30 2024-09-13T17:26:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.113+0000 7f4b4b400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4b2c066810 0x7f4b2c068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:10.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.113+0000 7f4b4b400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4b2c066810 0x7f4b2c068cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c155d50 tx=0x7f4b3c009240 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.121+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b38052f30 con 0x7f4b4c156f30 2024-09-13T17:26:10.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.297+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b4c155630 con 0x7f4b4c156f30 2024-09-13T17:26:10.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.893+0000 7f4b43400700 1 -- 172.21.15.139:0/3543895415 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4b4c155630 con 0x7f4b4c156f30 2024-09-13T17:26:10.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4b2c066810 msgr2=0x7f4b2c068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:10.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4b2c066810 0x7f4b2c068cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c155d50 tx=0x7f4b3c009240 comp rx=0 tx=0).stop 2024-09-13T17:26:10.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 msgr2=0x7f4b4c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:10.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c070f00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c06e460 tx=0x7f4b38004770 comp rx=0 tx=0).stop 2024-09-13T17:26:10.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 shutdown_connections 2024-09-13T17:26:10.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4b2c066810 0x7f4b2c068cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b4c1598f0 0x7f4b4c071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4c156f30 0x7f4b4c070f00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 --2- 172.21.15.139:0/3543895415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b4c0b3120 0x7f4b4c0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:10.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.897+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 >> 172.21.15.139:0/3543895415 conn(0x7f4b4c0cc7e0 msgr2=0x7f4b4c14f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:10.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.901+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 shutdown_connections 2024-09-13T17:26:10.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:10.901+0000 7f4b52400700 1 -- 172.21.15.139:0/3543895415 wait complete. 2024-09-13T17:26:10.907 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:26:10.930 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:26:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.101+0000 7ff413200700 1 Processor -- start 2024-09-13T17:26:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.101+0000 7ff413200700 1 -- start start 2024-09-13T17:26:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff413200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff40c1441c0 0x7ff40c06c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff413200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff40c15b310 0x7ff40c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff413200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c06d8d0 0x7ff40c0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff413200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c144ae0 con 0x7ff40c1441c0 2024-09-13T17:26:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff413200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0cd340 con 0x7ff40c15b310 2024-09-13T17:26:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff413200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c1445a0 con 0x7ff40c06d8d0 2024-09-13T17:26:11.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff40c1441c0 0x7ff40c06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff40c1441c0 0x7ff40c06c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34920/0 (socket says 172.21.15.139:34920) 2024-09-13T17:26:11.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff403e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff40c15b310 0x7ff40c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 -- 172.21.15.139:0/3815000731 learned_addr learned my addr 172.21.15.139:0/3815000731 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:11.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff411200700 1 --2- 172.21.15.139:0/3815000731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c06d8d0 0x7ff40c0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 -- 172.21.15.139:0/3815000731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c06d8d0 msgr2=0x7ff40c0b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:11.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 --2- 172.21.15.139:0/3815000731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c06d8d0 0x7ff40c0b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 -- 172.21.15.139:0/3815000731 >> v2:172.21.15.176:3300/0 conn(0x7ff40c15b310 msgr2=0x7ff40c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:11.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 --2- 172.21.15.139:0/3815000731 >> v2:172.21.15.176:3300/0 conn(0x7ff40c15b310 0x7ff40c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 -- 172.21.15.139:0/3815000731 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c06de40 con 0x7ff40c1441c0 2024-09-13T17:26:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40be00700 1 --2- 172.21.15.139:0/3815000731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c1441c0 0x7ff40c06c530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0cec60 tx=0x7ff3fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ffcfd8254e540c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40b400700 1 -- 172.21.15.139:0/3815000731 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011830 con 0x7ff40c1441c0 2024-09-13T17:26:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40b400700 1 -- 172.21.15.139:0/3815000731 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc011990 con 0x7ff40c1441c0 2024-09-13T17:26:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.105+0000 7ff40b400700 1 -- 172.21.15.139:0/3815000731 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011d20 con 0x7ff40c1441c0 2024-09-13T17:26:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 -- 172.21.15.139:0/3815000731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c1441c0 msgr2=0x7ff40c06c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 --2- 172.21.15.139:0/3815000731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c1441c0 0x7ff40c06c530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0cec60 tx=0x7ff3fc009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 -- 172.21.15.139:0/3815000731 shutdown_connections 2024-09-13T17:26:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 --2- 172.21.15.139:0/3815000731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c06d8d0 0x7ff40c0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 --2- 172.21.15.139:0/3815000731 >> v2:172.21.15.176:3300/0 conn(0x7ff40c15b310 0x7ff40c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 --2- 172.21.15.139:0/3815000731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c1441c0 0x7ff40c06c530 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 -- 172.21.15.139:0/3815000731 >> 172.21.15.139:0/3815000731 conn(0x7ff40c0cc7e0 msgr2=0x7ff40c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 -- 172.21.15.139:0/3815000731 shutdown_connections 2024-09-13T17:26:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 -- 172.21.15.139:0/3815000731 wait complete. 2024-09-13T17:26:11.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 Processor -- start 2024-09-13T17:26:11.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.109+0000 7ff413200700 1 -- start start 2024-09-13T17:26:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 0x7ff40c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c1441c0 0x7ff40c070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff40c1f6230 0x7ff40c139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0ae200 con 0x7ff40c06d8d0 2024-09-13T17:26:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c071400 con 0x7ff40c1f6230 2024-09-13T17:26:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0add70 con 0x7ff40c1441c0 2024-09-13T17:26:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 0x7ff40c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 0x7ff40c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34924/0 (socket says 172.21.15.139:34924) 2024-09-13T17:26:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 -- 172.21.15.139:0/2646354912 learned_addr learned my addr 172.21.15.139:0/2646354912 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff411200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff40c1f6230 0x7ff40c139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff403e00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c1441c0 0x7ff40c070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 -- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c1441c0 msgr2=0x7ff40c070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c1441c0 0x7ff40c070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 -- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff40c1f6230 msgr2=0x7ff40c139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff40c1f6230 0x7ff40c139640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 -- 172.21.15.139:0/2646354912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc009570 con 0x7ff40c06d8d0 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff40be00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 0x7ff40c071c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff40c06c4c0 tx=0x7ff3fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc004300 con 0x7ff40c06d8d0 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc01f070 con 0x7ff40c06d8d0 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0036c0 con 0x7ff40c06d8d0 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0ad440 con 0x7ff40c06d8d0 2024-09-13T17:26:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.113+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c0ada00 con 0x7ff40c06d8d0 2024-09-13T17:26:11.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.117+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c067040 con 0x7ff40c06d8d0 2024-09-13T17:26:11.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.117+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7ff3fc021030 con 0x7ff40c06d8d0 2024-09-13T17:26:11.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.121+0000 7ff408c00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7ff3e8066850 0x7ff3e8068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:11.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.121+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff3fc085780 con 0x7ff40c06d8d0 2024-09-13T17:26:11.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.121+0000 7ff403e00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7ff3e8066850 0x7ff3e8068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:11.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.121+0000 7ff403e00700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7ff3e8066850 0x7ff3e8068d10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0ae930 tx=0x7ff3f4008040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:11.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.125+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3fc052900 con 0x7ff40c06d8d0 2024-09-13T17:26:11.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.305+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff40c1391b0 con 0x7ff40c06d8d0 2024-09-13T17:26:11.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.917+0000 7ff408c00700 1 -- 172.21.15.139:0/2646354912 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff3fc055f20 con 0x7ff40c06d8d0 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7ff3e8066850 msgr2=0x7ff3e8068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7ff3e8066850 0x7ff3e8068d10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0ae930 tx=0x7ff3f4008040 comp rx=0 tx=0).stop 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 msgr2=0x7ff40c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 0x7ff40c071c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff40c06c4c0 tx=0x7ff3fc004770 comp rx=0 tx=0).stop 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 shutdown_connections 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7ff3e8066850 0x7ff3e8068d10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff40c1f6230 0x7ff40c139640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff40c1441c0 0x7ff40c070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 --2- 172.21.15.139:0/2646354912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff40c06d8d0 0x7ff40c071c60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:11.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 >> 172.21.15.139:0/2646354912 conn(0x7ff40c0cc7e0 msgr2=0x7ff40c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:11.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 shutdown_connections 2024-09-13T17:26:11.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:11.921+0000 7ff413200700 1 -- 172.21.15.139:0/2646354912 wait complete. 2024-09-13T17:26:11.929 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' removed 2024-09-13T17:26:11.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:26:12.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.125+0000 7fb98ca00700 1 Processor -- start 2024-09-13T17:26:12.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.125+0000 7fb98ca00700 1 -- start start 2024-09-13T17:26:12.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb98ca00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb9880721e0 0x7fb988070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb98ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb98ca00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880705c0 con 0x7fb988159bd0 2024-09-13T17:26:12.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb98ca00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb988159fb0 con 0x7fb9880721e0 2024-09-13T17:26:12.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb98ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880cb920 con 0x7fb9880712c0 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb9880721e0 0x7fb988070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb9880721e0 0x7fb988070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34930/0 (socket says 172.21.15.139:34930) 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 -- 172.21.15.139:0/1197413634 learned_addr learned my addr 172.21.15.139:0/1197413634 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb986800700 1 --2- 172.21.15.139:0/1197413634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 -- 172.21.15.139:0/1197413634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 msgr2=0x7fb98806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 --2- 172.21.15.139:0/1197413634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 -- 172.21.15.139:0/1197413634 >> v1:172.21.15.176:6789/0 conn(0x7fb988159bd0 legacy=0x7fb9880b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 -- 172.21.15.139:0/1197413634 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880cbc00 con 0x7fb9880721e0 2024-09-13T17:26:12.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb985400700 1 --2- 172.21.15.139:0/1197413634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988070d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb974009940 tx=0x7fb974009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23b05b4b8ff0fed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb984a00700 1 -- 172.21.15.139:0/1197413634 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400ba20 con 0x7fb9880721e0 2024-09-13T17:26:12.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb984a00700 1 -- 172.21.15.139:0/1197413634 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb974009e90 con 0x7fb9880721e0 2024-09-13T17:26:12.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.129+0000 7fb984a00700 1 -- 172.21.15.139:0/1197413634 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400bda0 con 0x7fb9880721e0 2024-09-13T17:26:12.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 -- 172.21.15.139:0/1197413634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 msgr2=0x7fb988070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 --2- 172.21.15.139:0/1197413634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988070d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb974009940 tx=0x7fb974009c50 comp rx=0 tx=0).stop 2024-09-13T17:26:12.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 -- 172.21.15.139:0/1197413634 shutdown_connections 2024-09-13T17:26:12.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 --2- 172.21.15.139:0/1197413634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 --2- 172.21.15.139:0/1197413634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988070d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 -- 172.21.15.139:0/1197413634 >> 172.21.15.139:0/1197413634 conn(0x7fb98806b1e0 msgr2=0x7fb98806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:12.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 -- 172.21.15.139:0/1197413634 shutdown_connections 2024-09-13T17:26:12.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 -- 172.21.15.139:0/1197413634 wait complete. 2024-09-13T17:26:12.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 Processor -- start 2024-09-13T17:26:12.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.133+0000 7fb98ca00700 1 -- start start 2024-09-13T17:26:12.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb988159bd0 0x7fb988151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988159040 con 0x7fb9880721e0 2024-09-13T17:26:12.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988150b10 con 0x7fb988159bd0 2024-09-13T17:26:12.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98814eec0 con 0x7fb9880712c0 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34938/0 (socket says 172.21.15.139:34938) 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 -- 172.21.15.139:0/827244552 learned_addr learned my addr 172.21.15.139:0/827244552 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb986800700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb988159bd0 0x7fb988151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 -- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 msgr2=0x7fb98814e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98814e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 -- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb988159bd0 msgr2=0x7fb988151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb988159bd0 0x7fb988151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 -- 172.21.15.139:0/827244552 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974009570 con 0x7fb9880721e0 2024-09-13T17:26:12.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb986800700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb988159bd0 0x7fb988151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:12.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb985400700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988150fa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974004450 con 0x7fb9880721e0 2024-09-13T17:26:12.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97401f070 con 0x7fb9880721e0 2024-09-13T17:26:12.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974003900 con 0x7fb9880721e0 2024-09-13T17:26:12.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98815cb50 con 0x7fb9880721e0 2024-09-13T17:26:12.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.137+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9881507a0 con 0x7fb9880721e0 2024-09-13T17:26:12.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.141+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb988150930 con 0x7fb9880721e0 2024-09-13T17:26:12.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.141+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb974003a60 con 0x7fb9880721e0 2024-09-13T17:26:12.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.141+0000 7fb97e000700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb968066880 0x7fb968068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.141+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fb974021070 con 0x7fb9880721e0 2024-09-13T17:26:12.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.141+0000 7fb985e00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb968066880 0x7fb968068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.145+0000 7fb985e00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb968066880 0x7fb968068d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb978000f60 tx=0x7fb978009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.149+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb974052a20 con 0x7fb9880721e0 2024-09-13T17:26:12.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.329+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb98806d2a0 con 0x7fb9880721e0 2024-09-13T17:26:12.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.337+0000 7fb97e000700 1 -- 172.21.15.139:0/827244552 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb974056040 con 0x7fb9880721e0 2024-09-13T17:26:12.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb968066880 msgr2=0x7fb968068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb968066880 0x7fb968068d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb978000f60 tx=0x7fb978009040 comp rx=0 tx=0).stop 2024-09-13T17:26:12.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 msgr2=0x7fb988150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988150fa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974004770 comp rx=0 tx=0).stop 2024-09-13T17:26:12.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 shutdown_connections 2024-09-13T17:26:12.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb968066880 0x7fb968068d40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb988159bd0 0x7fb988151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9880721e0 0x7fb988150fa0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 --2- 172.21.15.139:0/827244552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9880712c0 0x7fb98814e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 >> 172.21.15.139:0/827244552 conn(0x7fb98806b1e0 msgr2=0x7fb9880b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:12.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 shutdown_connections 2024-09-13T17:26:12.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.345+0000 7fb98ca00700 1 -- 172.21.15.139:0/827244552 wait complete. 2024-09-13T17:26:12.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-09-13T17:26:12.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.545+0000 7fe0b1600700 1 Processor -- start 2024-09-13T17:26:12.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.545+0000 7fe0b1600700 1 -- start start 2024-09-13T17:26:12.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:12.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b1600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0ac0cddd0 0x7fe0ac165680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b1600700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac070140 con 0x7fe0ac15aff0 2024-09-13T17:26:12.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b1600700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac070420 con 0x7fe0ac144300 2024-09-13T17:26:12.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b1600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac070700 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:12.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b0c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0ac0cddd0 0x7fe0ac165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0ab400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe0ac15aff0 0x7fe0ac0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50770/0 (socket says 172.21.15.139:50770) 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0ab400700 1 -- 172.21.15.139:0/1381414878 learned_addr learned my addr 172.21.15.139:0/1381414878 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b0c00700 1 -- 172.21.15.139:0/1381414878 >> v1:172.21.15.176:6789/0 conn(0x7fe0ac144300 legacy=0x7fe0ac06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0aaa00700 1 -- 172.21.15.139:0/1381414878 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962734634 0 0) 0x7fe0ac070420 con 0x7fe0ac144300 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b0c00700 1 -- 172.21.15.139:0/1381414878 >> v1:172.21.15.139:6789/0 conn(0x7fe0ac15aff0 legacy=0x7fe0ac0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.549+0000 7fe0b0c00700 1 -- 172.21.15.139:0/1381414878 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac0709e0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b0c00700 1 --2- 172.21.15.139:0/1381414878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac165680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009880 tx=0x7fe0a4009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99afd55066fe43f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0aaa00700 1 -- 172.21.15.139:0/1381414878 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4004230 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0aaa00700 1 -- 172.21.15.139:0/1381414878 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a4004390 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 -- 172.21.15.139:0/1381414878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 msgr2=0x7fe0ac165680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 --2- 172.21.15.139:0/1381414878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac165680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009880 tx=0x7fe0a4009b90 comp rx=0 tx=0).stop 2024-09-13T17:26:12.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 -- 172.21.15.139:0/1381414878 shutdown_connections 2024-09-13T17:26:12.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 --2- 172.21.15.139:0/1381414878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac165680 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 -- 172.21.15.139:0/1381414878 >> 172.21.15.139:0/1381414878 conn(0x7fe0ac0ce9d0 msgr2=0x7fe0ac0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:12.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 -- 172.21.15.139:0/1381414878 shutdown_connections 2024-09-13T17:26:12.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.553+0000 7fe0b1600700 1 -- 172.21.15.139:0/1381414878 wait complete. 2024-09-13T17:26:12.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 Processor -- start 2024-09-13T17:26:12.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 -- start start 2024-09-13T17:26:12.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac1f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac144300 0x7fe0ac0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac15aff0 0x7fe0ac0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac140670 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac13f380 con 0x7fe0ac15aff0 2024-09-13T17:26:12.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b1600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac1401e0 con 0x7fe0ac144300 2024-09-13T17:26:12.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac1f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac1f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34962/0 (socket says 172.21.15.139:34962) 2024-09-13T17:26:12.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 -- 172.21.15.139:0/950413094 learned_addr learned my addr 172.21.15.139:0/950413094 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:12.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0ab400700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac144300 0x7fe0ac0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0b0c00700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac15aff0 0x7fe0ac0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 -- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac144300 msgr2=0x7fe0ac0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac144300 0x7fe0ac0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 -- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac15aff0 msgr2=0x7fe0ac0cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac15aff0 0x7fe0ac0cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.557+0000 7fe0abe00700 1 -- 172.21.15.139:0/950413094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40094b0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0abe00700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac1f5fb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00ccd0 tx=0x7fe09c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c003e50 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c00a990 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00ad40 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac06deb0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac13f5d0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac1446e0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.561+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fe09c005070 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.565+0000 7fe0a3e00700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fe08c066850 0x7fe08c068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.565+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fe09c0845e0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.565+0000 7fe0ab400700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fe08c066850 0x7fe08c068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.565+0000 7fe0ab400700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fe08c066850 0x7fe08c068d10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe098007c40 tx=0x7fe098007d90 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.573+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe09c0516d0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.749+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe0ac0b04d0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.757+0000 7fe0a3e00700 1 -- 172.21.15.139:0/950413094 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe09c054cf0 con 0x7fe0ac0cddd0 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fe08c066850 msgr2=0x7fe08c068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fe08c066850 0x7fe08c068d10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe098007c40 tx=0x7fe098007d90 comp rx=0 tx=0).stop 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 msgr2=0x7fe0ac1f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac1f5fb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00ccd0 tx=0x7fe09c00a340 comp rx=0 tx=0).stop 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 shutdown_connections 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fe08c066850 0x7fe08c068d10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac15aff0 0x7fe0ac0cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac144300 0x7fe0ac0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 --2- 172.21.15.139:0/950413094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ac0cddd0 0x7fe0ac1f5fb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 >> 172.21.15.139:0/950413094 conn(0x7fe0ac0ce9d0 msgr2=0x7fe0ac06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:12.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 shutdown_connections 2024-09-13T17:26:12.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.761+0000 7fe0b1600700 1 -- 172.21.15.139:0/950413094 wait complete. 2024-09-13T17:26:12.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2024-09-13T17:26:12.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.961+0000 7fb167e00700 1 Processor -- start 2024-09-13T17:26:12.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.961+0000 7fb167e00700 1 -- start start 2024-09-13T17:26:12.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb167e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb168165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb167e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16806e690 con 0x7fb1680cdc90 2024-09-13T17:26:12.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb167e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1680ce150 con 0x7fb168151d50 2024-09-13T17:26:12.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb167e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680ce430 con 0x7fb168071570 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb166000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb1680cdc90 0x7fb168070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50776/0 (socket says 172.21.15.139:50776) 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb166000700 1 -- 172.21.15.139:0/3714923328 learned_addr learned my addr 172.21.15.139:0/3714923328 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb166a00700 1 --1- 172.21.15.139:0/3714923328 >> v1:172.21.15.176:6789/0 conn(0x7fb168151d50 0x7fb16806df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:50040/0 (socket says 172.21.15.139:50040) 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.965+0000 7fb167400700 1 --2- 172.21.15.139:0/3714923328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb168165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046603741 0 0) 0x7fb1680ce150 con 0x7fb168151d50 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb14c0035d0 con 0x7fb168151d50 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159264114 0 0) 0x7fb16806e690 con 0x7fb1680cdc90 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1680ce150 con 0x7fb1680cdc90 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb167400700 1 -- 172.21.15.139:0/3714923328 >> v1:172.21.15.176:6789/0 conn(0x7fb168151d50 legacy=0x7fb16806df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb167400700 1 -- 172.21.15.139:0/3714923328 >> v1:172.21.15.139:6789/0 conn(0x7fb1680cdc90 legacy=0x7fb168070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb167400700 1 -- 172.21.15.139:0/3714923328 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680ce710 con 0x7fb168071570 2024-09-13T17:26:12.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb167400700 1 --2- 172.21.15.139:0/3714923328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb168165a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb160009dc0 tx=0x7fb16000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69bc480be94cac2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000e070 con 0x7fb168071570 2024-09-13T17:26:12.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000bb20 con 0x7fb168071570 2024-09-13T17:26:12.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb165600700 1 -- 172.21.15.139:0/3714923328 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160012430 con 0x7fb168071570 2024-09-13T17:26:12.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb167e00700 1 -- 172.21.15.139:0/3714923328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 msgr2=0x7fb168165a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.969+0000 7fb167e00700 1 --2- 172.21.15.139:0/3714923328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb168165a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb160009dc0 tx=0x7fb16000b330 comp rx=0 tx=0).stop 2024-09-13T17:26:12.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.973+0000 7fb167e00700 1 -- 172.21.15.139:0/3714923328 shutdown_connections 2024-09-13T17:26:12.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.973+0000 7fb167e00700 1 --2- 172.21.15.139:0/3714923328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb168165a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.973+0000 7fb167e00700 1 -- 172.21.15.139:0/3714923328 >> 172.21.15.139:0/3714923328 conn(0x7fb16806efa0 msgr2=0x7fb1680b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:12.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.973+0000 7fb167e00700 1 -- 172.21.15.139:0/3714923328 shutdown_connections 2024-09-13T17:26:12.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.973+0000 7fb167e00700 1 -- 172.21.15.139:0/3714923328 wait complete. 2024-09-13T17:26:12.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.973+0000 7fb167e00700 1 Processor -- start 2024-09-13T17:26:12.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 -- start start 2024-09-13T17:26:12.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb16814f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1680cdc90 0x7fb1681521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 0x7fb168152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1681555d0 con 0x7fb168151d50 2024-09-13T17:26:12.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168151060 con 0x7fb1680cdc90 2024-09-13T17:26:12.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb168150450 con 0x7fb168071570 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 0x7fb168152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb166a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb16814f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 0x7fb168152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34970/0 (socket says 172.21.15.139:34970) 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 -- 172.21.15.139:0/4067436788 learned_addr learned my addr 172.21.15.139:0/4067436788 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb166000700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1680cdc90 0x7fb1681521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 -- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 msgr2=0x7fb16814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb16814f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 -- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1680cdc90 msgr2=0x7fb1681521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:12.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1680cdc90 0x7fb1681521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:12.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 -- 172.21.15.139:0/4067436788 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009a70 con 0x7fb168151d50 2024-09-13T17:26:12.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167400700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 0x7fb168152720 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb16000b370 tx=0x7fb160004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160012430 con 0x7fb168151d50 2024-09-13T17:26:12.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160020070 con 0x7fb168151d50 2024-09-13T17:26:12.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16001ba50 con 0x7fb168151d50 2024-09-13T17:26:12.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.977+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168150730 con 0x7fb168151d50 2024-09-13T17:26:12.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.981+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb168150cf0 con 0x7fb168151d50 2024-09-13T17:26:12.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.981+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168151210 con 0x7fb168151d50 2024-09-13T17:26:12.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.981+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb16001bbb0 con 0x7fb168151d50 2024-09-13T17:26:12.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.985+0000 7fb15f400700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb148066880 0x7fb148068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:12.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.985+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fb160022070 con 0x7fb168151d50 2024-09-13T17:26:12.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.985+0000 7fb166a00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb148066880 0x7fb148068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:12.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.985+0000 7fb166a00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb148066880 0x7fb148068d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb158000f60 tx=0x7fb158007e00 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:12.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:12.993+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb168151210 con 0x7fb168151d50 2024-09-13T17:26:13.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.169+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fb168151210 con 0x7fb168151d50 2024-09-13T17:26:13.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.177+0000 7fb15f400700 1 -- 172.21.15.139:0/4067436788 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb168151210 con 0x7fb168151d50 2024-09-13T17:26:13.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb148066880 msgr2=0x7fb148068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb148066880 0x7fb148068d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb158000f60 tx=0x7fb158007e00 comp rx=0 tx=0).stop 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 msgr2=0x7fb168152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 0x7fb168152720 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb16000b370 tx=0x7fb160004af0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 shutdown_connections 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb148066880 0x7fb148068d40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb168151d50 0x7fb168152720 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1680cdc90 0x7fb1681521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 --2- 172.21.15.139:0/4067436788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb168071570 0x7fb16814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 >> 172.21.15.139:0/4067436788 conn(0x7fb16806efa0 msgr2=0x7fb16815c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 shutdown_connections 2024-09-13T17:26:13.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.181+0000 7fb167e00700 1 -- 172.21.15.139:0/4067436788 wait complete. 2024-09-13T17:26:13.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2024-09-13T17:26:13.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.377+0000 7f59bf200700 1 Processor -- start 2024-09-13T17:26:13.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.377+0000 7f59bf200700 1 -- start start 2024-09-13T17:26:13.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59bf200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f59b8144770 0x7f59b80ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:13.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59bf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59bf200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b815c160 con 0x7f59b815b1c0 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59bf200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b815c540 con 0x7f59b8144770 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59bf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8144b50 con 0x7f59b806d9b0 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59afe00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f59b815b1c0 0x7f59b806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50786/0 (socket says 172.21.15.139:50786) 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59afe00700 1 -- 172.21.15.139:0/2338247985 learned_addr learned my addr 172.21.15.139:0/2338247985 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7e00700 1 --2- 172.21.15.139:0/2338247985 >> v2:172.21.15.139:3300/0 conn(0x7f59b8144770 0x7f59b80ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59bd200700 1 --2- 172.21.15.139:0/2338247985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7400700 1 -- 172.21.15.139:0/2338247985 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236068785 0 0) 0x7f59b815c160 con 0x7f59b815b1c0 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7400700 1 -- 172.21.15.139:0/2338247985 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599c0035d0 con 0x7f59b815b1c0 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7e00700 1 -- 172.21.15.139:0/2338247985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 msgr2=0x7f59b815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7e00700 1 --2- 172.21.15.139:0/2338247985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7e00700 1 -- 172.21.15.139:0/2338247985 >> v1:172.21.15.139:6789/0 conn(0x7f59b815b1c0 legacy=0x7f59b806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.381+0000 7f59b7e00700 1 -- 172.21.15.139:0/2338247985 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b815b620 con 0x7f59b8144770 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59b7e00700 1 --2- 172.21.15.139:0/2338247985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b8144770 0x7f59b80ce5f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009850 tx=0x7f59a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ac9e2eb0dd1a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59b7400700 1 -- 172.21.15.139:0/2338247985 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8011830 con 0x7f59b8144770 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59b7400700 1 -- 172.21.15.139:0/2338247985 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8011990 con 0x7f59b8144770 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59b7400700 1 -- 172.21.15.139:0/2338247985 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8011d40 con 0x7f59b8144770 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 -- 172.21.15.139:0/2338247985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b8144770 msgr2=0x7f59b80ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 --2- 172.21.15.139:0/2338247985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b8144770 0x7f59b80ce5f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009850 tx=0x7f59a8009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 -- 172.21.15.139:0/2338247985 shutdown_connections 2024-09-13T17:26:13.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 --2- 172.21.15.139:0/2338247985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 --2- 172.21.15.139:0/2338247985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b8144770 0x7f59b80ce5f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 -- 172.21.15.139:0/2338247985 >> 172.21.15.139:0/2338247985 conn(0x7f59b806b1e0 msgr2=0x7f59b806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:13.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 -- 172.21.15.139:0/2338247985 shutdown_connections 2024-09-13T17:26:13.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.385+0000 7f59bf200700 1 -- 172.21.15.139:0/2338247985 wait complete. 2024-09-13T17:26:13.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 Processor -- start 2024-09-13T17:26:13.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 -- start start 2024-09-13T17:26:13.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b8135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:13.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b8144770 0x7f59b80c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:13.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b815b1c0 0x7f59b80c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:13.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8142e30 con 0x7f59b815b1c0 2024-09-13T17:26:13.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8135770 con 0x7f59b8144770 2024-09-13T17:26:13.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80c5320 con 0x7f59b806d9b0 2024-09-13T17:26:13.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b815b1c0 0x7f59b80c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:13.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59b7e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b8135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:13.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59afe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b8144770 0x7f59b80c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:13.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59b7e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b8135230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:52870/0 (socket says 172.21.15.139:52870) 2024-09-13T17:26:13.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59b7e00700 1 -- 172.21.15.139:0/3744636789 learned_addr learned my addr 172.21.15.139:0/3744636789 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:13.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 -- 172.21.15.139:0/3744636789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 msgr2=0x7f59b8135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b8135230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 -- 172.21.15.139:0/3744636789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b8144770 msgr2=0x7f59b80c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b8144770 0x7f59b80c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 -- 172.21.15.139:0/3744636789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80094b0 con 0x7f59b815b1c0 2024-09-13T17:26:13.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.389+0000 7f59bd200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b815b1c0 0x7f59b80c4c80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b0a70 tx=0x7f59b000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:13.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.393+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000c940 con 0x7f59b815b1c0 2024-09-13T17:26:13.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.393+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000f040 con 0x7f59b815b1c0 2024-09-13T17:26:13.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.393+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000cce0 con 0x7f59b815b1c0 2024-09-13T17:26:13.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.393+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80c5600 con 0x7f59b815b1c0 2024-09-13T17:26:13.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.393+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b8135a60 con 0x7f59b815b1c0 2024-09-13T17:26:13.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.393+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80ce5f0 con 0x7f59b815b1c0 2024-09-13T17:26:13.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.397+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f59b0014480 con 0x7f59b815b1c0 2024-09-13T17:26:13.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.397+0000 7f59b4c00700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5994066850 0x7f5994068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:13.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.397+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f59b0084d40 con 0x7f59b815b1c0 2024-09-13T17:26:13.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.397+0000 7f59b7e00700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5994066850 0x7f5994068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:13.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.397+0000 7f59b7e00700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5994066850 0x7f5994068d10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f59a8000c00 tx=0x7f59a801c040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:13.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.405+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59b0051db0 con 0x7f59b815b1c0 2024-09-13T17:26:13.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.657+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f59b80ad7f0 con 0x7f59b815b1c0 2024-09-13T17:26:13.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.921+0000 7f59b4c00700 1 -- 172.21.15.139:0/3744636789 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v132) v1 ==== 155+0+0 (secure 0 0 0) 0x7f59b0018070 con 0x7f59b815b1c0 2024-09-13T17:26:13.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5994066850 msgr2=0x7f5994068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5994066850 0x7f5994068d10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f59a8000c00 tx=0x7f59a801c040 comp rx=0 tx=0).stop 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b815b1c0 msgr2=0x7f59b80c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b815b1c0 0x7f59b80c4c80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b0a70 tx=0x7f59b000ee50 comp rx=0 tx=0).stop 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 shutdown_connections 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5994066850 0x7f5994068d10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59b815b1c0 0x7f59b80c4c80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b8144770 0x7f59b80c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 --2- 172.21.15.139:0/3744636789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b806d9b0 0x7f59b8135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:13.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 >> 172.21.15.139:0/3744636789 conn(0x7f59b806b1e0 msgr2=0x7f59b80cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:13.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 shutdown_connections 2024-09-13T17:26:13.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:13.925+0000 7f59bf200700 1 -- 172.21.15.139:0/3744636789 wait complete. 2024-09-13T17:26:13.958 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2024-09-13T17:26:13.958 INFO:tasks.cephfs_test_runner: 2024-09-13T17:26:13.958 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T17:26:13.959 INFO:tasks.cephfs_test_runner:Ran 1 test in 62.763s 2024-09-13T17:26:13.959 INFO:tasks.cephfs_test_runner: 2024-09-13T17:26:13.959 INFO:tasks.cephfs_test_runner:OK 2024-09-13T17:26:13.959 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T17:26:14.070 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T17:26:14.080 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T17:26:14.080 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:26:14.080 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:14.099 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346792k,nr_inodes=4086698,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:26:14.099 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T17:26:14.099 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:14.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346792k,nr_inodes=4086698,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:26:14.154 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:26:14.154 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:14.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346852k,nr_inodes=4086713,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:26:14.171 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-13T17:26:14.171 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:26:14.229 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346852k,nr_inodes=4086713,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:26:14.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:14.229 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:26:14.246 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:26:14.246 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:26:14.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:14.247 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:26:14.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:14.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:26:14.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:14.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-13T17:26:14.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:14.945 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-13T17:26:14.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:14.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-13T17:26:15.384 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2024-09-13T17:26:15.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:26:15.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:15.387 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-13T17:26:15.404 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:26:15.404 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:26:15.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:15.405 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:26:15.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:15.486 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:26:15.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:15.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-13T17:26:16.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:16.125 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-13T17:26:16.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:26:16.142 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-13T17:26:16.493 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-13T17:26:16.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:26:16.496 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T17:26:16.506 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:26:16.506 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:16.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.685+0000 7fd2ab200700 1 Processor -- start 2024-09-13T17:26:16.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.685+0000 7fd2ab200700 1 -- start start 2024-09-13T17:26:16.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2ab200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd2a4144300 0x7fd2a406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:16.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2ab200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd2a40cddd0 0x7fd2a40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:16.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2ab200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a4070140 con 0x7fd2a415aff0 2024-09-13T17:26:16.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2ab200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a4070420 con 0x7fd2a4144300 2024-09-13T17:26:16.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2ab200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a4070700 con 0x7fd2a40cddd0 2024-09-13T17:26:16.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd2a4144300 0x7fd2a406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:16.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd2a415aff0 0x7fd2a40cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55114/0 (socket says 172.21.15.139:55114) 2024-09-13T17:26:16.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9400700 1 -- 172.21.15.139:0/3293578222 learned_addr learned my addr 172.21.15.139:0/3293578222 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:16.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2aa800700 1 --2- 172.21.15.139:0/3293578222 >> v2:172.21.15.176:3300/0 conn(0x7fd2a40cddd0 0x7fd2a40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:16.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a8a00700 1 -- 172.21.15.139:0/3293578222 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326309052 0 0) 0x7fd2a4070140 con 0x7fd2a415aff0 2024-09-13T17:26:16.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a8a00700 1 -- 172.21.15.139:0/3293578222 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd28c0035d0 con 0x7fd2a415aff0 2024-09-13T17:26:16.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9e00700 1 -- 172.21.15.139:0/3293578222 >> v2:172.21.15.176:3300/0 conn(0x7fd2a40cddd0 msgr2=0x7fd2a40711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:16.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9e00700 1 --2- 172.21.15.139:0/3293578222 >> v2:172.21.15.176:3300/0 conn(0x7fd2a40cddd0 0x7fd2a40711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9e00700 1 -- 172.21.15.139:0/3293578222 >> v1:172.21.15.139:6789/0 conn(0x7fd2a415aff0 legacy=0x7fd2a40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:16.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.689+0000 7fd2a9e00700 1 -- 172.21.15.139:0/3293578222 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40709e0 con 0x7fd2a4144300 2024-09-13T17:26:16.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2a9e00700 1 --2- 172.21.15.139:0/3293578222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a4144300 0x7fd2a406d620 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd298009850 tx=0x7fd298009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1120e22d473efce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:16.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2a8a00700 1 -- 172.21.15.139:0/3293578222 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298011830 con 0x7fd2a4144300 2024-09-13T17:26:16.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2a8a00700 1 -- 172.21.15.139:0/3293578222 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298011990 con 0x7fd2a4144300 2024-09-13T17:26:16.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2a8a00700 1 -- 172.21.15.139:0/3293578222 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298011d20 con 0x7fd2a4144300 2024-09-13T17:26:16.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 -- 172.21.15.139:0/3293578222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a4144300 msgr2=0x7fd2a406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:16.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 --2- 172.21.15.139:0/3293578222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a4144300 0x7fd2a406d620 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd298009850 tx=0x7fd298009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:16.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 -- 172.21.15.139:0/3293578222 shutdown_connections 2024-09-13T17:26:16.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 --2- 172.21.15.139:0/3293578222 >> v2:172.21.15.176:3300/0 conn(0x7fd2a40cddd0 0x7fd2a40711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 --2- 172.21.15.139:0/3293578222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a4144300 0x7fd2a406d620 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 -- 172.21.15.139:0/3293578222 >> 172.21.15.139:0/3293578222 conn(0x7fd2a40ce9d0 msgr2=0x7fd2a40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:16.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 -- 172.21.15.139:0/3293578222 shutdown_connections 2024-09-13T17:26:16.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.693+0000 7fd2ab200700 1 -- 172.21.15.139:0/3293578222 wait complete. 2024-09-13T17:26:16.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 Processor -- start 2024-09-13T17:26:16.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 -- start start 2024-09-13T17:26:16.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a40cddd0 0x7fd2a413ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:16.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4144300 0x7fd2a41e0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:16.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 0x7fd2a41e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:16.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a413b280 con 0x7fd2a415aff0 2024-09-13T17:26:16.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a413b760 con 0x7fd2a40cddd0 2024-09-13T17:26:16.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2ab200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a41f2710 con 0x7fd2a4144300 2024-09-13T17:26:16.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2aa800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 0x7fd2a41e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:16.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2aa800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 0x7fd2a41e0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32840/0 (socket says 172.21.15.139:32840) 2024-09-13T17:26:16.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2aa800700 1 -- 172.21.15.139:0/1114908053 learned_addr learned my addr 172.21.15.139:0/1114908053 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:16.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2a9e00700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a40cddd0 0x7fd2a413ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:16.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.697+0000 7fd2a9400700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4144300 0x7fd2a41e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:16.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2aa800700 1 -- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4144300 msgr2=0x7fd2a41e0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2aa800700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4144300 0x7fd2a41e0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2aa800700 1 -- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a40cddd0 msgr2=0x7fd2a413ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2aa800700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a40cddd0 0x7fd2a413ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2aa800700 1 -- 172.21.15.139:0/1114908053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980094b0 con 0x7fd2a415aff0 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2a9400700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4144300 0x7fd2a41e0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2a9e00700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a40cddd0 0x7fd2a413ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2aa800700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 0x7fd2a41e0d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000efc0 tx=0x7fd2a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000cd40 con 0x7fd2a415aff0 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000f040 con 0x7fd2a415aff0 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00146c0 con 0x7fd2a415aff0 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a41f29d0 con 0x7fd2a415aff0 2024-09-13T17:26:16.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a41f2f90 con 0x7fd2a415aff0 2024-09-13T17:26:16.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.701+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a40cd6c0 con 0x7fd2a415aff0 2024-09-13T17:26:16.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.705+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd2a0014820 con 0x7fd2a415aff0 2024-09-13T17:26:16.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.705+0000 7fd29e000700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd288066850 0x7fd288068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:16.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.705+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fd2a0085660 con 0x7fd2a415aff0 2024-09-13T17:26:16.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.705+0000 7fd2a9e00700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd288066850 0x7fd288068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:16.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.705+0000 7fd2a9e00700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd288066850 0x7fd288068d10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd298000c00 tx=0x7fd298008030 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:16.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.713+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2a0052640 con 0x7fd2a415aff0 2024-09-13T17:26:16.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.901+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2a406fe10 con 0x7fd288066850 2024-09-13T17:26:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.905+0000 7fd29e000700 1 -- 172.21.15.139:0/1114908053 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47990 (secure 0 0 0) 0x7fd298011ce0 con 0x7fd288066850 2024-09-13T17:26:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:16.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd288066850 msgr2=0x7fd288068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:16.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd288066850 0x7fd288068d10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd298000c00 tx=0x7fd298008030 comp rx=0 tx=0).stop 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 msgr2=0x7fd2a41e0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 0x7fd2a41e0d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000efc0 tx=0x7fd2a000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 shutdown_connections 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd288066850 0x7fd288068d10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2a415aff0 0x7fd2a41e0d80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4144300 0x7fd2a41e0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 --2- 172.21.15.139:0/1114908053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a40cddd0 0x7fd2a413ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 >> 172.21.15.139:0/1114908053 conn(0x7fd2a40ce9d0 msgr2=0x7fd2a40ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 shutdown_connections 2024-09-13T17:26:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:16.913+0000 7fd2ab200700 1 -- 172.21.15.139:0/1114908053 wait complete. 2024-09-13T17:26:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:26:16.939 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-13T17:26:16.878549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":225500,"kb_used_data":5224,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749220,"statfs":{"total":773094113280,"available":772863201280,"internally_reserved":0,"allocated":5349376,"data_stored":3008180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-733761,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-421,"num_read_kb":-255,"num_write":-380,"num_write_kb":-2907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002428"},"pg_stats":[{"pgid":"1.0","version":"43'139","reported_seq":262,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T17:26:11.676081+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:26:11.676081+0000","last_peered":"2024-09-13T17:26:11.676081+0000","last_clean":"2024-09-13T17:26:11.676081+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:26:11.676081+0000","last_undegraded":"2024-09-13T17:26:11.676081+0000","last_fullsized":"2024-09-13T17:26:11.676081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":817166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.1220000000000001,"15min":1.1599999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.429,"5min":1.522,"15min":1.522},"last":1.53},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5029999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.21,"15min":1.23},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.631,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.431}]},{"osd":2,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5469999999999999,"5min":1.673,"15min":1.673},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3660000000000001,"5min":1.623,"15min":1.623},"last":1.151}]},{"osd":3,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5680000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.486},{"interface":"front","average":{"1min":1.173,"5min":1.298,"15min":1.319},"min":{"1min":0.83899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3380000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.218,"15min":1.224},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6970000000000001,"5min":1.966,"15min":1.966},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3,"15min":1.3200000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.631,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.659}]},{"osd":5,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.5740000000000001,"5min":1.881,"15min":1.881},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.4490000000000001,"15min":1.4830000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4730000000000001,"5min":2.069,"15min":2.069},"last":1.823}]},{"osd":6,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.454,"15min":1.486},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5980000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4330000000000001,"15min":1.4570000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.7110000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.5900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2470000000000001,"15min":1.26},"min":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7689999999999999,"5min":2.399,"15min":2.399},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.1830000000000001,"15min":1.1870000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.49,"5min":2.476,"15min":2.476},"last":1.113}]},{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2649999999999999},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8420000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.02},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.298,"15min":1.3},"min":{"1min":0.84299999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5509999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.125,"15min":1.137},"min":{"1min":0.76100000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4359999999999999,"5min":1.593,"15min":1.593},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2250000000000001,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.462,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.323}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.25,"15min":1.27},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.5920000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.3919999999999999,"15min":1.4419999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3360000000000001,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2569999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.81399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8879999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.405},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4370000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.7310000000000001,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.304,"15min":1.321},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5389999999999999,"5min":1.883,"15min":1.883},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.401,"15min":1.411},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8660000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.395,"15min":1.401},"min":{"1min":0.92600000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.659,"5min":2.863,"15min":2.863},"last":1.379},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.784,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2090000000000001,"15min":1.2390000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.464,"5min":1.855,"15min":1.855},"last":1.006},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4330000000000001,"5min":2.218,"15min":2.218},"last":1.28}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.169,"15min":1.1870000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4019999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.365},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.2250000000000001,"15min":1.252},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4079999999999999,"5min":1.718,"15min":1.718},"last":1.1519999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.51,"5min":1.929,"15min":1.929},"last":1.462},{"interface":"front","average":{"1min":1.093,"5min":1.2010000000000001,"15min":1.2190000000000001},"min":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5569999999999999,"5min":1.593,"15min":1.593},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.292},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4219999999999999,"5min":1.78,"15min":1.78},"last":1.244},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.298,"15min":1.3340000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.542,"5min":1.786,"15min":1.786},"last":1.5940000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2589999999999999,"15min":1.274},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4930000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5169999999999999,"5min":2.625,"15min":2.625},"last":1.5469999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.3400000000000001,"15min":1.369},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4930000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.865},{"interface":"front","average":{"1min":1.244,"5min":1.3819999999999999,"15min":1.405},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.573,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.629}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.528,"15min":1.5640000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5129999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.331},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.599,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.6699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.083,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.145,"15min":1.159},"min":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2709999999999999,"15min":1.302},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1679999999999999,"15min":1.175},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5369999999999999,"5min":1.825,"15min":1.825},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2789999999999999,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5900000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.2549999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.294}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.266,"15min":1.282},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7130000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.381},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.446,"15min":1.464},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.5940000000000001,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.629}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.363,"15min":1.377},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.748,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.462},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3600000000000001,"15min":1.3799999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.778,"5min":2.274,"15min":2.274},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4419999999999999,"15min":1.454},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9690000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4350000000000001,"15min":1.4590000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9199999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.262},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5009999999999999,"15min":1.5149999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7849999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.74}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":1.02,"15min":1.056},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2729999999999999,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.468,"15min":1.468},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90500000000000003,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1930000000000001,"5min":1.554,"15min":1.554},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.222,"15min":1.252},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5680000000000001,"5min":1.708,"15min":1.708},"last":1.589},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.246,"15min":1.2669999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5580000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.4379999999999999,"15min":1.476},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.7390000000000001,"5min":2.972,"15min":2.972},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.383,"15min":1.4159999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6659999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4850000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.278,"15min":1.304},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.4950000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.454,"15min":1.4930000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.425}]},{"osd":7,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.3819999999999999,"15min":1.4199999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4910000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.395},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.341,"15min":1.3660000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6850000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31640,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93000000000000005,"15min":0.93799999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.27,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":1.0089999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.85599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4610000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.755},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.331,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.512,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5740000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3839999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.337,"15min":1.359},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4550000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5069999999999999,"5min":3.077,"15min":3.077},"last":1.1339999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.389,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.673,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.073},{"interface":"front","average":{"1min":1.367,"5min":1.4630000000000001,"15min":1.4790000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6000000000000001,"5min":2.387,"15min":2.387},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.504,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.256},{"interface":"front","average":{"1min":1.252,"5min":1.371,"15min":1.391},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5840000000000001,"5min":2.298,"15min":2.298},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.425,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.502,"15min":1.524},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.7170000000000001,"5min":2.254,"15min":2.254},"last":1.2170000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1859999999999999,"5min":1.345,"15min":1.345},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3160000000000001,"5min":1.474,"15min":1.474},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.153,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.026,"15min":1.0409999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.377,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.879}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.70399999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.405,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.321},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0620000000000001,"15min":1.0800000000000001},"min":{"1min":0.58799999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.395,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.083}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.373,"15min":1.403},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.5069999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.3160000000000001,"15min":1.343},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5980000000000001,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.2450000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.522,"5min":2.04,"15min":2.04},"last":0.999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.506,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.395}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.5580000000000001,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.288},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.375,"15min":1.4059999999999999},"min":{"1min":0.93500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5780000000000001,"5min":3.452,"15min":3.452},"last":1.4239999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.458,"15min":1.486},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.7310000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.90000000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8620000000000001,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.1579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1110016,"data_stored":817166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0740000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1220000000000001,"5min":1.53,"15min":1.53},"last":1.097}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.349},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1639999999999999,"15min":1.181},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.177}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2450000000000001,"15min":1.2529999999999999},"min":{"1min":0.92300000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.702,"15min":1.702},"last":1.466},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2,"15min":1.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4590000000000001,"5min":1.946,"15min":1.946},"last":1.25}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.341,"15min":1.351},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7230000000000001,"5min":2.093,"15min":2.093},"last":1.52},{"interface":"front","average":{"1min":1.302,"5min":1.403,"15min":1.4199999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.776,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.395},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.75,"5min":1.857,"15min":1.857},"last":1.319},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.679,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.83199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.514,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.397},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8380000000000001,"5min":2.177,"15min":2.177},"last":1.4410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:16.940 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:17.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.097+0000 7f3d52a00700 1 Processor -- start 2024-09-13T17:26:17.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.097+0000 7f3d52a00700 1 -- start start 2024-09-13T17:26:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d52a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3d4c146b40 0x7f3d4c161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d52a00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c161ab0 con 0x7f3d4c06b140 2024-09-13T17:26:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d52a00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c06cd90 con 0x7f3d4c0c8ed0 2024-09-13T17:26:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d52a00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c06c260 con 0x7f3d4c146b40 2024-09-13T17:26:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4be00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3d4c146b40 0x7f3d4c161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d43400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3d4c06b140 0x7f3d4c06c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55124/0 (socket says 172.21.15.139:55124) 2024-09-13T17:26:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d43400700 1 -- 172.21.15.139:0/1389499867 learned_addr learned my addr 172.21.15.139:0/1389499867 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4be00700 1 -- 172.21.15.139:0/1389499867 >> v1:172.21.15.176:6789/0 conn(0x7f3d4c0c8ed0 legacy=0x7f3d4c0c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4be00700 1 -- 172.21.15.139:0/1389499867 >> v1:172.21.15.139:6789/0 conn(0x7f3d4c06b140 legacy=0x7f3d4c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4be00700 1 -- 172.21.15.139:0/1389499867 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c06b5e0 con 0x7f3d4c146b40 2024-09-13T17:26:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4b400700 1 -- 172.21.15.139:0/1389499867 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306781296 0 0) 0x7f3d4c161ab0 con 0x7f3d4c06b140 2024-09-13T17:26:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4be00700 1 --2- 172.21.15.139:0/1389499867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c161570 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009850 tx=0x7f3d3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9359fe77a567a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4b400700 1 -- 172.21.15.139:0/1389499867 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c011830 con 0x7f3d4c146b40 2024-09-13T17:26:17.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4b400700 1 -- 172.21.15.139:0/1389499867 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c011990 con 0x7f3d4c146b40 2024-09-13T17:26:17.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.101+0000 7f3d4b400700 1 -- 172.21.15.139:0/1389499867 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c011d20 con 0x7f3d4c146b40 2024-09-13T17:26:17.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 -- 172.21.15.139:0/1389499867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 msgr2=0x7f3d4c161570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 --2- 172.21.15.139:0/1389499867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c161570 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009850 tx=0x7f3d3c009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:17.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 -- 172.21.15.139:0/1389499867 shutdown_connections 2024-09-13T17:26:17.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 --2- 172.21.15.139:0/1389499867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c161570 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 -- 172.21.15.139:0/1389499867 >> 172.21.15.139:0/1389499867 conn(0x7f3d4c0cfa80 msgr2=0x7f3d4c0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:17.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 -- 172.21.15.139:0/1389499867 shutdown_connections 2024-09-13T17:26:17.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 -- 172.21.15.139:0/1389499867 wait complete. 2024-09-13T17:26:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 Processor -- start 2024-09-13T17:26:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.105+0000 7f3d52a00700 1 -- start start 2024-09-13T17:26:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d4c06b140 0x7f3d4c15fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d4c0c8ed0 0x7f3d4c0b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b6d60 con 0x7f3d4c146b40 2024-09-13T17:26:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b7040 con 0x7f3d4c06b140 2024-09-13T17:26:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b7320 con 0x7f3d4c0c8ed0 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c0b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32846/0 (socket says 172.21.15.139:32846) 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 -- 172.21.15.139:0/2492925480 learned_addr learned my addr 172.21.15.139:0/2492925480 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d43400700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d4c0c8ed0 0x7f3d4c0b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d4be00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d4c06b140 0x7f3d4c15fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 -- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d4c0c8ed0 msgr2=0x7f3d4c0b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d4c0c8ed0 0x7f3d4c0b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 -- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d4c06b140 msgr2=0x7f3d4c15fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d4c06b140 0x7f3d4c15fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 -- 172.21.15.139:0/2492925480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0094b0 con 0x7f3d4c146b40 2024-09-13T17:26:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d4be00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d4c06b140 0x7f3d4c15fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:17.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d50a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c0b8830 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400cc50 tx=0x7f3d4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44003c20 con 0x7f3d4c146b40 2024-09-13T17:26:17.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44003d80 con 0x7f3d4c146b40 2024-09-13T17:26:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ab60 con 0x7f3d4c146b40 2024-09-13T17:26:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c0b7600 con 0x7f3d4c146b40 2024-09-13T17:26:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.109+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c0b5fe0 con 0x7f3d4c146b40 2024-09-13T17:26:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.113+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c13f730 con 0x7f3d4c146b40 2024-09-13T17:26:17.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.113+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f3d4400acc0 con 0x7f3d4c146b40 2024-09-13T17:26:17.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.117+0000 7f3d48c00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3d28066850 0x7f3d28068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.117+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f3d44084510 con 0x7f3d4c146b40 2024-09-13T17:26:17.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.117+0000 7f3d4be00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3d28066850 0x7f3d28068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.117+0000 7f3d4be00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3d28066850 0x7f3d28068d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0090b0 tx=0x7f3d3c008030 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.121+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d44051600 con 0x7f3d4c146b40 2024-09-13T17:26:17.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.301+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d4c06be80 con 0x7f3d28066850 2024-09-13T17:26:17.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.305+0000 7f3d48c00700 1 -- 172.21.15.139:0/2492925480 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47990 (secure 0 0 0) 0x7f3d3c0117f0 con 0x7f3d28066850 2024-09-13T17:26:17.312 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:17.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3d28066850 msgr2=0x7f3d28068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3d28066850 0x7f3d28068d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0090b0 tx=0x7f3d3c008030 comp rx=0 tx=0).stop 2024-09-13T17:26:17.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 msgr2=0x7f3d4c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c0b8830 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400cc50 tx=0x7f3d4400cf60 comp rx=0 tx=0).stop 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 shutdown_connections 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3d28066850 0x7f3d28068d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d4c146b40 0x7f3d4c0b8830 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d4c0c8ed0 0x7f3d4c0b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 --2- 172.21.15.139:0/2492925480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d4c06b140 0x7f3d4c15fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 >> 172.21.15.139:0/2492925480 conn(0x7f3d4c0cfa80 msgr2=0x7f3d4c0ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 shutdown_connections 2024-09-13T17:26:17.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.309+0000 7f3d52a00700 1 -- 172.21.15.139:0/2492925480 wait complete. 2024-09-13T17:26:17.317 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:26:17.335 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-13T17:26:16.878549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":225500,"kb_used_data":5224,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749220,"statfs":{"total":773094113280,"available":772863201280,"internally_reserved":0,"allocated":5349376,"data_stored":3008180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-733761,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-421,"num_read_kb":-255,"num_write":-380,"num_write_kb":-2907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002428"},"pg_stats":[{"pgid":"1.0","version":"43'139","reported_seq":262,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T17:26:11.676081+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:26:11.676081+0000","last_peered":"2024-09-13T17:26:11.676081+0000","last_clean":"2024-09-13T17:26:11.676081+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:26:11.676081+0000","last_undegraded":"2024-09-13T17:26:11.676081+0000","last_fullsized":"2024-09-13T17:26:11.676081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":817166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.1220000000000001,"15min":1.1599999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.429,"5min":1.522,"15min":1.522},"last":1.53},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5029999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.21,"15min":1.23},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.631,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.431}]},{"osd":2,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5469999999999999,"5min":1.673,"15min":1.673},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3660000000000001,"5min":1.623,"15min":1.623},"last":1.151}]},{"osd":3,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5680000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.486},{"interface":"front","average":{"1min":1.173,"5min":1.298,"15min":1.319},"min":{"1min":0.83899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3380000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.218,"15min":1.224},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6970000000000001,"5min":1.966,"15min":1.966},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3,"15min":1.3200000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.631,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.659}]},{"osd":5,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.5740000000000001,"5min":1.881,"15min":1.881},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.4490000000000001,"15min":1.4830000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4730000000000001,"5min":2.069,"15min":2.069},"last":1.823}]},{"osd":6,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.454,"15min":1.486},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5980000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4330000000000001,"15min":1.4570000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.7110000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.5900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2470000000000001,"15min":1.26},"min":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7689999999999999,"5min":2.399,"15min":2.399},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.1830000000000001,"15min":1.1870000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.49,"5min":2.476,"15min":2.476},"last":1.113}]},{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2649999999999999},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8420000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.02},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.298,"15min":1.3},"min":{"1min":0.84299999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5509999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.125,"15min":1.137},"min":{"1min":0.76100000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4359999999999999,"5min":1.593,"15min":1.593},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2250000000000001,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.462,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.323}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.25,"15min":1.27},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.5920000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.3919999999999999,"15min":1.4419999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3360000000000001,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2569999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.81399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8879999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.405},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4370000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.7310000000000001,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.304,"15min":1.321},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5389999999999999,"5min":1.883,"15min":1.883},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.401,"15min":1.411},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8660000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.395,"15min":1.401},"min":{"1min":0.92600000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.659,"5min":2.863,"15min":2.863},"last":1.379},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.784,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2090000000000001,"15min":1.2390000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.464,"5min":1.855,"15min":1.855},"last":1.006},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4330000000000001,"5min":2.218,"15min":2.218},"last":1.28}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.169,"15min":1.1870000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4019999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.365},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.2250000000000001,"15min":1.252},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4079999999999999,"5min":1.718,"15min":1.718},"last":1.1519999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.51,"5min":1.929,"15min":1.929},"last":1.462},{"interface":"front","average":{"1min":1.093,"5min":1.2010000000000001,"15min":1.2190000000000001},"min":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5569999999999999,"5min":1.593,"15min":1.593},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.292},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4219999999999999,"5min":1.78,"15min":1.78},"last":1.244},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.298,"15min":1.3340000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.542,"5min":1.786,"15min":1.786},"last":1.5940000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2589999999999999,"15min":1.274},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4930000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5169999999999999,"5min":2.625,"15min":2.625},"last":1.5469999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.3400000000000001,"15min":1.369},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4930000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.865},{"interface":"front","average":{"1min":1.244,"5min":1.3819999999999999,"15min":1.405},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.573,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.629}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.528,"15min":1.5640000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5129999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.331},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.599,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.6699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.083,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.145,"15min":1.159},"min":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2709999999999999,"15min":1.302},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1679999999999999,"15min":1.175},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5369999999999999,"5min":1.825,"15min":1.825},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2789999999999999,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5900000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.2549999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.294}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.266,"15min":1.282},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7130000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.381},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.446,"15min":1.464},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.5940000000000001,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.629}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.363,"15min":1.377},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.748,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.462},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3600000000000001,"15min":1.3799999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.778,"5min":2.274,"15min":2.274},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4419999999999999,"15min":1.454},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9690000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4350000000000001,"15min":1.4590000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9199999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.262},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5009999999999999,"15min":1.5149999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7849999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.74}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":1.02,"15min":1.056},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2729999999999999,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.468,"15min":1.468},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90500000000000003,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1930000000000001,"5min":1.554,"15min":1.554},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.222,"15min":1.252},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5680000000000001,"5min":1.708,"15min":1.708},"last":1.589},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.246,"15min":1.2669999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5580000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.4379999999999999,"15min":1.476},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.7390000000000001,"5min":2.972,"15min":2.972},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.383,"15min":1.4159999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6659999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4850000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.278,"15min":1.304},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.4950000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.454,"15min":1.4930000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.425}]},{"osd":7,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.3819999999999999,"15min":1.4199999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4910000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.395},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.341,"15min":1.3660000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6850000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31640,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93000000000000005,"15min":0.93799999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.27,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":1.0089999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.85599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4610000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.755},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.331,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.512,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5740000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3839999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.337,"15min":1.359},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4550000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5069999999999999,"5min":3.077,"15min":3.077},"last":1.1339999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.389,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.673,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.073},{"interface":"front","average":{"1min":1.367,"5min":1.4630000000000001,"15min":1.4790000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6000000000000001,"5min":2.387,"15min":2.387},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.504,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.256},{"interface":"front","average":{"1min":1.252,"5min":1.371,"15min":1.391},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5840000000000001,"5min":2.298,"15min":2.298},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.425,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.502,"15min":1.524},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.7170000000000001,"5min":2.254,"15min":2.254},"last":1.2170000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1859999999999999,"5min":1.345,"15min":1.345},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3160000000000001,"5min":1.474,"15min":1.474},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.153,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.026,"15min":1.0409999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.377,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.879}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.70399999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.405,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.321},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0620000000000001,"15min":1.0800000000000001},"min":{"1min":0.58799999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.395,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.083}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.373,"15min":1.403},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.5069999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.3160000000000001,"15min":1.343},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5980000000000001,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.2450000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.522,"5min":2.04,"15min":2.04},"last":0.999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.506,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.395}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.5580000000000001,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.288},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.375,"15min":1.4059999999999999},"min":{"1min":0.93500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5780000000000001,"5min":3.452,"15min":3.452},"last":1.4239999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.458,"15min":1.486},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.7310000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.90000000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8620000000000001,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.1579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1110016,"data_stored":817166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0740000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1220000000000001,"5min":1.53,"15min":1.53},"last":1.097}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.349},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1639999999999999,"15min":1.181},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.177}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2450000000000001,"15min":1.2529999999999999},"min":{"1min":0.92300000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.702,"15min":1.702},"last":1.466},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2,"15min":1.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4590000000000001,"5min":1.946,"15min":1.946},"last":1.25}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.341,"15min":1.351},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7230000000000001,"5min":2.093,"15min":2.093},"last":1.52},{"interface":"front","average":{"1min":1.302,"5min":1.403,"15min":1.4199999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.776,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.395},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.75,"5min":1.857,"15min":1.857},"last":1.319},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.679,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.83199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.514,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.397},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8380000000000001,"5min":2.177,"15min":2.177},"last":1.4410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:17.336 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:26:17.336 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:17.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.497+0000 7f7017e00700 1 Processor -- start 2024-09-13T17:26:17.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.497+0000 7f7017e00700 1 -- start start 2024-09-13T17:26:17.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7018144300 0x7f701806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f70180711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7018070140 con 0x7f701815aff0 2024-09-13T17:26:17.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7018070420 con 0x7f7018144300 2024-09-13T17:26:17.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7018070700 con 0x7f70180cddd0 2024-09-13T17:26:17.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7018144300 0x7f701806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7018144300 0x7f701806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32862/0 (socket says 172.21.15.139:32862) 2024-09-13T17:26:17.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 -- 172.21.15.139:0/3040613076 learned_addr learned my addr 172.21.15.139:0/3040613076 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:17.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017400700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f70180711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016000700 1 -- 172.21.15.139:0/3040613076 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350689017 0 0) 0x7f7018070140 con 0x7f701815aff0 2024-09-13T17:26:17.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016000700 1 -- 172.21.15.139:0/3040613076 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ffc0035d0 con 0x7f701815aff0 2024-09-13T17:26:17.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 -- 172.21.15.139:0/3040613076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 msgr2=0x7f70180711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f70180711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 -- 172.21.15.139:0/3040613076 >> v1:172.21.15.176:6789/0 conn(0x7f701815aff0 legacy=0x7f70180cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 -- 172.21.15.139:0/3040613076 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70180709e0 con 0x7f7018144300 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7017400700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f70180711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.501+0000 7f7016a00700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7018144300 0x7f701806d620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e80 tx=0x7f700800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feddfdff454c657 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7016000700 1 -- 172.21.15.139:0/3040613076 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800e070 con 0x7f7018144300 2024-09-13T17:26:17.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7016000700 1 -- 172.21.15.139:0/3040613076 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700800b8d0 con 0x7f7018144300 2024-09-13T17:26:17.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7016000700 1 -- 172.21.15.139:0/3040613076 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800bc40 con 0x7f7018144300 2024-09-13T17:26:17.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 -- 172.21.15.139:0/3040613076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7018144300 msgr2=0x7f701806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7018144300 0x7f701806d620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e80 tx=0x7f700800b330 comp rx=0 tx=0).stop 2024-09-13T17:26:17.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 -- 172.21.15.139:0/3040613076 shutdown_connections 2024-09-13T17:26:17.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f70180711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 --2- 172.21.15.139:0/3040613076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7018144300 0x7f701806d620 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 -- 172.21.15.139:0/3040613076 >> 172.21.15.139:0/3040613076 conn(0x7f70180ce9d0 msgr2=0x7f70180cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:17.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 -- 172.21.15.139:0/3040613076 shutdown_connections 2024-09-13T17:26:17.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.505+0000 7f7017e00700 1 -- 172.21.15.139:0/3040613076 wait complete. 2024-09-13T17:26:17.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 Processor -- start 2024-09-13T17:26:17.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 -- start start 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f701813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7018144300 0x7f701813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 0x7f7018154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7018159eb0 con 0x7f701815aff0 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70180cca20 con 0x7f7018144300 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70180ccd00 con 0x7f70180cddd0 2024-09-13T17:26:17.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 0x7f7018154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 0x7f7018154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32878/0 (socket says 172.21.15.139:32878) 2024-09-13T17:26:17.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 -- 172.21.15.139:0/3325012449 learned_addr learned my addr 172.21.15.139:0/3325012449 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:17.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7016a00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f701813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f700e000700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7018144300 0x7f701813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 -- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 msgr2=0x7f701813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f701813ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 -- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7018144300 msgr2=0x7f701813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7018144300 0x7f701813fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 -- 172.21.15.139:0/3325012449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100094b0 con 0x7f701815aff0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f700e000700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7018144300 0x7f701813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017400700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 0x7f7018154f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f701000eb30 tx=0x7f701000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010009790 con 0x7f701815aff0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7008009b30 con 0x7f701815aff0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701000c850 con 0x7f701815aff0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.509+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000cbc0 con 0x7f701815aff0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.513+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70180cd2c0 con 0x7f701815aff0 2024-09-13T17:26:17.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.513+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701806b1a0 con 0x7f701815aff0 2024-09-13T17:26:17.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.513+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f701000cd20 con 0x7f701815aff0 2024-09-13T17:26:17.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.517+0000 7f700f400700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f6ff4066850 0x7f6ff4068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.517+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f7010084630 con 0x7f701815aff0 2024-09-13T17:26:17.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.517+0000 7f7016a00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f6ff4066850 0x7f6ff4068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.517+0000 7f7016a00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f6ff4066850 0x7f6ff4068d10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f700800b370 tx=0x7f7008009000 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.521+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70100516a0 con 0x7f701815aff0 2024-09-13T17:26:17.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.705+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f701806fe10 con 0x7f6ff4066850 2024-09-13T17:26:17.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.709+0000 7f700f400700 1 -- 172.21.15.139:0/3325012449 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47990 (secure 0 0 0) 0x7f7008003ac0 con 0x7f6ff4066850 2024-09-13T17:26:17.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f6ff4066850 msgr2=0x7f6ff4068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f6ff4066850 0x7f6ff4068d10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f700800b370 tx=0x7f7008009000 comp rx=0 tx=0).stop 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 msgr2=0x7f7018154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 0x7f7018154f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f701000eb30 tx=0x7f701000eef0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 shutdown_connections 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f6ff4066850 0x7f6ff4068d10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f701815aff0 0x7f7018154f70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7018144300 0x7f701813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 --2- 172.21.15.139:0/3325012449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70180cddd0 0x7f701813ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.713+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 >> 172.21.15.139:0/3325012449 conn(0x7f70180ce9d0 msgr2=0x7f70180cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:17.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.717+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 shutdown_connections 2024-09-13T17:26:17.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.717+0000 7f7017e00700 1 -- 172.21.15.139:0/3325012449 wait complete. 2024-09-13T17:26:17.723 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:26:17.742 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-13T17:26:16.878549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":225500,"kb_used_data":5224,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749220,"statfs":{"total":773094113280,"available":772863201280,"internally_reserved":0,"allocated":5349376,"data_stored":3008180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-733761,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-421,"num_read_kb":-255,"num_write":-380,"num_write_kb":-2907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002428"},"pg_stats":[{"pgid":"1.0","version":"43'139","reported_seq":262,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T17:26:11.676081+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:26:11.676081+0000","last_peered":"2024-09-13T17:26:11.676081+0000","last_clean":"2024-09-13T17:26:11.676081+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:26:11.676081+0000","last_undegraded":"2024-09-13T17:26:11.676081+0000","last_fullsized":"2024-09-13T17:26:11.676081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":817166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.1220000000000001,"15min":1.1599999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.429,"5min":1.522,"15min":1.522},"last":1.53},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5029999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.21,"15min":1.23},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.631,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.431}]},{"osd":2,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5469999999999999,"5min":1.673,"15min":1.673},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3660000000000001,"5min":1.623,"15min":1.623},"last":1.151}]},{"osd":3,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5680000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.486},{"interface":"front","average":{"1min":1.173,"5min":1.298,"15min":1.319},"min":{"1min":0.83899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3380000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.218,"15min":1.224},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6970000000000001,"5min":1.966,"15min":1.966},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3,"15min":1.3200000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.631,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.659}]},{"osd":5,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.5740000000000001,"5min":1.881,"15min":1.881},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.4490000000000001,"15min":1.4830000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4730000000000001,"5min":2.069,"15min":2.069},"last":1.823}]},{"osd":6,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.454,"15min":1.486},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5980000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4330000000000001,"15min":1.4570000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.7110000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.5900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2470000000000001,"15min":1.26},"min":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7689999999999999,"5min":2.399,"15min":2.399},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.1830000000000001,"15min":1.1870000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.49,"5min":2.476,"15min":2.476},"last":1.113}]},{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2649999999999999},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8420000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.02},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.298,"15min":1.3},"min":{"1min":0.84299999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5509999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.125,"15min":1.137},"min":{"1min":0.76100000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4359999999999999,"5min":1.593,"15min":1.593},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2250000000000001,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.462,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.323}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.25,"15min":1.27},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.5920000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.3919999999999999,"15min":1.4419999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3360000000000001,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2569999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.81399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8879999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.405},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4370000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.7310000000000001,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.304,"15min":1.321},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5389999999999999,"5min":1.883,"15min":1.883},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.401,"15min":1.411},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8660000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.395,"15min":1.401},"min":{"1min":0.92600000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.659,"5min":2.863,"15min":2.863},"last":1.379},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.784,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2090000000000001,"15min":1.2390000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.464,"5min":1.855,"15min":1.855},"last":1.006},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4330000000000001,"5min":2.218,"15min":2.218},"last":1.28}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.169,"15min":1.1870000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4019999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.365},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.2250000000000001,"15min":1.252},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4079999999999999,"5min":1.718,"15min":1.718},"last":1.1519999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.51,"5min":1.929,"15min":1.929},"last":1.462},{"interface":"front","average":{"1min":1.093,"5min":1.2010000000000001,"15min":1.2190000000000001},"min":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5569999999999999,"5min":1.593,"15min":1.593},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.292},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4219999999999999,"5min":1.78,"15min":1.78},"last":1.244},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.298,"15min":1.3340000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.542,"5min":1.786,"15min":1.786},"last":1.5940000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2589999999999999,"15min":1.274},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4930000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5169999999999999,"5min":2.625,"15min":2.625},"last":1.5469999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.3400000000000001,"15min":1.369},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4930000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.865},{"interface":"front","average":{"1min":1.244,"5min":1.3819999999999999,"15min":1.405},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.573,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.629}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.528,"15min":1.5640000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5129999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.331},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.599,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.6699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.083,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.145,"15min":1.159},"min":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2709999999999999,"15min":1.302},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1679999999999999,"15min":1.175},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5369999999999999,"5min":1.825,"15min":1.825},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2789999999999999,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5900000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.2549999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.294}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.266,"15min":1.282},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7130000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.381},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.446,"15min":1.464},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.5940000000000001,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.629}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.363,"15min":1.377},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.748,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.462},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3600000000000001,"15min":1.3799999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.778,"5min":2.274,"15min":2.274},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4419999999999999,"15min":1.454},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9690000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4350000000000001,"15min":1.4590000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9199999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.262},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5009999999999999,"15min":1.5149999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7849999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.74}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":1.02,"15min":1.056},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2729999999999999,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.468,"15min":1.468},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90500000000000003,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1930000000000001,"5min":1.554,"15min":1.554},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.222,"15min":1.252},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5680000000000001,"5min":1.708,"15min":1.708},"last":1.589},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.246,"15min":1.2669999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5580000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.4379999999999999,"15min":1.476},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.7390000000000001,"5min":2.972,"15min":2.972},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.383,"15min":1.4159999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6659999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4850000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.278,"15min":1.304},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.4950000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.454,"15min":1.4930000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.425}]},{"osd":7,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.3819999999999999,"15min":1.4199999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4910000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.395},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.341,"15min":1.3660000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6850000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31640,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93000000000000005,"15min":0.93799999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.27,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":1.0089999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.85599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4610000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.755},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.331,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.512,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5740000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3839999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.337,"15min":1.359},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4550000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5069999999999999,"5min":3.077,"15min":3.077},"last":1.1339999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.389,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.673,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.073},{"interface":"front","average":{"1min":1.367,"5min":1.4630000000000001,"15min":1.4790000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6000000000000001,"5min":2.387,"15min":2.387},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.504,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.256},{"interface":"front","average":{"1min":1.252,"5min":1.371,"15min":1.391},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5840000000000001,"5min":2.298,"15min":2.298},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.425,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.502,"15min":1.524},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.7170000000000001,"5min":2.254,"15min":2.254},"last":1.2170000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":226798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1859999999999999,"5min":1.345,"15min":1.345},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3160000000000001,"5min":1.474,"15min":1.474},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.153,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.026,"15min":1.0409999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.377,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.879}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.70399999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.405,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.321},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0620000000000001,"15min":1.0800000000000001},"min":{"1min":0.58799999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.395,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.083}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.373,"15min":1.403},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.5069999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.3160000000000001,"15min":1.343},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5980000000000001,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.2450000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.522,"5min":2.04,"15min":2.04},"last":0.999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.506,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.395}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.5580000000000001,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.288},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.375,"15min":1.4059999999999999},"min":{"1min":0.93500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5780000000000001,"5min":3.452,"15min":3.452},"last":1.4239999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.458,"15min":1.486},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.7310000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.472},{"interface":"front","average":{"1min":1.202,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.90000000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8620000000000001,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.1579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1110016,"data_stored":817166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0740000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1220000000000001,"5min":1.53,"15min":1.53},"last":1.097}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.349},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1639999999999999,"15min":1.181},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.177}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2450000000000001,"15min":1.2529999999999999},"min":{"1min":0.92300000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.702,"15min":1.702},"last":1.466},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2,"15min":1.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4590000000000001,"5min":1.946,"15min":1.946},"last":1.25}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.341,"15min":1.351},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7230000000000001,"5min":2.093,"15min":2.093},"last":1.52},{"interface":"front","average":{"1min":1.302,"5min":1.403,"15min":1.4199999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.776,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.395},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.75,"5min":1.857,"15min":1.857},"last":1.319},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.679,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.83199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.514,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.397},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8380000000000001,"5min":2.177,"15min":2.177},"last":1.4410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:17.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:26:17.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.905+0000 7f4329200700 1 Processor -- start 2024-09-13T17:26:17.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.905+0000 7f4329200700 1 -- start start 2024-09-13T17:26:17.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4324159bd0 0x7f43240b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f43240721e0 0x7f4324070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43240705c0 con 0x7f43240712c0 2024-09-13T17:26:17.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4324159fb0 con 0x7f43240721e0 2024-09-13T17:26:17.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43240cb920 con 0x7f4324159bd0 2024-09-13T17:26:17.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f43240721e0 0x7f4324070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f43240721e0 0x7f4324070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32886/0 (socket says 172.21.15.139:32886) 2024-09-13T17:26:17.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 -- 172.21.15.139:0/1019382005 learned_addr learned my addr 172.21.15.139:0/1019382005 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:17.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321e00700 1 --2- 172.21.15.139:0/1019382005 >> v2:172.21.15.176:3300/0 conn(0x7f4324159bd0 0x7f43240b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 -- 172.21.15.139:0/1019382005 >> v2:172.21.15.176:3300/0 conn(0x7f4324159bd0 msgr2=0x7f43240b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:17.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 --2- 172.21.15.139:0/1019382005 >> v2:172.21.15.176:3300/0 conn(0x7f4324159bd0 0x7f43240b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 -- 172.21.15.139:0/1019382005 >> v1:172.21.15.176:6789/0 conn(0x7f43240712c0 legacy=0x7f432406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:17.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 -- 172.21.15.139:0/1019382005 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240cbc00 con 0x7f43240721e0 2024-09-13T17:26:17.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4321400700 1 --2- 172.21.15.139:0/1019382005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240721e0 0x7f4324070d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4310009910 tx=0x7f4310009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a6e37480a2b0ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4320a00700 1 -- 172.21.15.139:0/1019382005 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000ba20 con 0x7f43240721e0 2024-09-13T17:26:17.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4320a00700 1 -- 172.21.15.139:0/1019382005 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000bb80 con 0x7f43240721e0 2024-09-13T17:26:17.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4320a00700 1 -- 172.21.15.139:0/1019382005 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310009e60 con 0x7f43240721e0 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 -- 172.21.15.139:0/1019382005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240721e0 msgr2=0x7f4324070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.909+0000 7f4329200700 1 --2- 172.21.15.139:0/1019382005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240721e0 0x7f4324070d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4310009910 tx=0x7f4310009c20 comp rx=0 tx=0).stop 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 -- 172.21.15.139:0/1019382005 shutdown_connections 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 --2- 172.21.15.139:0/1019382005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240721e0 0x7f4324070d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 --2- 172.21.15.139:0/1019382005 >> v2:172.21.15.176:3300/0 conn(0x7f4324159bd0 0x7f43240b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 -- 172.21.15.139:0/1019382005 >> 172.21.15.139:0/1019382005 conn(0x7f432406b1e0 msgr2=0x7f432406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 -- 172.21.15.139:0/1019382005 shutdown_connections 2024-09-13T17:26:17.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 -- 172.21.15.139:0/1019382005 wait complete. 2024-09-13T17:26:17.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.913+0000 7f4329200700 1 Processor -- start 2024-09-13T17:26:17.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 -- start start 2024-09-13T17:26:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 0x7f432414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240721e0 0x7f43240ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4324159bd0 0x7f43240adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4324154a90 con 0x7f43240712c0 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43241e41a0 con 0x7f43240721e0 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4329200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43241e4480 con 0x7f4324159bd0 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 0x7f432414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 0x7f432414ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32894/0 (socket says 172.21.15.139:32894) 2024-09-13T17:26:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 -- 172.21.15.139:0/82907307 learned_addr learned my addr 172.21.15.139:0/82907307 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:17.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321400700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240721e0 0x7f43240ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4322800700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4324159bd0 0x7f43240adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 -- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4324159bd0 msgr2=0x7f43240adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4324159bd0 0x7f43240adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 -- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240721e0 msgr2=0x7f43240ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240721e0 0x7f43240ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321e00700 1 -- 172.21.15.139:0/82907307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310009570 con 0x7f43240712c0 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.917+0000 7f4321400700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240721e0 0x7f43240ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f4321e00700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 0x7f432414ffe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f431400d800 tx=0x7f431400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140125f0 con 0x7f43240712c0 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314012750 con 0x7f43240712c0 2024-09-13T17:26:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314012ac0 con 0x7f43240712c0 2024-09-13T17:26:17.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43241e4760 con 0x7f43240712c0 2024-09-13T17:26:17.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4324150520 con 0x7f43240712c0 2024-09-13T17:26:17.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.921+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4324154c00 con 0x7f43240712c0 2024-09-13T17:26:17.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.925+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f4314012c20 con 0x7f43240712c0 2024-09-13T17:26:17.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.925+0000 7f431a000700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4304066880 0x7f4304068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:17.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.925+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f4314084760 con 0x7f43240712c0 2024-09-13T17:26:17.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.925+0000 7f4321400700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4304066880 0x7f4304068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:17.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.925+0000 7f4321400700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4304066880 0x7f4304068d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4324070000 tx=0x7f4310008030 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:17.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:17.933+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4314051850 con 0x7f43240712c0 2024-09-13T17:26:18.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.117+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f432406dad0 con 0x7f43240712c0 2024-09-13T17:26:18.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.117+0000 7f431a000700 1 -- 172.21.15.139:0/82907307 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14194 (secure 0 0 0) 0x7f4314012ed0 con 0x7f43240712c0 2024-09-13T17:26:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":45,"fsid":"a6cff629-1d3c-470e-abc7-14e2fbc4e0ad","created":"2024-09-13T17:23:51.630926+0000","modified":"2024-09-13T17:26:11.904719+0000","last_up_change":"2024-09-13T17:24:04.404794+0000","last_in_change":"2024-09-13T17:23:54.706485+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:24:06.171629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f01ef42c-c08f-41a3-bb77-5874545218d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6801","nonce":2232177245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6803","nonce":2232177245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6807","nonce":2232177245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2232177245},{"type":"v1","addr":"172.21.15.139:6805","nonce":2232177245}]},"public_addr":"172.21.15.139:6801/2232177245","cluster_addr":"172.21.15.139:6803/2232177245","heartbeat_back_addr":"172.21.15.139:6807/2232177245","heartbeat_front_addr":"172.21.15.139:6805/2232177245","state":["exists","up"]},{"osd":1,"uuid":"387b9206-8c1a-457c-8126-451235020543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6809","nonce":2059112051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6811","nonce":2059112051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6815","nonce":2059112051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2059112051},{"type":"v1","addr":"172.21.15.139:6813","nonce":2059112051}]},"public_addr":"172.21.15.139:6809/2059112051","cluster_addr":"172.21.15.139:6811/2059112051","heartbeat_back_addr":"172.21.15.139:6815/2059112051","heartbeat_front_addr":"172.21.15.139:6813/2059112051","state":["exists","up"]},{"osd":2,"uuid":"9a2bc6d2-ca8c-420e-8dd9-85f4d3cb1849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6818","nonce":3239824397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6821","nonce":3239824397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6829","nonce":3239824397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6823","nonce":3239824397},{"type":"v1","addr":"172.21.15.139:6825","nonce":3239824397}]},"public_addr":"172.21.15.139:6818/3239824397","cluster_addr":"172.21.15.139:6821/3239824397","heartbeat_back_addr":"172.21.15.139:6829/3239824397","heartbeat_front_addr":"172.21.15.139:6825/3239824397","state":["exists","up"]},{"osd":3,"uuid":"6629ba9f-cb66-43f5-b3d9-ff6e34f23474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6819","nonce":1185400623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6824","nonce":1185400623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6831","nonce":1185400623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1185400623},{"type":"v1","addr":"172.21.15.139:6828","nonce":1185400623}]},"public_addr":"172.21.15.139:6819/1185400623","cluster_addr":"172.21.15.139:6824/1185400623","heartbeat_back_addr":"172.21.15.139:6831/1185400623","heartbeat_front_addr":"172.21.15.139:6828/1185400623","state":["exists","up"]},{"osd":4,"uuid":"9577bfa3-eb2a-4e9b-bea0-6f16cdf58fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6801","nonce":3123658344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6803","nonce":3123658344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6810","nonce":3123658344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3123658344},{"type":"v1","addr":"172.21.15.176:6807","nonce":3123658344}]},"public_addr":"172.21.15.176:6801/3123658344","cluster_addr":"172.21.15.176:6803/3123658344","heartbeat_back_addr":"172.21.15.176:6810/3123658344","heartbeat_front_addr":"172.21.15.176:6807/3123658344","state":["exists","up"]},{"osd":5,"uuid":"815c1d2e-00dc-47ad-9f5a-cc9d43550524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6806","nonce":545225210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6811","nonce":545225210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6815","nonce":545225210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":545225210},{"type":"v1","addr":"172.21.15.176:6813","nonce":545225210}]},"public_addr":"172.21.15.176:6806/545225210","cluster_addr":"172.21.15.176:6811/545225210","heartbeat_back_addr":"172.21.15.176:6815/545225210","heartbeat_front_addr":"172.21.15.176:6813/545225210","state":["exists","up"]},{"osd":6,"uuid":"a727471b-7468-4014-9f8f-fd407938eb78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6825","nonce":1964477782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6827","nonce":1964477782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6831","nonce":1964477782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1964477782},{"type":"v1","addr":"172.21.15.176:6829","nonce":1964477782}]},"public_addr":"172.21.15.176:6825/1964477782","cluster_addr":"172.21.15.176:6827/1964477782","heartbeat_back_addr":"172.21.15.176:6831/1964477782","heartbeat_front_addr":"172.21.15.176:6829/1964477782","state":["exists","up"]},{"osd":7,"uuid":"90b4c6d8-d297-40bb-87bf-e922fd88758e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6817","nonce":3835533036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6819","nonce":3835533036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6823","nonce":3835533036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3835533036},{"type":"v1","addr":"172.21.15.176:6821","nonce":3835533036}]},"public_addr":"172.21.15.176:6817/3835533036","cluster_addr":"172.21.15.176:6819/3835533036","heartbeat_back_addr":"172.21.15.176:6823/3835533036","heartbeat_front_addr":"172.21.15.176:6821/3835533036","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.431548+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.464539+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.519262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.336498+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.401639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.451762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.508006+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:24:00.774446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6833/501919372":"2024-09-14T17:26:08.847021+0000","172.21.15.176:6832/501919372":"2024-09-14T17:26:08.847021+0000","172.21.15.139:0/3293474047":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/2733931244":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/2707869445":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6833/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:6832/3612810800":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/312835695":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/1151495076":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/745875968":"2024-09-14T17:26:06.847686+0000","172.21.15.139:6833/2501085087":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/3153492983":"2024-09-14T17:25:57.627576+0000","172.21.15.139:0/2233835098":"2024-09-14T17:26:06.847686+0000","172.21.15.139:6832/2501085087":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/1678669475":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/3615204454":"2024-09-14T17:26:06.847686+0000","172.21.15.139:0/1509520047":"2024-09-14T17:26:06.847686+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:26:18.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4304066880 msgr2=0x7f4304068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4304066880 0x7f4304068d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4324070000 tx=0x7f4310008030 comp rx=0 tx=0).stop 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 msgr2=0x7f432414ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 0x7f432414ffe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f431400d800 tx=0x7f431400dbc0 comp rx=0 tx=0).stop 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 shutdown_connections 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4304066880 0x7f4304068d40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4324159bd0 0x7f43240adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240721e0 0x7f43240ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 --2- 172.21.15.139:0/82907307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43240712c0 0x7f432414ffe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:18.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 >> 172.21.15.139:0/82907307 conn(0x7f432406b1e0 msgr2=0x7f43240af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:18.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 shutdown_connections 2024-09-13T17:26:18.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:18.121+0000 7f4329200700 1 -- 172.21.15.139:0/82907307 wait complete. 2024-09-13T17:26:19.148 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T17:26:19.149 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:19.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 Processor -- start 2024-09-13T17:26:19.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 -- start start 2024-09-13T17:26:19.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f740015b310 0x7f740006c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74000b30a0 0x7f74000cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7400144ae0 con 0x7f74001441c0 2024-09-13T17:26:19.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74000cd340 con 0x7f74000b30a0 2024-09-13T17:26:19.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f7405400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74001445a0 con 0x7f740015b310 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.329+0000 7f73ff200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74000b30a0 0x7f74000cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74000b30a0 0x7f74000cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32900/0 (socket says 172.21.15.139:32900) 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 -- 172.21.15.139:0/1232285176 learned_addr learned my addr 172.21.15.139:0/1232285176 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73fde00700 1 --2- 172.21.15.139:0/1232285176 >> v2:172.21.15.176:3300/0 conn(0x7f740015b310 0x7f740006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 -- 172.21.15.139:0/1232285176 >> v2:172.21.15.176:3300/0 conn(0x7f740015b310 msgr2=0x7f740006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 --2- 172.21.15.139:0/1232285176 >> v2:172.21.15.176:3300/0 conn(0x7f740015b310 0x7f740006c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 -- 172.21.15.139:0/1232285176 >> v1:172.21.15.176:6789/0 conn(0x7f74001441c0 legacy=0x7f74000b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 -- 172.21.15.139:0/1232285176 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740006de40 con 0x7f74000b30a0 2024-09-13T17:26:19.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73ff200700 1 --2- 172.21.15.139:0/1232285176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000cd7d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f74000cec60 tx=0x7f73f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16cfa06ed744c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73fd400700 1 -- 172.21.15.139:0/1232285176 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f800e070 con 0x7f74000b30a0 2024-09-13T17:26:19.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73fd400700 1 -- 172.21.15.139:0/1232285176 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8003a40 con 0x7f74000b30a0 2024-09-13T17:26:19.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f73fd400700 1 -- 172.21.15.139:0/1232285176 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8003df0 con 0x7f74000b30a0 2024-09-13T17:26:19.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 -- 172.21.15.139:0/1232285176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 msgr2=0x7f74000cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 --2- 172.21.15.139:0/1232285176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000cd7d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f74000cec60 tx=0x7f73f800b330 comp rx=0 tx=0).stop 2024-09-13T17:26:19.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 -- 172.21.15.139:0/1232285176 shutdown_connections 2024-09-13T17:26:19.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 --2- 172.21.15.139:0/1232285176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000cd7d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 --2- 172.21.15.139:0/1232285176 >> v2:172.21.15.176:3300/0 conn(0x7f740015b310 0x7f740006c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 -- 172.21.15.139:0/1232285176 >> 172.21.15.139:0/1232285176 conn(0x7f74000cc7e0 msgr2=0x7f740006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 -- 172.21.15.139:0/1232285176 shutdown_connections 2024-09-13T17:26:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.333+0000 7f7405400700 1 -- 172.21.15.139:0/1232285176 wait complete. 2024-09-13T17:26:19.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.337+0000 7f7405400700 1 Processor -- start 2024-09-13T17:26:19.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.337+0000 7f7405400700 1 -- start start 2024-09-13T17:26:19.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f7405400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f7405400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74001441c0 0x7f74001418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f7405400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7400141e10 0x7f7400136fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f7405400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74001422c0 con 0x7f74000b30a0 2024-09-13T17:26:19.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f7405400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7400135720 con 0x7f7400141e10 2024-09-13T17:26:19.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f7405400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7400137cf0 con 0x7f74001441c0 2024-09-13T17:26:19.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32916/0 (socket says 172.21.15.139:32916) 2024-09-13T17:26:19.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 -- 172.21.15.139:0/4062158605 learned_addr learned my addr 172.21.15.139:0/4062158605 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:19.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fde00700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74001441c0 0x7f74001418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73ff200700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7400141e10 0x7f7400136fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 -- 172.21.15.139:0/4062158605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74001441c0 msgr2=0x7f74001418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74001441c0 0x7f74001418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 -- 172.21.15.139:0/4062158605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7400141e10 msgr2=0x7f7400136fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7400141e10 0x7f7400136fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 -- 172.21.15.139:0/4062158605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009b30 con 0x7f74000b30a0 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73fe800700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000c47c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c4e0 tx=0x7f73f000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0011790 con 0x7f74000b30a0 2024-09-13T17:26:19.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.341+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0011910 con 0x7f74000b30a0 2024-09-13T17:26:19.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.345+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7400134df0 con 0x7f74000b30a0 2024-09-13T17:26:19.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.345+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0011cc0 con 0x7f74000b30a0 2024-09-13T17:26:19.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.345+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74001353b0 con 0x7f74000b30a0 2024-09-13T17:26:19.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.345+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74000ccfd0 con 0x7f74000b30a0 2024-09-13T17:26:19.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.345+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f73f001c460 con 0x7f74000b30a0 2024-09-13T17:26:19.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73f6a00700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f73e0066850 0x7f73e0068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f73f00840d0 con 0x7f74000b30a0 2024-09-13T17:26:19.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73fde00700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f73e0066850 0x7f73e0068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73f6a00700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f73e006d0f0 0x7f73e006f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 --> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73e006fc00 con 0x7f73e006d0f0 2024-09-13T17:26:19.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f0086790 con 0x7f74000b30a0 2024-09-13T17:26:19.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73ff200700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f73e006d0f0 0x7f73e006f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73fde00700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f73e0066850 0x7f73e0068d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74000b4df0 tx=0x7f73ec008040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73ff200700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f73e006d0f0 0x7f73e006f530 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.349+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== osd.0 v2:172.21.15.139:6800/2232177245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f73e006fc00 con 0x7f73e006d0f0 2024-09-13T17:26:19.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 --> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74000cccf0 con 0x7f73e006d0f0 2024-09-13T17:26:19.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f73f6a00700 1 -- 172.21.15.139:0/4062158605 <== osd.0 v2:172.21.15.139:6800/2232177245 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f73f8003d90 con 0x7f73e006d0f0 2024-09-13T17:26:19.376 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:19.376 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f73e006d0f0 msgr2=0x7f73e006f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6800/2232177245,v1:172.21.15.139:6801/2232177245] conn(0x7f73e006d0f0 0x7f73e006f530 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f73e0066850 msgr2=0x7f73e0068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f73e0066850 0x7f73e0068d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74000b4df0 tx=0x7f73ec008040 comp rx=0 tx=0).stop 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 msgr2=0x7f74000c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 --2- 172.21.15.139:0/4062158605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74000b30a0 0x7f74000c47c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c4e0 tx=0x7f73f000c7f0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f73ff200700 1 -- 172.21.15.139:0/4062158605 reap_dead start 2024-09-13T17:26:19.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 shutdown_connections 2024-09-13T17:26:19.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.369+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 >> 172.21.15.139:0/4062158605 conn(0x7f74000cc7e0 msgr2=0x7f74000aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:19.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.373+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 shutdown_connections 2024-09-13T17:26:19.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.373+0000 7f7405400700 1 -- 172.21.15.139:0/4062158605 wait complete. 2024-09-13T17:26:19.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T17:26:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1803e00700 1 Processor -- start 2024-09-13T17:26:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1803e00700 1 -- start start 2024-09-13T17:26:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1803e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f180414a6d0 0x7f18040cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1803e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180414aab0 con 0x7f18040cd450 2024-09-13T17:26:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1803e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040cc3b0 con 0x7f18040b3280 2024-09-13T17:26:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1803e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040cd8c0 con 0x7f180414a6d0 2024-09-13T17:26:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f1802a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f180414a6d0 0x7f18040cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802a00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f180414a6d0 0x7f18040cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32930/0 (socket says 172.21.15.139:32930) 2024-09-13T17:26:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.569+0000 7f17fa000700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f18040cd450 0x7f18040b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55130/0 (socket says 172.21.15.139:55130) 2024-09-13T17:26:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802a00700 1 -- 172.21.15.139:0/768332208 learned_addr learned my addr 172.21.15.139:0/768332208 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802a00700 1 -- 172.21.15.139:0/768332208 >> v1:172.21.15.176:6789/0 conn(0x7f18040b3280 legacy=0x7f1804161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802a00700 1 -- 172.21.15.139:0/768332208 >> v1:172.21.15.139:6789/0 conn(0x7f18040cd450 legacy=0x7f18040b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802a00700 1 -- 172.21.15.139:0/768332208 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040cc690 con 0x7f180414a6d0 2024-09-13T17:26:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802000700 1 -- 172.21.15.139:0/768332208 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103018057 0 0) 0x7f180414aab0 con 0x7f18040cd450 2024-09-13T17:26:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802a00700 1 --2- 172.21.15.139:0/768332208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18040cbd40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009910 tx=0x7f17f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2f2866a7507c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802000700 1 -- 172.21.15.139:0/768332208 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400ba60 con 0x7f180414a6d0 2024-09-13T17:26:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802000700 1 -- 172.21.15.139:0/768332208 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400bbc0 con 0x7f180414a6d0 2024-09-13T17:26:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1802000700 1 -- 172.21.15.139:0/768332208 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4009e60 con 0x7f180414a6d0 2024-09-13T17:26:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 -- 172.21.15.139:0/768332208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 msgr2=0x7f18040cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 --2- 172.21.15.139:0/768332208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18040cbd40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009910 tx=0x7f17f4009c20 comp rx=0 tx=0).stop 2024-09-13T17:26:19.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 -- 172.21.15.139:0/768332208 shutdown_connections 2024-09-13T17:26:19.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 --2- 172.21.15.139:0/768332208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18040cbd40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 -- 172.21.15.139:0/768332208 >> 172.21.15.139:0/768332208 conn(0x7f18040ce9d0 msgr2=0x7f18040cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:19.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 -- 172.21.15.139:0/768332208 shutdown_connections 2024-09-13T17:26:19.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.573+0000 7f1803e00700 1 -- 172.21.15.139:0/768332208 wait complete. 2024-09-13T17:26:19.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 Processor -- start 2024-09-13T17:26:19.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 -- start start 2024-09-13T17:26:19.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18040b3280 0x7f1804143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18040cd450 0x7f180415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18041635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180415f610 con 0x7f180414a6d0 2024-09-13T17:26:19.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180406a810 con 0x7f18040cd450 2024-09-13T17:26:19.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18041edef0 con 0x7f18040b3280 2024-09-13T17:26:19.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18041635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1802a00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18040b3280 0x7f1804143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18041635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32936/0 (socket says 172.21.15.139:32936) 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f1803400700 1 -- 172.21.15.139:0/2769017030 learned_addr learned my addr 172.21.15.139:0/2769017030 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.577+0000 7f17fa000700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18040cd450 0x7f180415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803400700 1 -- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18040b3280 msgr2=0x7f1804143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803400700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18040b3280 0x7f1804143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803400700 1 -- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18040cd450 msgr2=0x7f180415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803400700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18040cd450 0x7f180415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803400700 1 -- 172.21.15.139:0/2769017030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009570 con 0x7f180414a6d0 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803400700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18041635d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00cbc0 tx=0x7f17fc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc003c20 con 0x7f180414a6d0 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18041ee1d0 con 0x7f180414a6d0 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc003d80 con 0x7f180414a6d0 2024-09-13T17:26:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00aae0 con 0x7f180414a6d0 2024-09-13T17:26:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18041ee790 con 0x7f180414a6d0 2024-09-13T17:26:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.581+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180406a980 con 0x7f180414a6d0 2024-09-13T17:26:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.585+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f17fc00ac40 con 0x7f180414a6d0 2024-09-13T17:26:19.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.585+0000 7f17fb400700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f17e0066850 0x7f17e0068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.585+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f17fc0843d0 con 0x7f180414a6d0 2024-09-13T17:26:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.585+0000 7f1802a00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f17e0066850 0x7f17e0068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.585+0000 7f1802a00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f17e0066850 0x7f17e0068d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17f4014040 tx=0x7f17f401c040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.589+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f180406a980 con 0x7f180414a6d0 2024-09-13T17:26:19.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f18040ccf30 con 0x7f17e0066850 2024-09-13T17:26:19.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f17fb400700 1 -- 172.21.15.139:0/2769017030 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f17f400b860 con 0x7f17e0066850 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f17e0066850 msgr2=0x7f17e0068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f17e0066850 0x7f17e0068d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17f4014040 tx=0x7f17f401c040 comp rx=0 tx=0).stop 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 msgr2=0x7f18041635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18041635d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00cbc0 tx=0x7f17fc00ced0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 shutdown_connections 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f17e0066850 0x7f17e0068d10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414a6d0 0x7f18041635d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18040cd450 0x7f180415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 --2- 172.21.15.139:0/2769017030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18040b3280 0x7f1804143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.773+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 >> 172.21.15.139:0/2769017030 conn(0x7f18040ce9d0 msgr2=0x7f18040cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:19.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.777+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 shutdown_connections 2024-09-13T17:26:19.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.777+0000 7f1803e00700 1 -- 172.21.15.139:0/2769017030 wait complete. 2024-09-13T17:26:19.783 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T17:26:19.802 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T17:26:19.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:19.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.969+0000 7f544da00700 1 Processor -- start 2024-09-13T17:26:19.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.969+0000 7f544da00700 1 -- start start 2024-09-13T17:26:19.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f544da00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f544806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f544da00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480cd220 con 0x7f544806bbb0 2024-09-13T17:26:19.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f544da00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480cc8f0 con 0x7f544806c120 2024-09-13T17:26:19.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f544da00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544806ecc0 con 0x7f544815ad30 2024-09-13T17:26:19.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5447400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f544806bbb0 0x7f54480cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55132/0 (socket says 172.21.15.139:55132) 2024-09-13T17:26:19.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5447400700 1 -- 172.21.15.139:0/3888285741 learned_addr learned my addr 172.21.15.139:0/3888285741 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:19.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5446000700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f544806c120 0x7f544806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:36922/0 (socket says 172.21.15.139:36922) 2024-09-13T17:26:19.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5446a00700 1 --2- 172.21.15.139:0/3888285741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f544806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260720310 0 0) 0x7f54480cc8f0 con 0x7f544806c120 2024-09-13T17:26:19.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f542c0035d0 con 0x7f544806c120 2024-09-13T17:26:19.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495410092 0 0) 0x7f54480cd220 con 0x7f544806bbb0 2024-09-13T17:26:19.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54480cc8f0 con 0x7f544806bbb0 2024-09-13T17:26:19.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5446a00700 1 -- 172.21.15.139:0/3888285741 >> v1:172.21.15.176:6789/0 conn(0x7f544806c120 legacy=0x7f544806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5446a00700 1 -- 172.21.15.139:0/3888285741 >> v1:172.21.15.139:6789/0 conn(0x7f544806bbb0 legacy=0x7f54480cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5446a00700 1 -- 172.21.15.139:0/3888285741 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480ccbd0 con 0x7f544815ad30 2024-09-13T17:26:19.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5446a00700 1 --2- 172.21.15.139:0/3888285741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f544806d7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5438009880 tx=0x7f5438009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7020c6ed2f4682c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438011830 con 0x7f544815ad30 2024-09-13T17:26:19.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438011990 con 0x7f544815ad30 2024-09-13T17:26:19.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.973+0000 7f5445600700 1 -- 172.21.15.139:0/3888285741 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438011d20 con 0x7f544815ad30 2024-09-13T17:26:19.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 -- 172.21.15.139:0/3888285741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 msgr2=0x7f544806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 --2- 172.21.15.139:0/3888285741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f544806d7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5438009880 tx=0x7f5438009b90 comp rx=0 tx=0).stop 2024-09-13T17:26:19.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 -- 172.21.15.139:0/3888285741 shutdown_connections 2024-09-13T17:26:19.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 --2- 172.21.15.139:0/3888285741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f544806d7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 -- 172.21.15.139:0/3888285741 >> 172.21.15.139:0/3888285741 conn(0x7f54480d0350 msgr2=0x7f54480b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:19.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 -- 172.21.15.139:0/3888285741 shutdown_connections 2024-09-13T17:26:19.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 -- 172.21.15.139:0/3888285741 wait complete. 2024-09-13T17:26:19.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 Processor -- start 2024-09-13T17:26:19.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 -- start start 2024-09-13T17:26:19.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.977+0000 7f544da00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f544806bbb0 0x7f544814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544806c120 0x7f544814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f54480b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544814f8b0 con 0x7f544806c120 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448154b50 con 0x7f544806bbb0 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5448154e30 con 0x7f544815ad30 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544806c120 0x7f544814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544806c120 0x7f544814faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32946/0 (socket says 172.21.15.139:32946) 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 -- 172.21.15.139:0/2201113540 learned_addr learned my addr 172.21.15.139:0/2201113540 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446a00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f544806bbb0 0x7f544814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5447400700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f54480b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 -- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 msgr2=0x7f54480b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f544815ad30 0x7f54480b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 -- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f544806bbb0 msgr2=0x7f544814f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f544806bbb0 0x7f544814f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 -- 172.21.15.139:0/2201113540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380094b0 con 0x7f544806c120 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446a00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f544806bbb0 0x7f544814f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f5446000700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544806c120 0x7f544814faa0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f54340011e0 tx=0x7f543400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434005cd0 con 0x7f544806c120 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5434005e30 con 0x7f544806c120 2024-09-13T17:26:19.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5448155110 con 0x7f544806c120 2024-09-13T17:26:19.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340072d0 con 0x7f544806c120 2024-09-13T17:26:19.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544814ffe0 con 0x7f544806c120 2024-09-13T17:26:19.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.981+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f544815b110 con 0x7f544806c120 2024-09-13T17:26:19.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f5434007430 con 0x7f544806c120 2024-09-13T17:26:19.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f543ea00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5428066850 0x7f5428068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f54340837f0 con 0x7f544806c120 2024-09-13T17:26:19.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f543ea00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7f542806d0f0 0x7f542806f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:19.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f5446a00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5428066850 0x7f5428068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 --> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f542806fc00 con 0x7f542806d0f0 2024-09-13T17:26:19.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.985+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5434085dd0 con 0x7f544806c120 2024-09-13T17:26:19.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.989+0000 7f5447400700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7f542806d0f0 0x7f542806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:19.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.989+0000 7f5446a00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5428066850 0x7f5428068d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54380090b0 tx=0x7f543801c040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.989+0000 7f5447400700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7f542806d0f0 0x7f542806f530 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:19.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:19.989+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== osd.1 v2:172.21.15.139:6808/2059112051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f542806fc00 con 0x7f542806d0f0 2024-09-13T17:26:20.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.009+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 --> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f54480c91e0 con 0x7f542806d0f0 2024-09-13T17:26:20.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.009+0000 7f543ea00700 1 -- 172.21.15.139:0/2201113540 <== osd.1 v2:172.21.15.139:6808/2059112051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f54480c91e0 con 0x7f542806d0f0 2024-09-13T17:26:20.016 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:20.016 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.009+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7f542806d0f0 msgr2=0x7f542806f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.009+0000 7f544da00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6808/2059112051,v1:172.21.15.139:6809/2059112051] conn(0x7f542806d0f0 0x7f542806f530 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.009+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5428066850 msgr2=0x7f5428068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.009+0000 7f544da00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f5428066850 0x7f5428068d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54380090b0 tx=0x7f543801c040 comp rx=0 tx=0).stop 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544806c120 msgr2=0x7f544814faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f544da00700 1 --2- 172.21.15.139:0/2201113540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544806c120 0x7f544814faa0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f54340011e0 tx=0x7f543400ca90 comp rx=0 tx=0).stop 2024-09-13T17:26:20.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f5447400700 1 -- 172.21.15.139:0/2201113540 reap_dead start 2024-09-13T17:26:20.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 shutdown_connections 2024-09-13T17:26:20.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 >> 172.21.15.139:0/2201113540 conn(0x7f54480d0350 msgr2=0x7f54480cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:20.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 shutdown_connections 2024-09-13T17:26:20.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.013+0000 7f544da00700 1 -- 172.21.15.139:0/2201113540 wait complete. 2024-09-13T17:26:20.039 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T17:26:20.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.209+0000 7f2faf200700 1 Processor -- start 2024-09-13T17:26:20.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.209+0000 7f2faf200700 1 -- start start 2024-09-13T17:26:20.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.209+0000 7f2faf200700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2fb00b64e0 0x7f2fb0162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faf200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2fb00d0270 0x7f2fb00cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faf200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb006c080 con 0x7f2fb00cfc90 2024-09-13T17:26:20.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faf200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00d09f0 con 0x7f2fb00d0270 2024-09-13T17:26:20.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faf200700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00cf2c0 con 0x7f2fb00b64e0 2024-09-13T17:26:20.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fad400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2fb00d0270 0x7f2fb00cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fae800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2fb00cfc90 0x7f2fb00d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55134/0 (socket says 172.21.15.139:55134) 2024-09-13T17:26:20.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fae800700 1 -- 172.21.15.139:0/3684971842 learned_addr learned my addr 172.21.15.139:0/3684971842 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:20.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fade00700 1 --2- 172.21.15.139:0/3684971842 >> v2:172.21.15.176:3300/0 conn(0x7f2fb00b64e0 0x7f2fb0162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fad400700 1 -- 172.21.15.139:0/3684971842 >> v2:172.21.15.176:3300/0 conn(0x7f2fb00b64e0 msgr2=0x7f2fb0162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fad400700 1 --2- 172.21.15.139:0/3684971842 >> v2:172.21.15.176:3300/0 conn(0x7f2fb00b64e0 0x7f2fb0162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fad400700 1 -- 172.21.15.139:0/3684971842 >> v1:172.21.15.139:6789/0 conn(0x7f2fb00cfc90 legacy=0x7f2fb00d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faca00700 1 -- 172.21.15.139:0/3684971842 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889757873 0 0) 0x7f2fb006c080 con 0x7f2fb00cfc90 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fad400700 1 -- 172.21.15.139:0/3684971842 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb01587e0 con 0x7f2fb00d0270 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fade00700 1 --2- 172.21.15.139:0/3684971842 >> v2:172.21.15.176:3300/0 conn(0x7f2fb00b64e0 0x7f2fb0162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2fad400700 1 --2- 172.21.15.139:0/3684971842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb00cf750 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00b1000 tx=0x7f2f9c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ede981094296bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faca00700 1 -- 172.21.15.139:0/3684971842 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c011830 con 0x7f2fb00d0270 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faca00700 1 -- 172.21.15.139:0/3684971842 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c011990 con 0x7f2fb00d0270 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faca00700 1 -- 172.21.15.139:0/3684971842 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c011d20 con 0x7f2fb00d0270 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faf200700 1 -- 172.21.15.139:0/3684971842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 msgr2=0x7f2fb00cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.213+0000 7f2faf200700 1 --2- 172.21.15.139:0/3684971842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb00cf750 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00b1000 tx=0x7f2f9c009b30 comp rx=0 tx=0).stop 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 -- 172.21.15.139:0/3684971842 shutdown_connections 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 --2- 172.21.15.139:0/3684971842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb00cf750 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 --2- 172.21.15.139:0/3684971842 >> v2:172.21.15.176:3300/0 conn(0x7f2fb00b64e0 0x7f2fb0162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 -- 172.21.15.139:0/3684971842 >> 172.21.15.139:0/3684971842 conn(0x7f2fb0071fa0 msgr2=0x7f2fb0072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 -- 172.21.15.139:0/3684971842 shutdown_connections 2024-09-13T17:26:20.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 -- 172.21.15.139:0/3684971842 wait complete. 2024-09-13T17:26:20.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 Processor -- start 2024-09-13T17:26:20.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.217+0000 7f2faf200700 1 -- start start 2024-09-13T17:26:20.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb00b64e0 0x7f2fb015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb0149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb00b35b0 0x7f2fb0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00b2880 con 0x7f2fb00d0270 2024-09-13T17:26:20.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00b3120 con 0x7f2fb00b64e0 2024-09-13T17:26:20.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb014a370 con 0x7f2fb00b35b0 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb0149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb0149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32960/0 (socket says 172.21.15.139:32960) 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 -- 172.21.15.139:0/1600371827 learned_addr learned my addr 172.21.15.139:0/1600371827 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fade00700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb00b64e0 0x7f2fb015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fae800700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb00b35b0 0x7f2fb0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 -- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb00b35b0 msgr2=0x7f2fb0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb00b35b0 0x7f2fb0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 -- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb00b64e0 msgr2=0x7f2fb015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb00b64e0 0x7f2fb015b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 -- 172.21.15.139:0/1600371827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00094b0 con 0x7f2fb00d0270 2024-09-13T17:26:20.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fad400700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb0149e30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c014040 tx=0x7f2f9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0036c0 con 0x7f2fb00d0270 2024-09-13T17:26:20.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c01e070 con 0x7f2fb00d0270 2024-09-13T17:26:20.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c003a40 con 0x7f2fb00d0270 2024-09-13T17:26:20.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c0094b0 con 0x7f2fb00d0270 2024-09-13T17:26:20.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.221+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb00b2ad0 con 0x7f2fb00d0270 2024-09-13T17:26:20.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.225+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb00677e0 con 0x7f2fb00d0270 2024-09-13T17:26:20.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.225+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f2f9c003ba0 con 0x7f2fb00d0270 2024-09-13T17:26:20.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.225+0000 7f2fa6000700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2f90066850 0x7f2f90068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.229+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f2f9c085320 con 0x7f2fb00d0270 2024-09-13T17:26:20.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.229+0000 7f2fade00700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2f90066850 0x7f2f90068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.229+0000 7f2fade00700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2f90066850 0x7f2f90068d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009d80 tx=0x7f2fa0009240 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.233+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f9c0524a0 con 0x7f2fb00d0270 2024-09-13T17:26:20.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.413+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fb006fb40 con 0x7f2f90066850 2024-09-13T17:26:20.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.413+0000 7f2fa6000700 1 -- 172.21.15.139:0/1600371827 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2fb006fb40 con 0x7f2f90066850 2024-09-13T17:26:20.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2f90066850 msgr2=0x7f2f90068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2f90066850 0x7f2f90068d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009d80 tx=0x7f2fa0009240 comp rx=0 tx=0).stop 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 msgr2=0x7f2fb0149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb0149e30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c014040 tx=0x7f2f9c004770 comp rx=0 tx=0).stop 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 shutdown_connections 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f2f90066850 0x7f2f90068d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb00b35b0 0x7f2fb0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fb00d0270 0x7f2fb0149e30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 --2- 172.21.15.139:0/1600371827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb00b64e0 0x7f2fb015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 >> 172.21.15.139:0/1600371827 conn(0x7f2fb0071fa0 msgr2=0x7f2fb015f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 shutdown_connections 2024-09-13T17:26:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.417+0000 7f2faf200700 1 -- 172.21.15.139:0/1600371827 wait complete. 2024-09-13T17:26:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T17:26:20.441 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T17:26:20.442 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:20.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.605+0000 7f4816400700 1 Processor -- start 2024-09-13T17:26:20.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.605+0000 7f4816400700 1 -- start start 2024-09-13T17:26:20.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f4816400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f481015b440 0x7f481006df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f4816400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015bf30 0x7f48100d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f4816400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100d0a20 con 0x7f48100d0070 2024-09-13T17:26:20.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f4816400700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48100b4880 con 0x7f481015b440 2024-09-13T17:26:20.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f4816400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48100cda30 con 0x7f481015bf30 2024-09-13T17:26:20.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480f400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f481015b440 0x7f481006df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480ea00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f48100d0070 0x7f481015b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.139:36938/0 (socket says 172.21.15.139:36938) 2024-09-13T17:26:20.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480ea00700 1 -- 172.21.15.139:0/563235547 learned_addr learned my addr 172.21.15.139:0/563235547 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:20.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480fe00700 1 --2- 172.21.15.139:0/563235547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015bf30 0x7f48100d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480f400700 1 -- 172.21.15.139:0/563235547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015bf30 msgr2=0x7f48100d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:20.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480f400700 1 --2- 172.21.15.139:0/563235547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015bf30 0x7f48100d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480f400700 1 -- 172.21.15.139:0/563235547 >> v1:172.21.15.176:6789/0 conn(0x7f48100d0070 legacy=0x7f481015b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480f400700 1 -- 172.21.15.139:0/563235547 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100b3ee0 con 0x7f481015b440 2024-09-13T17:26:20.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480e000700 1 -- 172.21.15.139:0/563235547 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008752596 0 0) 0x7f48100d0a20 con 0x7f48100d0070 2024-09-13T17:26:20.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480f400700 1 --2- 172.21.15.139:0/563235547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015b440 0x7f481006df40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4800009850 tx=0x7f4800009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3534c635649e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480e000700 1 -- 172.21.15.139:0/563235547 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800011830 con 0x7f481015b440 2024-09-13T17:26:20.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480e000700 1 -- 172.21.15.139:0/563235547 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4800011990 con 0x7f481015b440 2024-09-13T17:26:20.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.609+0000 7f480e000700 1 -- 172.21.15.139:0/563235547 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800011d40 con 0x7f481015b440 2024-09-13T17:26:20.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 -- 172.21.15.139:0/563235547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015b440 msgr2=0x7f481006df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 --2- 172.21.15.139:0/563235547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015b440 0x7f481006df40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4800009850 tx=0x7f4800009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:20.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 -- 172.21.15.139:0/563235547 shutdown_connections 2024-09-13T17:26:20.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 --2- 172.21.15.139:0/563235547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015bf30 0x7f48100d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 --2- 172.21.15.139:0/563235547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015b440 0x7f481006df40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 -- 172.21.15.139:0/563235547 >> 172.21.15.139:0/563235547 conn(0x7f48100b2a40 msgr2=0x7f48100b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:20.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 -- 172.21.15.139:0/563235547 shutdown_connections 2024-09-13T17:26:20.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.613+0000 7f4816400700 1 -- 172.21.15.139:0/563235547 wait complete. 2024-09-13T17:26:20.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 Processor -- start 2024-09-13T17:26:20.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 -- start start 2024-09-13T17:26:20.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48100d0070 0x7f48101f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015b440 0x7f48101f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015bf30 0x7f48100cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48101f0f30 con 0x7f481015bf30 2024-09-13T17:26:20.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4810148030 con 0x7f48100d0070 2024-09-13T17:26:20.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f4816400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4810148310 con 0x7f481015b440 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f480fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015bf30 0x7f48100cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f480fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015bf30 0x7f48100cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32978/0 (socket says 172.21.15.139:32978) 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f480f400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48100d0070 0x7f48101f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f480fe00700 1 -- 172.21.15.139:0/2972452957 learned_addr learned my addr 172.21.15.139:0/2972452957 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f480ea00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015b440 0x7f48101f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.617+0000 7f480fe00700 1 -- 172.21.15.139:0/2972452957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015b440 msgr2=0x7f48101f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f480fe00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015b440 0x7f48101f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f480fe00700 1 -- 172.21.15.139:0/2972452957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48100d0070 msgr2=0x7f48101f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f480fe00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48100d0070 0x7f48101f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f480fe00700 1 -- 172.21.15.139:0/2972452957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000094b0 con 0x7f481015bf30 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f480ea00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481015b440 0x7f48101f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f480fe00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015bf30 0x7f48100cdfb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f480800efc0 tx=0x7f480800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480800cb80 con 0x7f481015bf30 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480800f040 con 0x7f481015bf30 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48101485f0 con 0x7f481015bf30 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808014480 con 0x7f481015bf30 2024-09-13T17:26:20.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4810148bb0 con 0x7f481015bf30 2024-09-13T17:26:20.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48100b44a0 con 0x7f481015bf30 2024-09-13T17:26:20.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.621+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f48080145e0 con 0x7f481015bf30 2024-09-13T17:26:20.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f4807400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f47f0066850 0x7f47f0068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f4808085940 con 0x7f481015bf30 2024-09-13T17:26:20.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f4807400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7f47f006d0f0 0x7f47f006f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 --> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47f006fc00 con 0x7f47f006d0f0 2024-09-13T17:26:20.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4808085cb0 con 0x7f481015bf30 2024-09-13T17:26:20.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f480f400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f47f0066850 0x7f47f0068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f480ea00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7f47f006d0f0 0x7f47f006f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f480f400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f47f0066850 0x7f47f0068d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48000090b0 tx=0x7f4800008030 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.625+0000 7f480ea00700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7f47f006d0f0 0x7f47f006f530 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.629+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== osd.2 v2:172.21.15.139:6817/3239824397 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f47f006fc00 con 0x7f47f006d0f0 2024-09-13T17:26:20.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 --> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f48100b4ca0 con 0x7f47f006d0f0 2024-09-13T17:26:20.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4807400700 1 -- 172.21.15.139:0/2972452957 <== osd.2 v2:172.21.15.139:6817/3239824397 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f47fc004890 con 0x7f47f006d0f0 2024-09-13T17:26:20.652 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:20.652 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:20.652 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:20.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7f47f006d0f0 msgr2=0x7f47f006f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6817/3239824397,v1:172.21.15.139:6818/3239824397] conn(0x7f47f006d0f0 0x7f47f006f530 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f47f0066850 msgr2=0x7f47f0068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f47f0066850 0x7f47f0068d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48000090b0 tx=0x7f4800008030 comp rx=0 tx=0).stop 2024-09-13T17:26:20.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015bf30 msgr2=0x7f48100cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f4816400700 1 --2- 172.21.15.139:0/2972452957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481015bf30 0x7f48100cdfb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f480800efc0 tx=0x7f480800c0c0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.645+0000 7f480fe00700 1 -- 172.21.15.139:0/2972452957 reap_dead start 2024-09-13T17:26:20.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.649+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 shutdown_connections 2024-09-13T17:26:20.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.649+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 >> 172.21.15.139:0/2972452957 conn(0x7f48100b2a40 msgr2=0x7f48100b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:20.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.649+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 shutdown_connections 2024-09-13T17:26:20.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.649+0000 7f4816400700 1 -- 172.21.15.139:0/2972452957 wait complete. 2024-09-13T17:26:20.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T17:26:20.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 Processor -- start 2024-09-13T17:26:20.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 -- start start 2024-09-13T17:26:20.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde9806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fde9815aff0 0x7fde980cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde98070140 con 0x7fde9806db60 2024-09-13T17:26:20.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde98070420 con 0x7fde9815aff0 2024-09-13T17:26:20.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde9d000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98070700 con 0x7fde98144300 2024-09-13T17:26:20.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde97e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fde9806db60 0x7fde980b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55150/0 (socket says 172.21.15.139:55150) 2024-09-13T17:26:20.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde97e00700 1 -- 172.21.15.139:0/1321722392 learned_addr learned my addr 172.21.15.139:0/1321722392 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:20.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde96a00700 1 --2- 172.21.15.139:0/1321722392 >> v2:172.21.15.139:3300/0 conn(0x7fde9815aff0 0x7fde980cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.845+0000 7fde97400700 1 --2- 172.21.15.139:0/1321722392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde9806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96a00700 1 -- 172.21.15.139:0/1321722392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 msgr2=0x7fde9806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:20.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96a00700 1 --2- 172.21.15.139:0/1321722392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde9806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96a00700 1 -- 172.21.15.139:0/1321722392 >> v1:172.21.15.139:6789/0 conn(0x7fde9806db60 legacy=0x7fde980b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96a00700 1 -- 172.21.15.139:0/1321722392 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980709e0 con 0x7fde9815aff0 2024-09-13T17:26:20.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96a00700 1 --2- 172.21.15.139:0/1321722392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980cd6c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fde84009850 tx=0x7fde84009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11a19098c5ddc19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96000700 1 -- 172.21.15.139:0/1321722392 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011830 con 0x7fde9815aff0 2024-09-13T17:26:20.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96000700 1 -- 172.21.15.139:0/1321722392 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84011990 con 0x7fde9815aff0 2024-09-13T17:26:20.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde96000700 1 -- 172.21.15.139:0/1321722392 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011d40 con 0x7fde9815aff0 2024-09-13T17:26:20.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 -- 172.21.15.139:0/1321722392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 msgr2=0x7fde980cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 --2- 172.21.15.139:0/1321722392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980cd6c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fde84009850 tx=0x7fde84009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:20.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 -- 172.21.15.139:0/1321722392 shutdown_connections 2024-09-13T17:26:20.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 --2- 172.21.15.139:0/1321722392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980cd6c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 --2- 172.21.15.139:0/1321722392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde9806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 -- 172.21.15.139:0/1321722392 >> 172.21.15.139:0/1321722392 conn(0x7fde980ce9d0 msgr2=0x7fde980cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:20.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 -- 172.21.15.139:0/1321722392 shutdown_connections 2024-09-13T17:26:20.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.849+0000 7fde9d000700 1 -- 172.21.15.139:0/1321722392 wait complete. 2024-09-13T17:26:20.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 Processor -- start 2024-09-13T17:26:20.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 -- start start 2024-09-13T17:26:20.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9806db60 0x7fde9815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde980cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9815aaf0 con 0x7fde9815aff0 2024-09-13T17:26:20.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980ccac0 con 0x7fde9806db60 2024-09-13T17:26:20.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde9d000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980ccda0 con 0x7fde98144300 2024-09-13T17:26:20.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde97e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde97e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32992/0 (socket says 172.21.15.139:32992) 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde97e00700 1 -- 172.21.15.139:0/3275922257 learned_addr learned my addr 172.21.15.139:0/3275922257 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde96a00700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde980cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.853+0000 7fde97400700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9806db60 0x7fde9815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97e00700 1 -- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 msgr2=0x7fde980cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97e00700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde980cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97e00700 1 -- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9806db60 msgr2=0x7fde9815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97e00700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9806db60 0x7fde9815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97e00700 1 -- 172.21.15.139:0/3275922257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840094b0 con 0x7fde9815aff0 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97400700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9806db60 0x7fde9815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde96a00700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde980cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:20.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde97e00700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980aa630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fde9000caa0 tx=0x7fde9000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9000a7b0 con 0x7fde9815aff0 2024-09-13T17:26:20.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9000a910 con 0x7fde9815aff0 2024-09-13T17:26:20.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980cd080 con 0x7fde9815aff0 2024-09-13T17:26:20.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9000ace0 con 0x7fde9815aff0 2024-09-13T17:26:20.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde981f6c80 con 0x7fde9815aff0 2024-09-13T17:26:20.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.857+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde981f71e0 con 0x7fde9815aff0 2024-09-13T17:26:20.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.861+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fde9001b3b0 con 0x7fde9815aff0 2024-09-13T17:26:20.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.861+0000 7fde8f400700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fde78066850 0x7fde78068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:20.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.861+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fde90083e30 con 0x7fde9815aff0 2024-09-13T17:26:20.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.861+0000 7fde97400700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fde78066850 0x7fde78068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:20.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.861+0000 7fde97400700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fde78066850 0x7fde78068d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde88009c40 tx=0x7fde88008040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:20.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:20.869+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde90050fb0 con 0x7fde9815aff0 2024-09-13T17:26:21.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.053+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fde980ccf10 con 0x7fde78066850 2024-09-13T17:26:21.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.057+0000 7fde8f400700 1 -- 172.21.15.139:0/3275922257 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fde980ccf10 con 0x7fde78066850 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fde78066850 msgr2=0x7fde78068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fde78066850 0x7fde78068d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde88009c40 tx=0x7fde88008040 comp rx=0 tx=0).stop 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 msgr2=0x7fde980aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980aa630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fde9000caa0 tx=0x7fde9000cb80 comp rx=0 tx=0).stop 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 shutdown_connections 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fde78066850 0x7fde78068d10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde9815aff0 0x7fde980aa630 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde98144300 0x7fde980cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 --2- 172.21.15.139:0/3275922257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde9806db60 0x7fde9815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 >> 172.21.15.139:0/3275922257 conn(0x7fde980ce9d0 msgr2=0x7fde98142ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 shutdown_connections 2024-09-13T17:26:21.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.061+0000 7fde9d000700 1 -- 172.21.15.139:0/3275922257 wait complete. 2024-09-13T17:26:21.068 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T17:26:21.089 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T17:26:21.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:21.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.261+0000 7f8bc2600700 1 Processor -- start 2024-09-13T17:26:21.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.261+0000 7f8bc2600700 1 -- start start 2024-09-13T17:26:21.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc2600700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8bbc06d220 0x7f8bbc071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc2600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 0x7f8bbc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc2600700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8bbc15e0b0 0x7f8bbc0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc2600700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc06d600 con 0x7f8bbc06d220 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc2600700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc15d6e0 con 0x7f8bbc15e0b0 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc2600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc15d3f0 con 0x7f8bbc0b2300 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bbbe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 0x7f8bbc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc1200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8bbc06d220 0x7f8bbc071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bbbe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 0x7f8bbc15db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.139:57914/0 (socket says 172.21.15.139:57914) 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bbbe00700 1 -- 172.21.15.139:0/2781362566 learned_addr learned my addr 172.21.15.139:0/2781362566 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.265+0000 7f8bc1c00700 1 --2- 172.21.15.139:0/2781362566 >> v2:172.21.15.176:3300/0 conn(0x7f8bbc15e0b0 0x7f8bbc0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbbe00700 1 -- 172.21.15.139:0/2781362566 >> v2:172.21.15.176:3300/0 conn(0x7f8bbc15e0b0 msgr2=0x7f8bbc0ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbbe00700 1 --2- 172.21.15.139:0/2781362566 >> v2:172.21.15.176:3300/0 conn(0x7f8bbc15e0b0 0x7f8bbc0ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbbe00700 1 -- 172.21.15.139:0/2781362566 >> v2:172.21.15.139:3300/0 conn(0x7f8bbc06d220 msgr2=0x7f8bbc071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbbe00700 1 --2- 172.21.15.139:0/2781362566 >> v2:172.21.15.139:3300/0 conn(0x7f8bbc06d220 0x7f8bbc071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbbe00700 1 -- 172.21.15.139:0/2781362566 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0b2a70 con 0x7f8bbc0b2300 2024-09-13T17:26:21.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbbe00700 1 --2- 172.21.15.139:0/2781362566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 0x7f8bbc15db70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0b39f0 tx=0x7f8ba8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d34955f11a3093e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbb400700 1 -- 172.21.15.139:0/2781362566 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8011830 con 0x7f8bbc0b2300 2024-09-13T17:26:21.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbb400700 1 -- 172.21.15.139:0/2781362566 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba8011990 con 0x7f8bbc0b2300 2024-09-13T17:26:21.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bbb400700 1 -- 172.21.15.139:0/2781362566 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8011d20 con 0x7f8bbc0b2300 2024-09-13T17:26:21.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 -- 172.21.15.139:0/2781362566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 msgr2=0x7f8bbc15db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 --2- 172.21.15.139:0/2781362566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 0x7f8bbc15db70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0b39f0 tx=0x7f8ba8009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 -- 172.21.15.139:0/2781362566 shutdown_connections 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 --2- 172.21.15.139:0/2781362566 >> v2:172.21.15.176:3300/0 conn(0x7f8bbc15e0b0 0x7f8bbc0ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 --2- 172.21.15.139:0/2781362566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc0b2300 0x7f8bbc15db70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 --2- 172.21.15.139:0/2781362566 >> v2:172.21.15.139:3300/0 conn(0x7f8bbc06d220 0x7f8bbc071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 -- 172.21.15.139:0/2781362566 >> 172.21.15.139:0/2781362566 conn(0x7f8bbc06e360 msgr2=0x7f8bbc06e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 -- 172.21.15.139:0/2781362566 shutdown_connections 2024-09-13T17:26:21.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.269+0000 7f8bc2600700 1 -- 172.21.15.139:0/2781362566 wait complete. 2024-09-13T17:26:21.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.273+0000 7f8bc2600700 1 Processor -- start 2024-09-13T17:26:21.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.273+0000 7f8bc2600700 1 -- start start 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bbc06d220 0x7f8bbc157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bbc0b2300 0x7f8bbc15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc15e0b0 0x7f8bbc1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc15cae0 con 0x7f8bbc0b2300 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1582f0 con 0x7f8bbc06d220 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1558f0 con 0x7f8bbc15e0b0 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bbc0b2300 0x7f8bbc15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bbc0b2300 0x7f8bbc15bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33016/0 (socket says 172.21.15.139:33016) 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc1200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bbc06d220 0x7f8bbc157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 -- 172.21.15.139:0/3343242072 learned_addr learned my addr 172.21.15.139:0/3343242072 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:21.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc1c00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc15e0b0 0x7f8bbc1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 -- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc15e0b0 msgr2=0x7f8bbc1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc15e0b0 0x7f8bbc1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 -- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bbc06d220 msgr2=0x7f8bbc157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bbc06d220 0x7f8bbc157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 -- 172.21.15.139:0/3343242072 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009570 con 0x7f8bbc0b2300 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc1c00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bbc15e0b0 0x7f8bbc1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc1200700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bbc06d220 0x7f8bbc157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:26:21.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bbbe00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bbc0b2300 0x7f8bbc15bae0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8013000 tx=0x7f8ba8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004240 con 0x7f8bbc0b2300 2024-09-13T17:26:21.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba801f070 con 0x7f8bbc0b2300 2024-09-13T17:26:21.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004600 con 0x7f8bbc0b2300 2024-09-13T17:26:21.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc155b00 con 0x7f8bbc0b2300 2024-09-13T17:26:21.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.277+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc1560c0 con 0x7f8bbc0b2300 2024-09-13T17:26:21.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.281+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bbc0b2760 con 0x7f8bbc0b2300 2024-09-13T17:26:21.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.281+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8ba8021030 con 0x7f8bbc0b2300 2024-09-13T17:26:21.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bb8c00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8b9c066850 0x7f8b9c068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f8ba8085700 con 0x7f8bbc0b2300 2024-09-13T17:26:21.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bc1200700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8b9c066850 0x7f8b9c068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bb8c00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7f8b9c06cf80 0x7f8b9c06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 --> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b9c06fa90 con 0x7f8b9c06cf80 2024-09-13T17:26:21.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ba8085a70 con 0x7f8bbc0b2300 2024-09-13T17:26:21.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bc1c00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7f8b9c06cf80 0x7f8b9c06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bc1200700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8b9c066850 0x7f8b9c068d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009f60 tx=0x7f8bb0009240 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bc1c00700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7f8b9c06cf80 0x7f8b9c06f3c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.285+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== osd.3 v2:172.21.15.139:6816/1185400623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8b9c06fa90 con 0x7f8b9c06cf80 2024-09-13T17:26:21.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 --> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8bbc0b3030 con 0x7f8b9c06cf80 2024-09-13T17:26:21.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bb8c00700 1 -- 172.21.15.139:0/3343242072 <== osd.3 v2:172.21.15.139:6816/1185400623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8bb4007730 con 0x7f8b9c06cf80 2024-09-13T17:26:21.312 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:21.312 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:21.312 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7f8b9c06cf80 msgr2=0x7f8b9c06f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6816/1185400623,v1:172.21.15.139:6819/1185400623] conn(0x7f8b9c06cf80 0x7f8b9c06f3c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8b9c066850 msgr2=0x7f8b9c068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8b9c066850 0x7f8b9c068d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009f60 tx=0x7f8bb0009240 comp rx=0 tx=0).stop 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bbc0b2300 msgr2=0x7f8bbc15bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 --2- 172.21.15.139:0/3343242072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bbc0b2300 0x7f8bbc15bae0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8013000 tx=0x7f8ba8004770 comp rx=0 tx=0).stop 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc1c00700 1 -- 172.21.15.139:0/3343242072 reap_dead start 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 shutdown_connections 2024-09-13T17:26:21.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.305+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 >> 172.21.15.139:0/3343242072 conn(0x7f8bbc06e360 msgr2=0x7f8bbc0aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.309+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 shutdown_connections 2024-09-13T17:26:21.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.309+0000 7f8bc2600700 1 -- 172.21.15.139:0/3343242072 wait complete. 2024-09-13T17:26:21.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T17:26:21.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.501+0000 7fce8fe00700 1 Processor -- start 2024-09-13T17:26:21.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8fe00700 1 -- start start 2024-09-13T17:26:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8fe00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce90144300 0x7fce9006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce900cddd0 0x7fce900711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8fe00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce90070140 con 0x7fce9015aff0 2024-09-13T17:26:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8fe00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce90070420 con 0x7fce90144300 2024-09-13T17:26:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90070700 con 0x7fce900cddd0 2024-09-13T17:26:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce90144300 0x7fce9006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8f400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce900cddd0 0x7fce900711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce90144300 0x7fce9006d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:47278/0 (socket says 172.21.15.139:47278) 2024-09-13T17:26:21.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 -- 172.21.15.139:0/4021963542 learned_addr learned my addr 172.21.15.139:0/4021963542 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:21.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 -- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce900cddd0 msgr2=0x7fce900711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:21.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 --2- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce900cddd0 0x7fce900711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 -- 172.21.15.139:0/4021963542 >> v1:172.21.15.176:6789/0 conn(0x7fce9015aff0 legacy=0x7fce900cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.505+0000 7fce8ea00700 1 -- 172.21.15.139:0/4021963542 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900709e0 con 0x7fce90144300 2024-09-13T17:26:21.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8ea00700 1 --2- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce90144300 0x7fce9006d620 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce80009e80 tx=0x7fce8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c6826f30209fa08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8d600700 1 -- 172.21.15.139:0/4021963542 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000e070 con 0x7fce90144300 2024-09-13T17:26:21.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8d600700 1 -- 172.21.15.139:0/4021963542 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8000b8d0 con 0x7fce90144300 2024-09-13T17:26:21.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8d600700 1 -- 172.21.15.139:0/4021963542 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000bc80 con 0x7fce90144300 2024-09-13T17:26:21.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 -- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce90144300 msgr2=0x7fce9006d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 --2- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce90144300 0x7fce9006d620 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce80009e80 tx=0x7fce8000b330 comp rx=0 tx=0).stop 2024-09-13T17:26:21.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 -- 172.21.15.139:0/4021963542 shutdown_connections 2024-09-13T17:26:21.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 --2- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce900cddd0 0x7fce900711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 --2- 172.21.15.139:0/4021963542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce90144300 0x7fce9006d620 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 -- 172.21.15.139:0/4021963542 >> 172.21.15.139:0/4021963542 conn(0x7fce900ce9d0 msgr2=0x7fce900cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 -- 172.21.15.139:0/4021963542 shutdown_connections 2024-09-13T17:26:21.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.509+0000 7fce8fe00700 1 -- 172.21.15.139:0/4021963542 wait complete. 2024-09-13T17:26:21.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 Processor -- start 2024-09-13T17:26:21.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 -- start start 2024-09-13T17:26:21.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce900cddd0 0x7fce901f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 0x7fce901f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9015aff0 0x7fce900a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f2fd0 con 0x7fce90144300 2024-09-13T17:26:21.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f3280 con 0x7fce900cddd0 2024-09-13T17:26:21.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8fe00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f3560 con 0x7fce9015aff0 2024-09-13T17:26:21.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.513+0000 7fce8e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 0x7fce901f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 0x7fce901f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33020/0 (socket says 172.21.15.139:33020) 2024-09-13T17:26:21.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 -- 172.21.15.139:0/2689281909 learned_addr learned my addr 172.21.15.139:0/2689281909 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:21.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8f400700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9015aff0 0x7fce900a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8ea00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce900cddd0 0x7fce901f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 -- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9015aff0 msgr2=0x7fce900a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9015aff0 0x7fce900a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 -- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce900cddd0 msgr2=0x7fce901f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce900cddd0 0x7fce901f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 -- 172.21.15.139:0/2689281909 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80009b30 con 0x7fce90144300 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8e000700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 0x7fce901f2a90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00c500 tx=0x7fce7c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0052d0 con 0x7fce90144300 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c005430 con 0x7fce90144300 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce901f3840 con 0x7fce90144300 2024-09-13T17:26:21.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0055a0 con 0x7fce90144300 2024-09-13T17:26:21.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce901f3e00 con 0x7fce90144300 2024-09-13T17:26:21.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.517+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce900cd6c0 con 0x7fce90144300 2024-09-13T17:26:21.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.521+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fce7c0038e0 con 0x7fce90144300 2024-09-13T17:26:21.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.521+0000 7fce86a00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fce70066850 0x7fce70068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.521+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fce7c083750 con 0x7fce90144300 2024-09-13T17:26:21.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.525+0000 7fce8ea00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fce70066850 0x7fce70068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.525+0000 7fce8ea00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fce70066850 0x7fce70068d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce8000b370 tx=0x7fce80009000 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.529+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fce7c050840 con 0x7fce90144300 2024-09-13T17:26:21.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.713+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fce9006fe10 con 0x7fce70066850 2024-09-13T17:26:21.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.713+0000 7fce86a00700 1 -- 172.21.15.139:0/2689281909 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fce80021070 con 0x7fce70066850 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fce70066850 msgr2=0x7fce70068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fce70066850 0x7fce70068d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce8000b370 tx=0x7fce80009000 comp rx=0 tx=0).stop 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 msgr2=0x7fce901f2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 0x7fce901f2a90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00c500 tx=0x7fce7c00c810 comp rx=0 tx=0).stop 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 shutdown_connections 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fce70066850 0x7fce70068d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9015aff0 0x7fce900a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce90144300 0x7fce901f2a90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 --2- 172.21.15.139:0/2689281909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce900cddd0 0x7fce901f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 >> 172.21.15.139:0/2689281909 conn(0x7fce900ce9d0 msgr2=0x7fce9006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 shutdown_connections 2024-09-13T17:26:21.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.717+0000 7fce8fe00700 1 -- 172.21.15.139:0/2689281909 wait complete. 2024-09-13T17:26:21.723 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T17:26:21.744 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T17:26:21.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:21.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.925+0000 7f8497e00700 1 Processor -- start 2024-09-13T17:26:21.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.925+0000 7f8497e00700 1 -- start start 2024-09-13T17:26:21.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8497e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f84980ce0d0 0x7f849806fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8497e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84980b3960 0x7f849806b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8497e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8498070480 con 0x7f849814ab50 2024-09-13T17:26:21.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8497e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498070760 con 0x7f84980ce0d0 2024-09-13T17:26:21.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8497e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498070a40 con 0x7f84980b3960 2024-09-13T17:26:21.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f849814ab50 0x7f84980cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55166/0 (socket says 172.21.15.139:55166) 2024-09-13T17:26:21.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496a00700 1 -- 172.21.15.139:0/3719386656 learned_addr learned my addr 172.21.15.139:0/3719386656 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:21.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496000700 1 --2- 172.21.15.139:0/3719386656 >> v2:172.21.15.139:3300/0 conn(0x7f84980ce0d0 0x7f849806fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8497400700 1 --2- 172.21.15.139:0/3719386656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84980b3960 0x7f849806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8495600700 1 -- 172.21.15.139:0/3719386656 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295660102 0 0) 0x7f8498070480 con 0x7f849814ab50 2024-09-13T17:26:21.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496000700 1 -- 172.21.15.139:0/3719386656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84980b3960 msgr2=0x7f849806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:21.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496000700 1 --2- 172.21.15.139:0/3719386656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84980b3960 0x7f849806b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496000700 1 -- 172.21.15.139:0/3719386656 >> v1:172.21.15.139:6789/0 conn(0x7f849814ab50 legacy=0x7f84980cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496000700 1 -- 172.21.15.139:0/3719386656 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498070d20 con 0x7f84980ce0d0 2024-09-13T17:26:21.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8496000700 1 --2- 172.21.15.139:0/3719386656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f849806fe10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8484009880 tx=0x7f8484009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ef7837ebbf2a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8495600700 1 -- 172.21.15.139:0/3719386656 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484011830 con 0x7f84980ce0d0 2024-09-13T17:26:21.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8495600700 1 -- 172.21.15.139:0/3719386656 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484011990 con 0x7f84980ce0d0 2024-09-13T17:26:21.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.929+0000 7f8495600700 1 -- 172.21.15.139:0/3719386656 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484011d20 con 0x7f84980ce0d0 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 -- 172.21.15.139:0/3719386656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 msgr2=0x7f849806fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 --2- 172.21.15.139:0/3719386656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f849806fe10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8484009880 tx=0x7f8484009b90 comp rx=0 tx=0).stop 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 -- 172.21.15.139:0/3719386656 shutdown_connections 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 --2- 172.21.15.139:0/3719386656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84980b3960 0x7f849806b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 --2- 172.21.15.139:0/3719386656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f849806fe10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 -- 172.21.15.139:0/3719386656 >> 172.21.15.139:0/3719386656 conn(0x7f84980cb5b0 msgr2=0x7f84980cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 -- 172.21.15.139:0/3719386656 shutdown_connections 2024-09-13T17:26:21.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.933+0000 7f8497e00700 1 -- 172.21.15.139:0/3719386656 wait complete. 2024-09-13T17:26:21.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 Processor -- start 2024-09-13T17:26:21.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 -- start start 2024-09-13T17:26:21.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980b3960 0x7f84981f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f8498163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f849814ab50 0x7f84980ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498154700 con 0x7f84980ce0d0 2024-09-13T17:26:21.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498144cb0 con 0x7f84980b3960 2024-09-13T17:26:21.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498144f90 con 0x7f849814ab50 2024-09-13T17:26:21.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f8498163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f8498163fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33046/0 (socket says 172.21.15.139:33046) 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 -- 172.21.15.139:0/3189232399 learned_addr learned my addr 172.21.15.139:0/3189232399 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496a00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980b3960 0x7f84981f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8497400700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f849814ab50 0x7f84980ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 -- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f849814ab50 msgr2=0x7f84980ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f849814ab50 0x7f84980ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 -- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980b3960 msgr2=0x7f84981f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980b3960 0x7f84981f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496000700 1 -- 172.21.15.139:0/3189232399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84840094b0 con 0x7f84980ce0d0 2024-09-13T17:26:21.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.937+0000 7f8496a00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980b3960 0x7f84981f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:26:21.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f8496000700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f8498163fd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8484009bd0 tx=0x7f8484004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840044c0 con 0x7f84980ce0d0 2024-09-13T17:26:21.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848401f070 con 0x7f84980ce0d0 2024-09-13T17:26:21.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8498145270 con 0x7f84980ce0d0 2024-09-13T17:26:21.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840038c0 con 0x7f84980ce0d0 2024-09-13T17:26:21.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84981f66b0 con 0x7f84980ce0d0 2024-09-13T17:26:21.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.941+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f849814af30 con 0x7f84980ce0d0 2024-09-13T17:26:21.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8484021030 con 0x7f84980ce0d0 2024-09-13T17:26:21.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f848f400700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8478066850 0x7f8478068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f8484085f20 con 0x7f84980ce0d0 2024-09-13T17:26:21.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f8496a00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8478066850 0x7f8478068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f848f400700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f847806d0f0 0x7f847806f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:21.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 --> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f847806fc00 con 0x7f847806d0f0 2024-09-13T17:26:21.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8484086370 con 0x7f84980ce0d0 2024-09-13T17:26:21.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f8497400700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f847806d0f0 0x7f847806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:21.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.945+0000 7f8496a00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8478066850 0x7f8478068d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8488000f60 tx=0x7f8488007d50 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.949+0000 7f8497400700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f847806d0f0 0x7f847806f530 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:21.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.949+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== osd.4 v2:172.21.15.176:6800/3123658344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f847806fc00 con 0x7f847806d0f0 2024-09-13T17:26:21.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 --> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84980b3e10 con 0x7f847806d0f0 2024-09-13T17:26:21.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f848f400700 1 -- 172.21.15.139:0/3189232399 <== osd.4 v2:172.21.15.176:6800/3123658344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f849000f040 con 0x7f847806d0f0 2024-09-13T17:26:21.976 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:21.976 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:21.976 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:21.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f847806d0f0 msgr2=0x7f847806f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.176:6800/3123658344,v1:172.21.15.176:6801/3123658344] conn(0x7f847806d0f0 0x7f847806f530 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:21.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8478066850 msgr2=0x7f8478068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f8478066850 0x7f8478068d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8488000f60 tx=0x7f8488007d50 comp rx=0 tx=0).stop 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 msgr2=0x7f8498163fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 --2- 172.21.15.139:0/3189232399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84980ce0d0 0x7f8498163fd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8484009bd0 tx=0x7f8484004770 comp rx=0 tx=0).stop 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497400700 1 -- 172.21.15.139:0/3189232399 reap_dead start 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 shutdown_connections 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 >> 172.21.15.139:0/3189232399 conn(0x7f84980cb5b0 msgr2=0x7f84980cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.969+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 shutdown_connections 2024-09-13T17:26:21.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:21.973+0000 7f8497e00700 1 -- 172.21.15.139:0/3189232399 wait complete. 2024-09-13T17:26:22.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T17:26:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 Processor -- start 2024-09-13T17:26:22.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 -- start start 2024-09-13T17:26:22.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415aff0 0x7fbed40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbed40cdc00 0x7fbed40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed4070140 con 0x7fbed4144300 2024-09-13T17:26:22.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed40ce070 con 0x7fbed40cdc00 2024-09-13T17:26:22.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed8c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4070420 con 0x7fbed415aff0 2024-09-13T17:26:22.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbed40cdc00 0x7fbed40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed3e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbed40cdc00 0x7fbed40711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33060/0 (socket says 172.21.15.139:33060) 2024-09-13T17:26:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed3e00700 1 -- 172.21.15.139:0/554770496 learned_addr learned my addr 172.21.15.139:0/554770496 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.177+0000 7fbed2a00700 1 --2- 172.21.15.139:0/554770496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415aff0 0x7fbed40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed3e00700 1 -- 172.21.15.139:0/554770496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415aff0 msgr2=0x7fbed40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed3e00700 1 --2- 172.21.15.139:0/554770496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415aff0 0x7fbed40cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed3e00700 1 -- 172.21.15.139:0/554770496 >> v1:172.21.15.176:6789/0 conn(0x7fbed4144300 legacy=0x7fbed406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed3e00700 1 -- 172.21.15.139:0/554770496 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4070700 con 0x7fbed40cdc00 2024-09-13T17:26:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed3e00700 1 --2- 172.21.15.139:0/554770496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed40cdc00 0x7fbed40711e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e50 tx=0x7fbecc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07d8808e0e901e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed2000700 1 -- 172.21.15.139:0/554770496 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00e070 con 0x7fbed40cdc00 2024-09-13T17:26:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed2000700 1 -- 172.21.15.139:0/554770496 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00b910 con 0x7fbed40cdc00 2024-09-13T17:26:22.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed2000700 1 -- 172.21.15.139:0/554770496 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00bcc0 con 0x7fbed40cdc00 2024-09-13T17:26:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 -- 172.21.15.139:0/554770496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed40cdc00 msgr2=0x7fbed40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 --2- 172.21.15.139:0/554770496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed40cdc00 0x7fbed40711e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e50 tx=0x7fbecc00b330 comp rx=0 tx=0).stop 2024-09-13T17:26:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 -- 172.21.15.139:0/554770496 shutdown_connections 2024-09-13T17:26:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 --2- 172.21.15.139:0/554770496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed40cdc00 0x7fbed40711e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 --2- 172.21.15.139:0/554770496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415aff0 0x7fbed40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 -- 172.21.15.139:0/554770496 >> 172.21.15.139:0/554770496 conn(0x7fbed40ce9d0 msgr2=0x7fbed40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:22.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 -- 172.21.15.139:0/554770496 shutdown_connections 2024-09-13T17:26:22.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.181+0000 7fbed8c00700 1 -- 172.21.15.139:0/554770496 wait complete. 2024-09-13T17:26:22.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 Processor -- start 2024-09-13T17:26:22.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 -- start start 2024-09-13T17:26:22.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40cdc00 0x7fbed41efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 0x7fbed41f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415aff0 0x7fbed413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed41f37c0 con 0x7fbed4144300 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed41f0260 con 0x7fbed415aff0 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed8c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed41f2cf0 con 0x7fbed40cdc00 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed2a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 0x7fbed41f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed2a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 0x7fbed41f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33074/0 (socket says 172.21.15.139:33074) 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed2a00700 1 -- 172.21.15.139:0/1805489279 learned_addr learned my addr 172.21.15.139:0/1805489279 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed3e00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415aff0 0x7fbed413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.185+0000 7fbed3400700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40cdc00 0x7fbed41efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed2a00700 1 -- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40cdc00 msgr2=0x7fbed41efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed2a00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40cdc00 0x7fbed41efd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed2a00700 1 -- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415aff0 msgr2=0x7fbed413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed2a00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415aff0 0x7fbed413e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed2a00700 1 -- 172.21.15.139:0/1805489279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009b30 con 0x7fbed4144300 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed2a00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 0x7fbed41f27b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbec000e840 tx=0x7fbec000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00095a0 con 0x7fbed4144300 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0013680 con 0x7fbed4144300 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00139f0 con 0x7fbed4144300 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed413e810 con 0x7fbed4144300 2024-09-13T17:26:22.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed41f3200 con 0x7fbed4144300 2024-09-13T17:26:22.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.189+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed41446e0 con 0x7fbed4144300 2024-09-13T17:26:22.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.193+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fbec0013b50 con 0x7fbed4144300 2024-09-13T17:26:22.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.193+0000 7fbecb400700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbeb4066850 0x7fbeb4068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.193+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fbec0084250 con 0x7fbed4144300 2024-09-13T17:26:22.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.193+0000 7fbed3400700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbeb4066850 0x7fbeb4068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.193+0000 7fbed3400700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbeb4066850 0x7fbeb4068d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbec4000f60 tx=0x7fbec4009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.201+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbec0051340 con 0x7fbed4144300 2024-09-13T17:26:22.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.381+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed406fe10 con 0x7fbeb4066850 2024-09-13T17:26:22.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbecb400700 1 -- 172.21.15.139:0/1805489279 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbec40015e0 con 0x7fbeb4066850 2024-09-13T17:26:22.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbeb4066850 msgr2=0x7fbeb4068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbeb4066850 0x7fbeb4068d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbec4000f60 tx=0x7fbec4009040 comp rx=0 tx=0).stop 2024-09-13T17:26:22.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 msgr2=0x7fbed41f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 0x7fbed41f27b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbec000e840 tx=0x7fbec000eb50 comp rx=0 tx=0).stop 2024-09-13T17:26:22.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 shutdown_connections 2024-09-13T17:26:22.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fbeb4066850 0x7fbeb4068d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415aff0 0x7fbed413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbed4144300 0x7fbed41f27b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 --2- 172.21.15.139:0/1805489279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40cdc00 0x7fbed41efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 >> 172.21.15.139:0/1805489279 conn(0x7fbed40ce9d0 msgr2=0x7fbed40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:22.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 shutdown_connections 2024-09-13T17:26:22.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.385+0000 7fbed8c00700 1 -- 172.21.15.139:0/1805489279 wait complete. 2024-09-13T17:26:22.395 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T17:26:22.412 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T17:26:22.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:22.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.585+0000 7fc563200700 1 Processor -- start 2024-09-13T17:26:22.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.585+0000 7fc563200700 1 -- start start 2024-09-13T17:26:22.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.585+0000 7fc563200700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc5640cd560 0x7fc5640cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5640d0910 0x7fc5640d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640d0260 con 0x7fc564144570 2024-09-13T17:26:22.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640cf730 con 0x7fc5640cd560 2024-09-13T17:26:22.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640cf100 con 0x7fc5640d0910 2024-09-13T17:26:22.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc5640cd560 0x7fc5640cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561e00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc564144570 0x7fc5640cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55170/0 (socket says 172.21.15.139:55170) 2024-09-13T17:26:22.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561e00700 1 -- 172.21.15.139:0/3870332246 learned_addr learned my addr 172.21.15.139:0/3870332246 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:22.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc562800700 1 --2- 172.21.15.139:0/3870332246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5640d0910 0x7fc5640d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561400700 1 -- 172.21.15.139:0/3870332246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5640d0910 msgr2=0x7fc5640d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:22.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561400700 1 --2- 172.21.15.139:0/3870332246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5640d0910 0x7fc5640d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561400700 1 -- 172.21.15.139:0/3870332246 >> v1:172.21.15.139:6789/0 conn(0x7fc564144570 legacy=0x7fc5640cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc560a00700 1 -- 172.21.15.139:0/3870332246 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849855781 0 0) 0x7fc5640d0260 con 0x7fc564144570 2024-09-13T17:26:22.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561400700 1 -- 172.21.15.139:0/3870332246 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640ce000 con 0x7fc5640cd560 2024-09-13T17:26:22.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc561400700 1 --2- 172.21.15.139:0/3870332246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cd9d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc550009850 tx=0x7fc550009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6091debe8f5c5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc560a00700 1 -- 172.21.15.139:0/3870332246 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550011830 con 0x7fc5640cd560 2024-09-13T17:26:22.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc560a00700 1 -- 172.21.15.139:0/3870332246 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc550011990 con 0x7fc5640cd560 2024-09-13T17:26:22.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc560a00700 1 -- 172.21.15.139:0/3870332246 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550011d40 con 0x7fc5640cd560 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- 172.21.15.139:0/3870332246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 msgr2=0x7fc5640cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 --2- 172.21.15.139:0/3870332246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cd9d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc550009850 tx=0x7fc550009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- 172.21.15.139:0/3870332246 shutdown_connections 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 --2- 172.21.15.139:0/3870332246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5640d0910 0x7fc5640d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 --2- 172.21.15.139:0/3870332246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cd9d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- 172.21.15.139:0/3870332246 >> 172.21.15.139:0/3870332246 conn(0x7fc56406a390 msgr2=0x7fc56406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- 172.21.15.139:0/3870332246 shutdown_connections 2024-09-13T17:26:22.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.589+0000 7fc563200700 1 -- 172.21.15.139:0/3870332246 wait complete. 2024-09-13T17:26:22.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 Processor -- start 2024-09-13T17:26:22.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 -- start start 2024-09-13T17:26:22.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5640d0910 0x7fc5640ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc564144570 0x7fc5640c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56413dfe0 con 0x7fc5640cd560 2024-09-13T17:26:22.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56406d6f0 con 0x7fc5640d0910 2024-09-13T17:26:22.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc563200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640ccb30 con 0x7fc564144570 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.593+0000 7fc561e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33104/0 (socket says 172.21.15.139:33104) 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 -- 172.21.15.139:0/921266315 learned_addr learned my addr 172.21.15.139:0/921266315 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc562800700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc564144570 0x7fc5640c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561400700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5640d0910 0x7fc5640ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 -- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc564144570 msgr2=0x7fc5640c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc564144570 0x7fc5640c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 -- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5640d0910 msgr2=0x7fc5640ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5640d0910 0x7fc5640ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 -- 172.21.15.139:0/921266315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500094b0 con 0x7fc5640cd560 2024-09-13T17:26:22.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc561e00700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cc5f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c780 tx=0x7fc55400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554005d90 con 0x7fc5640cd560 2024-09-13T17:26:22.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5540070d0 con 0x7fc5640cd560 2024-09-13T17:26:22.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554007480 con 0x7fc5640cd560 2024-09-13T17:26:22.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5640cac70 con 0x7fc5640cd560 2024-09-13T17:26:22.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5640c61f0 con 0x7fc5640cd560 2024-09-13T17:26:22.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.597+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5640d12a0 con 0x7fc5640cd560 2024-09-13T17:26:22.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc5540075e0 con 0x7fc5640cd560 2024-09-13T17:26:22.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc55a000700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fc544066850 0x7fc544068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fc5540839f0 con 0x7fc5640cd560 2024-09-13T17:26:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc561400700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fc544066850 0x7fc544068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc55a000700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7fc54406d0f0 0x7fc54406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 --> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc54406fc00 con 0x7fc54406d0f0 2024-09-13T17:26:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5540882a0 con 0x7fc5640cd560 2024-09-13T17:26:22.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc561400700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fc544066850 0x7fc544068d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5500090b0 tx=0x7fc55001c040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.601+0000 7fc562800700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7fc54406d0f0 0x7fc54406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.605+0000 7fc562800700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7fc54406d0f0 0x7fc54406f530 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.605+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== osd.5 v2:172.21.15.176:6804/545225210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc54406fc00 con 0x7fc54406d0f0 2024-09-13T17:26:22.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.625+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 --> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5640cf350 con 0x7fc54406d0f0 2024-09-13T17:26:22.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.625+0000 7fc55a000700 1 -- 172.21.15.139:0/921266315 <== osd.5 v2:172.21.15.176:6804/545225210 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc55c00f040 con 0x7fc54406d0f0 2024-09-13T17:26:22.632 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:22.632 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:22.632 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7fc54406d0f0 msgr2=0x7fc54406f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.176:6804/545225210,v1:172.21.15.176:6806/545225210] conn(0x7fc54406d0f0 0x7fc54406f530 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fc544066850 msgr2=0x7fc544068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fc544066850 0x7fc544068d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5500090b0 tx=0x7fc55001c040 comp rx=0 tx=0).stop 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 msgr2=0x7fc5640cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 --2- 172.21.15.139:0/921266315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5640cd560 0x7fc5640cc5f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c780 tx=0x7fc55400cb40 comp rx=0 tx=0).stop 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc562800700 1 -- 172.21.15.139:0/921266315 reap_dead start 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 shutdown_connections 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 >> 172.21.15.139:0/921266315 conn(0x7fc56406a390 msgr2=0x7fc5640cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 shutdown_connections 2024-09-13T17:26:22.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.629+0000 7fc563200700 1 -- 172.21.15.139:0/921266315 wait complete. 2024-09-13T17:26:22.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T17:26:22.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.829+0000 7fd59be00700 1 Processor -- start 2024-09-13T17:26:22.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.829+0000 7fd59be00700 1 -- start start 2024-09-13T17:26:22.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59be00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd59c15f5c0 0x7fd59c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59be00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c0b6370 con 0x7fd59c15ebb0 2024-09-13T17:26:22.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59be00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c0b6650 con 0x7fd59c15ef90 2024-09-13T17:26:22.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59be00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c0b6930 con 0x7fd59c15f5c0 2024-09-13T17:26:22.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59aa00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd59c15ebb0 0x7fd59c1434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55182/0 (socket says 172.21.15.139:55182) 2024-09-13T17:26:22.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59aa00700 1 -- 172.21.15.139:0/488518734 learned_addr learned my addr 172.21.15.139:0/488518734 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:22.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd592000700 1 --2- 172.21.15.139:0/488518734 >> v2:172.21.15.176:3300/0 conn(0x7fd59c15f5c0 0x7fd59c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492947503 0 0) 0x7fd59c0b6370 con 0x7fd59c15ebb0 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5800035d0 con 0x7fd59c15ebb0 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744508080 0 0) 0x7fd59c0b6650 con 0x7fd59c15ef90 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd59c0b6370 con 0x7fd59c15ef90 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd592000700 1 -- 172.21.15.139:0/488518734 >> v1:172.21.15.176:6789/0 conn(0x7fd59c15ef90 legacy=0x7fd59c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd592000700 1 -- 172.21.15.139:0/488518734 >> v1:172.21.15.139:6789/0 conn(0x7fd59c15ebb0 legacy=0x7fd59c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd592000700 1 -- 172.21.15.139:0/488518734 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0b6c10 con 0x7fd59c15f5c0 2024-09-13T17:26:22.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.833+0000 7fd592000700 1 --2- 172.21.15.139:0/488518734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15f5c0 0x7fd59c143be0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd584009d90 tx=0x7fd58400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=348bafd1ab59c041 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400e070 con 0x7fd59c15f5c0 2024-09-13T17:26:22.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400bb20 con 0x7fd59c15f5c0 2024-09-13T17:26:22.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59a000700 1 -- 172.21.15.139:0/488518734 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584012430 con 0x7fd59c15f5c0 2024-09-13T17:26:22.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 -- 172.21.15.139:0/488518734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15f5c0 msgr2=0x7fd59c143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 --2- 172.21.15.139:0/488518734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15f5c0 0x7fd59c143be0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd584009d90 tx=0x7fd58400b330 comp rx=0 tx=0).stop 2024-09-13T17:26:22.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 -- 172.21.15.139:0/488518734 shutdown_connections 2024-09-13T17:26:22.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 --2- 172.21.15.139:0/488518734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15f5c0 0x7fd59c143be0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 -- 172.21.15.139:0/488518734 >> 172.21.15.139:0/488518734 conn(0x7fd59c071fa0 msgr2=0x7fd59c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:22.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 -- 172.21.15.139:0/488518734 shutdown_connections 2024-09-13T17:26:22.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.837+0000 7fd59be00700 1 -- 172.21.15.139:0/488518734 wait complete. 2024-09-13T17:26:22.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 Processor -- start 2024-09-13T17:26:22.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 -- start start 2024-09-13T17:26:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15ebb0 0x7fd59c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 0x7fd59c139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd59c15f5c0 0x7fd59c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c13b150 con 0x7fd59c15ef90 2024-09-13T17:26:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0cbf80 con 0x7fd59c15ebb0 2024-09-13T17:26:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.841+0000 7fd59be00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0cc260 con 0x7fd59c15f5c0 2024-09-13T17:26:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 0x7fd59c139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 0x7fd59c139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33118/0 (socket says 172.21.15.139:33118) 2024-09-13T17:26:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 -- 172.21.15.139:0/1244489432 learned_addr learned my addr 172.21.15.139:0/1244489432 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd59aa00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15ebb0 0x7fd59c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd59b400700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd59c15f5c0 0x7fd59c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 -- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd59c15f5c0 msgr2=0x7fd59c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd59c15f5c0 0x7fd59c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 -- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15ebb0 msgr2=0x7fd59c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15ebb0 0x7fd59c0ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 -- 172.21.15.139:0/1244489432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584009a70 con 0x7fd59c15ef90 2024-09-13T17:26:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd592000700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 0x7fd59c139aa0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd584014040 tx=0x7fd584004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58401b810 con 0x7fd59c15ef90 2024-09-13T17:26:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584020070 con 0x7fd59c15ef90 2024-09-13T17:26:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c0cc540 con 0x7fd59c15ef90 2024-09-13T17:26:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58401bbd0 con 0x7fd59c15ef90 2024-09-13T17:26:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c13b920 con 0x7fd59c15ef90 2024-09-13T17:26:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.845+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c0677e0 con 0x7fd59c15ef90 2024-09-13T17:26:22.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.849+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd58401bd30 con 0x7fd59c15ef90 2024-09-13T17:26:22.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.849+0000 7fd593e00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd578066850 0x7fd578068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.849+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fd584022070 con 0x7fd59c15ef90 2024-09-13T17:26:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.849+0000 7fd59aa00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd578066850 0x7fd578068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:22.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.853+0000 7fd59aa00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd578066850 0x7fd578068d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd58c000f60 tx=0x7fd58c009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:22.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:22.857+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd584053500 con 0x7fd59c15ef90 2024-09-13T17:26:23.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.037+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd59c0cc3d0 con 0x7fd578066850 2024-09-13T17:26:23.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd593e00700 1 -- 172.21.15.139:0/1244489432 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd59c0cc3d0 con 0x7fd578066850 2024-09-13T17:26:23.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd578066850 msgr2=0x7fd578068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd578066850 0x7fd578068d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd58c000f60 tx=0x7fd58c009040 comp rx=0 tx=0).stop 2024-09-13T17:26:23.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 msgr2=0x7fd59c139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 0x7fd59c139aa0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd584014040 tx=0x7fd584004af0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 shutdown_connections 2024-09-13T17:26:23.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fd578066850 0x7fd578068d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd59c15f5c0 0x7fd59c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c15ef90 0x7fd59c139aa0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 --2- 172.21.15.139:0/1244489432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd59c15ebb0 0x7fd59c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 >> 172.21.15.139:0/1244489432 conn(0x7fd59c071fa0 msgr2=0x7fd59c0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 shutdown_connections 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.041+0000 7fd59be00700 1 -- 172.21.15.139:0/1244489432 wait complete. 2024-09-13T17:26:23.049 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T17:26:23.071 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T17:26:23.071 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:23.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.325+0000 7fb518c00700 1 Processor -- start 2024-09-13T17:26:23.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.325+0000 7fb518c00700 1 -- start start 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb518c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5141598f0 0x7fb51406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb518c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5140b3120 0x7fb51406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb518c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb514157310 con 0x7fb514156f30 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb518c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5140ce720 con 0x7fb5140b3120 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb518c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb514159df0 con 0x7fb5141598f0 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5140b3120 0x7fb51406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5140b3120 0x7fb51406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33128/0 (socket says 172.21.15.139:33128) 2024-09-13T17:26:23.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 -- 172.21.15.139:0/366403028 learned_addr learned my addr 172.21.15.139:0/366403028 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:23.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb511400700 1 --2- 172.21.15.139:0/366403028 >> v2:172.21.15.176:3300/0 conn(0x7fb5141598f0 0x7fb51406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 -- 172.21.15.139:0/366403028 >> v2:172.21.15.176:3300/0 conn(0x7fb5141598f0 msgr2=0x7fb51406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:23.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 --2- 172.21.15.139:0/366403028 >> v2:172.21.15.176:3300/0 conn(0x7fb5141598f0 0x7fb51406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 -- 172.21.15.139:0/366403028 >> v1:172.21.15.139:6789/0 conn(0x7fb514156f30 legacy=0x7fb5140b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 -- 172.21.15.139:0/366403028 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51415a0d0 con 0x7fb5140b3120 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb510a00700 1 -- 172.21.15.139:0/366403028 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554924057 0 0) 0x7fb514157310 con 0x7fb514156f30 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb512800700 1 --2- 172.21.15.139:0/366403028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5140b3120 0x7fb51406d170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb5140b2030 tx=0x7fb50c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aff00ec4b3b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb510a00700 1 -- 172.21.15.139:0/366403028 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c00e070 con 0x7fb5140b3120 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb510a00700 1 -- 172.21.15.139:0/366403028 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c00b9c0 con 0x7fb5140b3120 2024-09-13T17:26:23.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.329+0000 7fb510a00700 1 -- 172.21.15.139:0/366403028 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c00bd70 con 0x7fb5140b3120 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 -- 172.21.15.139:0/366403028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5140b3120 msgr2=0x7fb51406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 --2- 172.21.15.139:0/366403028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5140b3120 0x7fb51406d170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb5140b2030 tx=0x7fb50c00b330 comp rx=0 tx=0).stop 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 -- 172.21.15.139:0/366403028 shutdown_connections 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 --2- 172.21.15.139:0/366403028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5140b3120 0x7fb51406d170 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 --2- 172.21.15.139:0/366403028 >> v2:172.21.15.176:3300/0 conn(0x7fb5141598f0 0x7fb51406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 -- 172.21.15.139:0/366403028 >> 172.21.15.139:0/366403028 conn(0x7fb5140cc7e0 msgr2=0x7fb51406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 -- 172.21.15.139:0/366403028 shutdown_connections 2024-09-13T17:26:23.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 -- 172.21.15.139:0/366403028 wait complete. 2024-09-13T17:26:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.333+0000 7fb518c00700 1 Processor -- start 2024-09-13T17:26:23.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 -- start start 2024-09-13T17:26:23.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5140b3120 0x7fb514157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb514156f30 0x7fb5141f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5141598f0 0x7fb51414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5141514b0 con 0x7fb5141598f0 2024-09-13T17:26:23.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514151770 con 0x7fb5140b3120 2024-09-13T17:26:23.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51414d370 con 0x7fb514156f30 2024-09-13T17:26:23.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5141598f0 0x7fb51414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5141598f0 0x7fb51414c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33144/0 (socket says 172.21.15.139:33144) 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 -- 172.21.15.139:0/2726381813 learned_addr learned my addr 172.21.15.139:0/2726381813 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb511400700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb514156f30 0x7fb5141f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb511e00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5140b3120 0x7fb514157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 -- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb514156f30 msgr2=0x7fb5141f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb514156f30 0x7fb5141f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 -- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5140b3120 msgr2=0x7fb514157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5140b3120 0x7fb514157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 -- 172.21.15.139:0/2726381813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c009b30 con 0x7fb5141598f0 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb511e00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5140b3120 0x7fb514157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:26:23.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb512800700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5141598f0 0x7fb51414c0c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb514067fc0 tx=0x7fb50c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0099b0 con 0x7fb5141598f0 2024-09-13T17:26:23.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c0092e0 con 0x7fb5141598f0 2024-09-13T17:26:23.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5141f2af0 con 0x7fb5141598f0 2024-09-13T17:26:23.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c01c660 con 0x7fb5141598f0 2024-09-13T17:26:23.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.337+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51414cdb0 con 0x7fb5141598f0 2024-09-13T17:26:23.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.341+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb514164fe0 con 0x7fb5141598f0 2024-09-13T17:26:23.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.341+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb50c01c7c0 con 0x7fb5141598f0 2024-09-13T17:26:23.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb50a000700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb4f4066850 0x7fb4f4068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fb50c086190 con 0x7fb5141598f0 2024-09-13T17:26:23.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb511e00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb4f4066850 0x7fb4f4068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb50a000700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7fb4f406d0f0 0x7fb4f406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 --> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4f406fc00 con 0x7fb4f406d0f0 2024-09-13T17:26:23.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb50c088770 con 0x7fb5141598f0 2024-09-13T17:26:23.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb511400700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7fb4f406d0f0 0x7fb4f406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb511e00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb4f4066850 0x7fb4f4068d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb504000f60 tx=0x7fb504009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.345+0000 7fb511400700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7fb4f406d0f0 0x7fb4f406f530 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.349+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== osd.6 v2:172.21.15.176:6824/1964477782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb4f406fc00 con 0x7fb4f406d0f0 2024-09-13T17:26:23.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 --> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb514071420 con 0x7fb4f406d0f0 2024-09-13T17:26:23.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb50a000700 1 -- 172.21.15.139:0/2726381813 <== osd.6 v2:172.21.15.176:6824/1964477782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb514071420 con 0x7fb4f406d0f0 2024-09-13T17:26:23.374 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:23.374 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:23.374 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:23.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7fb4f406d0f0 msgr2=0x7fb4f406f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.176:6824/1964477782,v1:172.21.15.176:6825/1964477782] conn(0x7fb4f406d0f0 0x7fb4f406f530 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb4f4066850 msgr2=0x7fb4f4068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb4f4066850 0x7fb4f4068d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb504000f60 tx=0x7fb504009040 comp rx=0 tx=0).stop 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5141598f0 msgr2=0x7fb51414c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 --2- 172.21.15.139:0/2726381813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5141598f0 0x7fb51414c0c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb514067fc0 tx=0x7fb50c004af0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb512800700 1 -- 172.21.15.139:0/2726381813 reap_dead start 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 shutdown_connections 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 >> 172.21.15.139:0/2726381813 conn(0x7fb5140cc7e0 msgr2=0x7fb51414e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 shutdown_connections 2024-09-13T17:26:23.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.369+0000 7fb518c00700 1 -- 172.21.15.139:0/2726381813 wait complete. 2024-09-13T17:26:23.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T17:26:23.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.573+0000 7f3c66400700 1 Processor -- start 2024-09-13T17:26:23.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.573+0000 7f3c66400700 1 -- start start 2024-09-13T17:26:23.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c66400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c60144300 0x7f3c6006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c66400700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c6015aff0 0x7f3c600cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c66400700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c60070140 con 0x7f3c6006db60 2024-09-13T17:26:23.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c66400700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c60070420 con 0x7f3c6015aff0 2024-09-13T17:26:23.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c66400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60070700 con 0x7f3c60144300 2024-09-13T17:26:23.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c65000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c60144300 0x7f3c6006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c6015aff0 0x7f3c600cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c6015aff0 0x7f3c600cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.139:47344/0 (socket says 172.21.15.139:47344) 2024-09-13T17:26:23.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 -- 172.21.15.139:0/1855513413 learned_addr learned my addr 172.21.15.139:0/1855513413 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:23.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 -- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c60144300 msgr2=0x7f3c6006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:23.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 --2- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c60144300 0x7f3c6006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 -- 172.21.15.139:0/1855513413 >> v1:172.21.15.176:6789/0 conn(0x7f3c6006db60 legacy=0x7f3c600b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:23.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 -- 172.21.15.139:0/1855513413 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c600709e0 con 0x7f3c6015aff0 2024-09-13T17:26:23.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c57e00700 1 --2- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6015aff0 0x7f3c600cd6c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009910 tx=0x7f3c48009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713d9907c11f10b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c5fe00700 1 -- 172.21.15.139:0/1855513413 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48004230 con 0x7f3c6015aff0 2024-09-13T17:26:23.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c5fe00700 1 -- 172.21.15.139:0/1855513413 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48004390 con 0x7f3c6015aff0 2024-09-13T17:26:23.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.577+0000 7f3c5fe00700 1 -- 172.21.15.139:0/1855513413 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480036c0 con 0x7f3c6015aff0 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 -- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6015aff0 msgr2=0x7f3c600cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 --2- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6015aff0 0x7f3c600cd6c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009910 tx=0x7f3c48009c20 comp rx=0 tx=0).stop 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 -- 172.21.15.139:0/1855513413 shutdown_connections 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 --2- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6015aff0 0x7f3c600cd6c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 --2- 172.21.15.139:0/1855513413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c60144300 0x7f3c6006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 -- 172.21.15.139:0/1855513413 >> 172.21.15.139:0/1855513413 conn(0x7f3c600ce9d0 msgr2=0x7f3c600cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 -- 172.21.15.139:0/1855513413 shutdown_connections 2024-09-13T17:26:23.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 -- 172.21.15.139:0/1855513413 wait complete. 2024-09-13T17:26:23.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 Processor -- start 2024-09-13T17:26:23.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.581+0000 7f3c66400700 1 -- start start 2024-09-13T17:26:23.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6006db60 0x7f3c6013b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 0x7f3c60155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c6015aff0 0x7f3c60157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6013ba30 con 0x7f3c60144300 2024-09-13T17:26:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60156860 con 0x7f3c6006db60 2024-09-13T17:26:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60156580 con 0x7f3c6015aff0 2024-09-13T17:26:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 0x7f3c60155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 0x7f3c60155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33152/0 (socket says 172.21.15.139:33152) 2024-09-13T17:26:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 -- 172.21.15.139:0/2003582750 learned_addr learned my addr 172.21.15.139:0/2003582750 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:23.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c65000700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6006db60 0x7f3c6013b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c65a00700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c6015aff0 0x7f3c60157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 -- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c6015aff0 msgr2=0x7f3c60157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c6015aff0 0x7f3c60157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 -- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6006db60 msgr2=0x7f3c6013b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6006db60 0x7f3c6013b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 -- 172.21.15.139:0/2003582750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009570 con 0x7f3c60144300 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c57e00700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 0x7f3c60155b00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3c600660e0 tx=0x7f3c48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48003ea0 con 0x7f3c60144300 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48011830 con 0x7f3c60144300 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c60153350 con 0x7f3c60144300 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011be0 con 0x7f3c60144300 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c60153910 con 0x7f3c60144300 2024-09-13T17:26:23.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.585+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c601531b0 con 0x7f3c60144300 2024-09-13T17:26:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.589+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f3c48011d40 con 0x7f3c60144300 2024-09-13T17:26:23.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.589+0000 7f3c5d600700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3c3c066880 0x7f3c3c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:23.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.589+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f3c48085910 con 0x7f3c60144300 2024-09-13T17:26:23.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.589+0000 7f3c65000700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3c3c066880 0x7f3c3c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:23.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.593+0000 7f3c65000700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3c3c066880 0x7f3c3c068d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c60153140 tx=0x7f3c50008040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:23.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.597+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c601531b0 con 0x7f3c60144300 2024-09-13T17:26:23.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.777+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c6006fe10 con 0x7f3c3c066880 2024-09-13T17:26:23.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.777+0000 7f3c5d600700 1 -- 172.21.15.139:0/2003582750 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c50004020 con 0x7f3c3c066880 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3c3c066880 msgr2=0x7f3c3c068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3c3c066880 0x7f3c3c068d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c60153140 tx=0x7f3c50008040 comp rx=0 tx=0).stop 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 msgr2=0x7f3c60155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 0x7f3c60155b00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3c600660e0 tx=0x7f3c48004770 comp rx=0 tx=0).stop 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 shutdown_connections 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f3c3c066880 0x7f3c3c068d40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c6015aff0 0x7f3c60157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c60144300 0x7f3c60155b00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 --2- 172.21.15.139:0/2003582750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c6006db60 0x7f3c6013b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 >> 172.21.15.139:0/2003582750 conn(0x7f3c600ce9d0 msgr2=0x7f3c600b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:23.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 shutdown_connections 2024-09-13T17:26:23.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.781+0000 7f3c66400700 1 -- 172.21.15.139:0/2003582750 wait complete. 2024-09-13T17:26:23.790 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T17:26:23.808 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T17:26:23.808 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:26:23.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.981+0000 7fad48e00700 1 Processor -- start 2024-09-13T17:26:24.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.981+0000 7fad48e00700 1 -- start start 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad48e00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fad44153dd0 0x7fad4406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad48e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fad4415db20 0x7fad440cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad48e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4406bd90 con 0x7fad4406d020 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad48e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440cd750 con 0x7fad4415db20 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad48e00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440cd9f0 con 0x7fad44153dd0 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad42a00700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fad4406d020 0x7fad4415d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55202/0 (socket says 172.21.15.139:55202) 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad42a00700 1 -- 172.21.15.139:0/2954842184 learned_addr learned my addr 172.21.15.139:0/2954842184 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad43e00700 1 --2- 172.21.15.139:0/2954842184 >> v2:172.21.15.139:3300/0 conn(0x7fad4415db20 0x7fad440cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad43400700 1 --2- 172.21.15.139:0/2954842184 >> v2:172.21.15.176:3300/0 conn(0x7fad44153dd0 0x7fad4406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad42000700 1 -- 172.21.15.139:0/2954842184 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141791864 0 0) 0x7fad4406bd90 con 0x7fad4406d020 2024-09-13T17:26:24.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad42000700 1 -- 172.21.15.139:0/2954842184 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad280057e0 con 0x7fad4406d020 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad43400700 1 -- 172.21.15.139:0/2954842184 >> v2:172.21.15.139:3300/0 conn(0x7fad4415db20 msgr2=0x7fad440cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad43400700 1 --2- 172.21.15.139:0/2954842184 >> v2:172.21.15.139:3300/0 conn(0x7fad4415db20 0x7fad440cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad43400700 1 -- 172.21.15.139:0/2954842184 >> v1:172.21.15.139:6789/0 conn(0x7fad4406d020 legacy=0x7fad4415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.985+0000 7fad43400700 1 -- 172.21.15.139:0/2954842184 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4406b4f0 con 0x7fad44153dd0 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad43400700 1 --2- 172.21.15.139:0/2954842184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad44153dd0 0x7fad4406ae80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad44072830 tx=0x7fad34009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3a0e91a43ceb69b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad42000700 1 -- 172.21.15.139:0/2954842184 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34011830 con 0x7fad44153dd0 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad42000700 1 -- 172.21.15.139:0/2954842184 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad34011990 con 0x7fad44153dd0 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad42000700 1 -- 172.21.15.139:0/2954842184 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34011d20 con 0x7fad44153dd0 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 -- 172.21.15.139:0/2954842184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad44153dd0 msgr2=0x7fad4406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 --2- 172.21.15.139:0/2954842184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad44153dd0 0x7fad4406ae80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad44072830 tx=0x7fad34009b30 comp rx=0 tx=0).stop 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 -- 172.21.15.139:0/2954842184 shutdown_connections 2024-09-13T17:26:24.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 --2- 172.21.15.139:0/2954842184 >> v2:172.21.15.139:3300/0 conn(0x7fad4415db20 0x7fad440cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 --2- 172.21.15.139:0/2954842184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad44153dd0 0x7fad4406ae80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 -- 172.21.15.139:0/2954842184 >> 172.21.15.139:0/2954842184 conn(0x7fad4406e250 msgr2=0x7fad4406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 -- 172.21.15.139:0/2954842184 shutdown_connections 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.989+0000 7fad48e00700 1 -- 172.21.15.139:0/2954842184 wait complete. 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 Processor -- start 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 -- start start 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4406d020 0x7fad44156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad44153dd0 0x7fad4415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad4415db20 0x7fad4415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4414caa0 con 0x7fad4406d020 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44155e60 con 0x7fad4415db20 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad44156140 con 0x7fad44153dd0 2024-09-13T17:26:24.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4406d020 0x7fad44156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad4415db20 0x7fad4415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4406d020 0x7fad44156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33168/0 (socket says 172.21.15.139:33168) 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 -- 172.21.15.139:0/3075095819 learned_addr learned my addr 172.21.15.139:0/3075095819 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad42a00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad44153dd0 0x7fad4415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 -- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad44153dd0 msgr2=0x7fad4415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad44153dd0 0x7fad4415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 -- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad4415db20 msgr2=0x7fad4415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad4415db20 0x7fad4415bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 -- 172.21.15.139:0/3075095819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340094b0 con 0x7fad4406d020 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad43400700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4406d020 0x7fad44156c20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fad34009b70 tx=0x7fad34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34004380 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3401f070 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad44156420 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340036c0 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.993+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad44157160 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.997+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad44155fd0 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:23.997+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fad34021030 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad3b400700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fad24066850 0x7fad24068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fad34085670 con 0x7fad4406d020 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad42a00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fad24066850 0x7fad24068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad3b400700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fad2406d0f0 0x7fad2406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 --> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad2406fc00 con 0x7fad2406d0f0 2024-09-13T17:26:24.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad34087c50 con 0x7fad4406d020 2024-09-13T17:26:24.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad43e00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fad2406d0f0 0x7fad2406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad42a00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fad24066850 0x7fad24068d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad440b3900 tx=0x7fad30007de0 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.001+0000 7fad43e00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fad2406d0f0 0x7fad2406f530 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.005+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== osd.7 v2:172.21.15.176:6816/3835533036 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fad2406fc00 con 0x7fad2406d0f0 2024-09-13T17:26:24.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.021+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 --> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad4406bab0 con 0x7fad2406d0f0 2024-09-13T17:26:24.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad3b400700 1 -- 172.21.15.139:0/3075095819 <== osd.7 v2:172.21.15.176:6816/3835533036 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fad3c00f040 con 0x7fad2406d0f0 2024-09-13T17:26:24.187 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T17:26:24.187 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:26:24.187 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fad2406d0f0 msgr2=0x7fad2406f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.176:6816/3835533036,v1:172.21.15.176:6817/3835533036] conn(0x7fad2406d0f0 0x7fad2406f530 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fad24066850 msgr2=0x7fad24068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fad24066850 0x7fad24068d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad440b3900 tx=0x7fad30007de0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4406d020 msgr2=0x7fad44156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 --2- 172.21.15.139:0/3075095819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4406d020 0x7fad44156c20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fad34009b70 tx=0x7fad34004770 comp rx=0 tx=0).stop 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad43e00700 1 -- 172.21.15.139:0/3075095819 reap_dead start 2024-09-13T17:26:24.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 shutdown_connections 2024-09-13T17:26:24.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 >> 172.21.15.139:0/3075095819 conn(0x7fad4406e250 msgr2=0x7fad440cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 shutdown_connections 2024-09-13T17:26:24.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.025+0000 7fad48e00700 1 -- 172.21.15.139:0/3075095819 wait complete. 2024-09-13T17:26:24.190 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T17:26:24.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.365+0000 7f4386c00700 1 Processor -- start 2024-09-13T17:26:24.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.365+0000 7f4386c00700 1 -- start start 2024-09-13T17:26:24.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4386c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f438006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4386c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f438015aff0 0x7f43800cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4386c00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380070140 con 0x7f438006db60 2024-09-13T17:26:24.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4386c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4380070420 con 0x7f438015aff0 2024-09-13T17:26:24.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4386c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4380070700 con 0x7f4380144300 2024-09-13T17:26:24.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f438015aff0 0x7f43800cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f438015aff0 0x7f43800cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33180/0 (socket says 172.21.15.139:33180) 2024-09-13T17:26:24.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 -- 172.21.15.139:0/4110055226 learned_addr learned my addr 172.21.15.139:0/4110055226 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:24.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4385800700 1 --2- 172.21.15.139:0/4110055226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f438006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 -- 172.21.15.139:0/4110055226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 msgr2=0x7f438006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:24.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 --2- 172.21.15.139:0/4110055226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f438006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f437fe00700 1 -- 172.21.15.139:0/4110055226 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560570652 0 0) 0x7f4380070140 con 0x7f438006db60 2024-09-13T17:26:24.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 -- 172.21.15.139:0/4110055226 >> v1:172.21.15.139:6789/0 conn(0x7f438006db60 legacy=0x7f43800b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 -- 172.21.15.139:0/4110055226 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800709e0 con 0x7f438015aff0 2024-09-13T17:26:24.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f4384e00700 1 --2- 172.21.15.139:0/4110055226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43800cd6c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f436c009910 tx=0x7f436c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5ae0615f18866f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f437fe00700 1 -- 172.21.15.139:0/4110055226 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c011830 con 0x7f438015aff0 2024-09-13T17:26:24.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f437fe00700 1 -- 172.21.15.139:0/4110055226 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c011990 con 0x7f438015aff0 2024-09-13T17:26:24.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.369+0000 7f437fe00700 1 -- 172.21.15.139:0/4110055226 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c011d40 con 0x7f438015aff0 2024-09-13T17:26:24.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 -- 172.21.15.139:0/4110055226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 msgr2=0x7f43800cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 --2- 172.21.15.139:0/4110055226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43800cd6c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f436c009910 tx=0x7f436c009c20 comp rx=0 tx=0).stop 2024-09-13T17:26:24.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 -- 172.21.15.139:0/4110055226 shutdown_connections 2024-09-13T17:26:24.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 --2- 172.21.15.139:0/4110055226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43800cd6c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 --2- 172.21.15.139:0/4110055226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f438006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 -- 172.21.15.139:0/4110055226 >> 172.21.15.139:0/4110055226 conn(0x7f43800ce9d0 msgr2=0x7f43800cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 -- 172.21.15.139:0/4110055226 shutdown_connections 2024-09-13T17:26:24.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.373+0000 7f4386c00700 1 -- 172.21.15.139:0/4110055226 wait complete. 2024-09-13T17:26:24.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 Processor -- start 2024-09-13T17:26:24.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 -- start start 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f438006db60 0x7f438015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f43801f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43801f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43801f6c70 con 0x7f438015aff0 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015a5a0 con 0x7f438006db60 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43801e1500 con 0x7f4380144300 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43801f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43801f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33184/0 (socket says 172.21.15.139:33184) 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 -- 172.21.15.139:0/30696441 learned_addr learned my addr 172.21.15.139:0/30696441 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:24.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4385800700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f438006db60 0x7f438015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4384e00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f43801f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 -- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 msgr2=0x7f43801f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f43801f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 -- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f438006db60 msgr2=0x7f438015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f438006db60 0x7f438015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 -- 172.21.15.139:0/30696441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c009570 con 0x7f438015aff0 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.377+0000 7f4386200700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43801f6380 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f437800c4a0 tx=0x7f437800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780054e0 con 0x7f438015aff0 2024-09-13T17:26:24.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43801e17e0 con 0x7f438015aff0 2024-09-13T17:26:24.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780036a0 con 0x7f438015aff0 2024-09-13T17:26:24.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378003a50 con 0x7f438015aff0 2024-09-13T17:26:24.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438013caf0 con 0x7f438015aff0 2024-09-13T17:26:24.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438006d620 con 0x7f438015aff0 2024-09-13T17:26:24.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.381+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f4378003bb0 con 0x7f438015aff0 2024-09-13T17:26:24.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.385+0000 7f437d600700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4360066850 0x7f4360068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.385+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f4378083890 con 0x7f438015aff0 2024-09-13T17:26:24.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.385+0000 7f4385800700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4360066850 0x7f4360068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.385+0000 7f4385800700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4360066850 0x7f4360068d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f43740113e0 tx=0x7f437400b040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.393+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4378050900 con 0x7f438015aff0 2024-09-13T17:26:24.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.573+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f438006fe10 con 0x7f4360066850 2024-09-13T17:26:24.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.573+0000 7f437d600700 1 -- 172.21.15.139:0/30696441 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f437400f040 con 0x7f4360066850 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4360066850 msgr2=0x7f4360068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4360066850 0x7f4360068d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f43740113e0 tx=0x7f437400b040 comp rx=0 tx=0).stop 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 msgr2=0x7f43801f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43801f6380 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f437800c4a0 tx=0x7f437800c7b0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 shutdown_connections 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f4360066850 0x7f4360068d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f438015aff0 0x7f43801f6380 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380144300 0x7f43801f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 --2- 172.21.15.139:0/30696441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f438006db60 0x7f438015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 >> 172.21.15.139:0/30696441 conn(0x7f43800ce9d0 msgr2=0x7f43800b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 shutdown_connections 2024-09-13T17:26:24.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.581+0000 7f4386c00700 1 -- 172.21.15.139:0/30696441 wait complete. 2024-09-13T17:26:24.588 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T17:26:24.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.773+0000 7fa073e00700 1 Processor -- start 2024-09-13T17:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.773+0000 7fa073e00700 1 -- start start 2024-09-13T17:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.773+0000 7fa073e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa07406fe10 0x7fa0740ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.773+0000 7fa073e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740cd160 con 0x7fa0740b2b70 2024-09-13T17:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.773+0000 7fa073e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740aceb0 con 0x7fa07415cc00 2024-09-13T17:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.773+0000 7fa073e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740ad190 con 0x7fa07406fe10 2024-09-13T17:26:24.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa06a000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa07406fe10 0x7fa0740ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa0740b2b70 0x7fa07415cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43664/0 (socket says 172.21.15.139:43664) 2024-09-13T17:26:24.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073400700 1 -- 172.21.15.139:0/3915351934 learned_addr learned my addr 172.21.15.139:0/3915351934 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:24.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa06a000700 1 -- 172.21.15.139:0/3915351934 >> v1:172.21.15.176:6789/0 conn(0x7fa07415cc00 legacy=0x7fa0740adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa06a000700 1 -- 172.21.15.139:0/3915351934 >> v1:172.21.15.139:6789/0 conn(0x7fa0740b2b70 legacy=0x7fa07415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa06a000700 1 -- 172.21.15.139:0/3915351934 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740ad470 con 0x7fa07406fe10 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa072000700 1 -- 172.21.15.139:0/3915351934 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221105486 0 0) 0x7fa0740aceb0 con 0x7fa07415cc00 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa06a000700 1 --2- 172.21.15.139:0/3915351934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa07406fe10 0x7fa0740ac890 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009850 tx=0x7fa05c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec27b06a92ce8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa072000700 1 -- 172.21.15.139:0/3915351934 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c004230 con 0x7fa07406fe10 2024-09-13T17:26:24.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa072000700 1 -- 172.21.15.139:0/3915351934 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c004390 con 0x7fa07406fe10 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa072000700 1 -- 172.21.15.139:0/3915351934 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0036c0 con 0x7fa07406fe10 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 -- 172.21.15.139:0/3915351934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa07406fe10 msgr2=0x7fa0740ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 --2- 172.21.15.139:0/3915351934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa07406fe10 0x7fa0740ac890 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009850 tx=0x7fa05c009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:24.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 -- 172.21.15.139:0/3915351934 shutdown_connections 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 --2- 172.21.15.139:0/3915351934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa07406fe10 0x7fa0740ac890 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 -- 172.21.15.139:0/3915351934 >> 172.21.15.139:0/3915351934 conn(0x7fa0740ce9d0 msgr2=0x7fa0740cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 -- 172.21.15.139:0/3915351934 shutdown_connections 2024-09-13T17:26:24.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.777+0000 7fa073e00700 1 -- 172.21.15.139:0/3915351934 wait complete. 2024-09-13T17:26:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.781+0000 7fa073e00700 1 Processor -- start 2024-09-13T17:26:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.781+0000 7fa073e00700 1 -- start start 2024-09-13T17:26:24.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa07406fe10 0x7fa0741568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 0x7fa07406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa07415cc00 0x7fa07415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07406e1d0 con 0x7fa0740b2b70 2024-09-13T17:26:24.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0741f6110 con 0x7fa07406fe10 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa074156ed0 con 0x7fa07415cc00 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 0x7fa07406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 0x7fa07406dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55358/0 (socket says 172.21.15.139:55358) 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 -- 172.21.15.139:0/3236969359 learned_addr learned my addr 172.21.15.139:0/3236969359 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa072a00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa07406fe10 0x7fa0741568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073400700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa07415cc00 0x7fa07415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 -- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa07415cc00 msgr2=0x7fa07415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa07415cc00 0x7fa07415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 -- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa07406fe10 msgr2=0x7fa0741568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa07406fe10 0x7fa0741568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 -- 172.21.15.139:0/3236969359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0094b0 con 0x7fa0740b2b70 2024-09-13T17:26:24.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06a000700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 0x7fa07406dc90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0090b0 tx=0x7fa05c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c004500 con 0x7fa0740b2b70 2024-09-13T17:26:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c011630 con 0x7fa0740b2b70 2024-09-13T17:26:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0119e0 con 0x7fa0740b2b70 2024-09-13T17:26:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0741f6360 con 0x7fa0740b2b70 2024-09-13T17:26:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.785+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0741f6920 con 0x7fa0740b2b70 2024-09-13T17:26:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.789+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0740ac890 con 0x7fa0740b2b70 2024-09-13T17:26:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.789+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fa05c011b40 con 0x7fa0740b2b70 2024-09-13T17:26:24.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.789+0000 7fa06b400700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fa050066850 0x7fa050068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:24.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.789+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fa05c085370 con 0x7fa0740b2b70 2024-09-13T17:26:24.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.789+0000 7fa072a00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fa050066850 0x7fa050068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:24.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.793+0000 7fa072a00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fa050066850 0x7fa050068d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0640012e0 tx=0x7fa064009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:24.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.797+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa05c052590 con 0x7fa0740b2b70 2024-09-13T17:26:24.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.989+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa074071050 con 0x7fa050066850 2024-09-13T17:26:25.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.993+0000 7fa06b400700 1 -- 172.21.15.139:0/3236969359 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48011 (secure 0 0 0) 0x7fa074071050 con 0x7fa050066850 2024-09-13T17:26:25.001 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:25.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fa050066850 msgr2=0x7fa050068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fa050066850 0x7fa050068d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0640012e0 tx=0x7fa064009040 comp rx=0 tx=0).stop 2024-09-13T17:26:25.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 msgr2=0x7fa07406dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:25.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 0x7fa07406dc90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0090b0 tx=0x7fa05c004770 comp rx=0 tx=0).stop 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 shutdown_connections 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fa050066850 0x7fa050068d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa07415cc00 0x7fa07415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0740b2b70 0x7fa07406dc90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 --2- 172.21.15.139:0/3236969359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa07406fe10 0x7fa0741568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 >> 172.21.15.139:0/3236969359 conn(0x7fa0740ce9d0 msgr2=0x7fa074071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 shutdown_connections 2024-09-13T17:26:25.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:24.997+0000 7fa073e00700 1 -- 172.21.15.139:0/3236969359 wait complete. 2024-09-13T17:26:25.006 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:26:25.025 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-13T17:26:24.880762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":225584,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749136,"statfs":{"total":773094113280,"available":772863115264,"internally_reserved":0,"allocated":5447680,"data_stored":3047360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":206,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003511"},"pg_stats":[{"pgid":"1.0","version":"43'139","reported_seq":263,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T17:26:12.883407+0000","last_change":"2024-09-13T17:24:08.174439+0000","last_active":"2024-09-13T17:26:12.883407+0000","last_peered":"2024-09-13T17:26:12.883407+0000","last_clean":"2024-09-13T17:26:12.883407+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:26:12.883407+0000","last_undegraded":"2024-09-13T17:26:12.883407+0000","last_fullsized":"2024-09-13T17:26:12.883407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:24:06.429410+0000","last_clean_scrub_stamp":"2024-09-13T17:24:06.429410+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:16.698536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":823696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.1220000000000001,"15min":1.1599999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.429,"5min":1.522,"15min":1.522},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5029999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.21,"15min":1.23},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.631,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5469999999999999,"5min":1.673,"15min":1.673},"last":1.129},{"interface":"front","average":{"1min":1.125,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3660000000000001,"5min":1.623,"15min":1.623},"last":1.2529999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5680000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.298,"15min":1.319},"min":{"1min":0.83899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.046}]},{"osd":4,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.218,"15min":1.224},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6970000000000001,"5min":1.966,"15min":1.966},"last":1.085},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3,"15min":1.3200000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.631,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.3260000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.5740000000000001,"5min":1.881,"15min":1.881},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.4490000000000001,"15min":1.4830000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4730000000000001,"5min":2.069,"15min":2.069},"last":1.393}]},{"osd":6,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.454,"15min":1.486},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5980000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.347},{"interface":"front","average":{"1min":1.288,"5min":1.4330000000000001,"15min":1.4570000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.7110000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.462}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2470000000000001,"15min":1.26},"min":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7689999999999999,"5min":2.399,"15min":2.399},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.1830000000000001,"15min":1.1870000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.49,"5min":2.476,"15min":2.476},"last":1.143}]},{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2649999999999999},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8420000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.097},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.298,"15min":1.3},"min":{"1min":0.84299999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5509999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.222}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.125,"15min":1.137},"min":{"1min":0.76100000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4359999999999999,"5min":1.593,"15min":1.593},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2250000000000001,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.462,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.4259999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.25,"15min":1.27},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.5920000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.3919999999999999,"15min":1.4419999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3360000000000001,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.25}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.81399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8879999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4370000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.7310000000000001,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.4039999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.304,"15min":1.321},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5389999999999999,"5min":1.883,"15min":1.883},"last":1.022},{"interface":"front","average":{"1min":1.341,"5min":1.401,"15min":1.411},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8660000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.395,"15min":1.401},"min":{"1min":0.92600000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.659,"5min":2.863,"15min":2.863},"last":1.466},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.784,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.329}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2090000000000001,"15min":1.2390000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.464,"5min":1.855,"15min":1.855},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4330000000000001,"5min":2.218,"15min":2.218},"last":1.4319999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.169,"15min":1.1870000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4019999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.2250000000000001,"15min":1.252},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4079999999999999,"5min":1.718,"15min":1.718},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.51,"5min":1.929,"15min":1.929},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.2010000000000001,"15min":1.2190000000000001},"min":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5569999999999999,"5min":1.593,"15min":1.593},"last":1.375}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.292},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4219999999999999,"5min":1.78,"15min":1.78},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.298,"15min":1.3340000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.542,"5min":1.786,"15min":1.786},"last":1.306}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2589999999999999,"15min":1.274},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4930000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.069},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5169999999999999,"5min":2.625,"15min":2.625},"last":1.1879999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.3400000000000001,"15min":1.369},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4930000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.508},{"interface":"front","average":{"1min":1.244,"5min":1.3819999999999999,"15min":1.405},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.573,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.1539999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.528,"15min":1.5640000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5129999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.599,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.6040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.083,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.145,"15min":1.159},"min":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2709999999999999,"15min":1.302},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.071},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1679999999999999,"15min":1.175},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5369999999999999,"5min":1.825,"15min":1.825},"last":1.2929999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2789999999999999,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5900000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.2549999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3979999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.266,"15min":1.282},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7130000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.254},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.446,"15min":1.464},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.5940000000000001,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.4910000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.363,"15min":1.377},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.748,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3600000000000001,"15min":1.3799999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.778,"5min":2.274,"15min":2.274},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4419999999999999,"15min":1.454},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9690000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4350000000000001,"15min":1.4590000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9199999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.123},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5009999999999999,"15min":1.5149999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7849999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.208}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":1.02,"15min":1.056},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2729999999999999,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.468,"15min":1.468},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90500000000000003,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1930000000000001,"5min":1.554,"15min":1.554},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.222,"15min":1.252},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5680000000000001,"5min":1.708,"15min":1.708},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.246,"15min":1.2669999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5580000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.151}]},{"osd":5,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.4379999999999999,"15min":1.476},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.7390000000000001,"5min":2.972,"15min":2.972},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.383,"15min":1.4159999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6659999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.278,"15min":1.304},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.4950000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.454,"15min":1.4930000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.3819999999999999,"15min":1.4199999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4910000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.341,"15min":1.3660000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6850000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1120000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31640,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93000000000000005,"15min":0.93799999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.27,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.85599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4610000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.331,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.512,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5740000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.133}]},{"osd":4,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.337,"15min":1.359},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4550000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5069999999999999,"5min":3.077,"15min":3.077},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.389,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.673,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.179},{"interface":"front","average":{"1min":1.367,"5min":1.4630000000000001,"15min":1.4790000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6000000000000001,"5min":2.387,"15min":2.387},"last":1.264}]},{"osd":6,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.504,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.204},{"interface":"front","average":{"1min":1.252,"5min":1.371,"15min":1.391},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5840000000000001,"5min":2.298,"15min":2.298},"last":1.1200000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.425,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.331},{"interface":"front","average":{"1min":1.373,"5min":1.502,"15min":1.524},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.7170000000000001,"5min":2.254,"15min":2.254},"last":1.222}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1859999999999999,"5min":1.345,"15min":1.345},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3160000000000001,"5min":1.474,"15min":1.474},"last":0.91100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.153,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.026,"15min":1.0409999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.377,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.70399999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.405,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0620000000000001,"15min":1.0800000000000001},"min":{"1min":0.58799999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.395,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.135}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.373,"15min":1.403},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.5069999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.306},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.3160000000000001,"15min":1.343},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5980000000000001,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.26}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.522,"5min":2.04,"15min":2.04},"last":1.161},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.506,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.2769999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.5580000000000001,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.375,"15min":1.4059999999999999},"min":{"1min":0.93500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5780000000000001,"5min":3.452,"15min":3.452},"last":1.345}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.458,"15min":1.486},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.7310000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.389},{"interface":"front","average":{"1min":1.202,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.90000000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8620000000000001,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.2150000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":823696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0740000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.623},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1220000000000001,"5min":1.53,"15min":1.53},"last":0.59699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.748},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1639999999999999,"15min":1.181},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.876}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2450000000000001,"15min":1.2529999999999999},"min":{"1min":0.92300000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.702,"15min":1.702},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2,"15min":1.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4590000000000001,"5min":1.946,"15min":1.946},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.341,"15min":1.351},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7230000000000001,"5min":2.093,"15min":2.093},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.302,"5min":1.403,"15min":1.4199999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.776,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.96599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.395},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.75,"5min":1.857,"15min":1.857},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.679,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.94899999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.83199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.514,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8380000000000001,"5min":2.177,"15min":2.177},"last":1.0449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:25.029 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T17:24:06.429410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=24, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=26, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:26:25.029 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:26:42.636 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:42.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:26:45.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:26:45.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.197+0000 7fcb07200700 1 Processor -- start 2024-09-13T17:26:45.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb07200700 1 -- start start 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb07200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb080ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb07200700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080cd160 con 0x7fcb080b2b70 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb07200700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080aceb0 con 0x7fcb0806fe10 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb07200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080ad190 con 0x7fcb0815cc00 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb06800700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcb080b2b70 0x7fcb0815cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44788/0 (socket says 172.21.15.139:44788) 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb06800700 1 -- 172.21.15.139:0/1621041920 learned_addr learned my addr 172.21.15.139:0/1621041920 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:45.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb05e00700 1 --2- 172.21.15.139:0/1621041920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb080ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb04a00700 1 -- 172.21.15.139:0/1621041920 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300904404 0 0) 0x7fcb080cd160 con 0x7fcb080b2b70 2024-09-13T17:26:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb04a00700 1 -- 172.21.15.139:0/1621041920 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaec0035d0 con 0x7fcb080b2b70 2024-09-13T17:26:45.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb05e00700 1 -- 172.21.15.139:0/1621041920 >> v1:172.21.15.176:6789/0 conn(0x7fcb0806fe10 legacy=0x7fcb080adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb04a00700 1 -- 172.21.15.139:0/1621041920 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820224084 0 0) 0x7fcb080aceb0 con 0x7fcb0806fe10 2024-09-13T17:26:45.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb05e00700 1 -- 172.21.15.139:0/1621041920 >> v1:172.21.15.139:6789/0 conn(0x7fcb080b2b70 legacy=0x7fcb0815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.201+0000 7fcb05e00700 1 -- 172.21.15.139:0/1621041920 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080ad470 con 0x7fcb0815cc00 2024-09-13T17:26:45.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb05e00700 1 --2- 172.21.15.139:0/1621041920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb080ac890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009880 tx=0x7fcaf8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=809bda056d9fe3e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:45.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb04a00700 1 -- 172.21.15.139:0/1621041920 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8011830 con 0x7fcb0815cc00 2024-09-13T17:26:45.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb04a00700 1 -- 172.21.15.139:0/1621041920 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8011990 con 0x7fcb0815cc00 2024-09-13T17:26:45.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb04a00700 1 -- 172.21.15.139:0/1621041920 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8011d00 con 0x7fcb0815cc00 2024-09-13T17:26:45.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 -- 172.21.15.139:0/1621041920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 msgr2=0x7fcb080ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 --2- 172.21.15.139:0/1621041920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb080ac890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009880 tx=0x7fcaf8009b90 comp rx=0 tx=0).stop 2024-09-13T17:26:45.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 -- 172.21.15.139:0/1621041920 shutdown_connections 2024-09-13T17:26:45.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 --2- 172.21.15.139:0/1621041920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb080ac890 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 -- 172.21.15.139:0/1621041920 >> 172.21.15.139:0/1621041920 conn(0x7fcb080ce9d0 msgr2=0x7fcb080cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:45.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 -- 172.21.15.139:0/1621041920 shutdown_connections 2024-09-13T17:26:45.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.205+0000 7fcb07200700 1 -- 172.21.15.139:0/1621041920 wait complete. 2024-09-13T17:26:45.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.209+0000 7fcb07200700 1 Processor -- start 2024-09-13T17:26:45.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.209+0000 7fcb07200700 1 -- start start 2024-09-13T17:26:45.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 0x7fcb081f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb080b2b70 0x7fcb08145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb0815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08156dc0 con 0x7fcb0806fe10 2024-09-13T17:26:45.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08156240 con 0x7fcb080b2b70 2024-09-13T17:26:45.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08156520 con 0x7fcb0815cc00 2024-09-13T17:26:45.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 0x7fcb081f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 0x7fcb081f1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55972/0 (socket says 172.21.15.139:55972) 2024-09-13T17:26:45.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 -- 172.21.15.139:0/4265845941 learned_addr learned my addr 172.21.15.139:0/4265845941 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:45.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05400700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb080b2b70 0x7fcb08145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb06800700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb0815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 -- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 msgr2=0x7fcb0815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb0815f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 -- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb080b2b70 msgr2=0x7fcb08145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb080b2b70 0x7fcb08145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 -- 172.21.15.139:0/4265845941 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80094b0 con 0x7fcb0806fe10 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb05e00700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 0x7fcb081f1b70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8013040 tx=0x7fcaf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8004610 con 0x7fcb0806fe10 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf80036c0 con 0x7fcb0806fe10 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8003a90 con 0x7fcb0806fe10 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb08156800 con 0x7fcb0806fe10 2024-09-13T17:26:45.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.213+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb081f20b0 con 0x7fcb0806fe10 2024-09-13T17:26:45.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.217+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb081f2240 con 0x7fcb0806fe10 2024-09-13T17:26:45.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.217+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fcaf8003bf0 con 0x7fcb0806fe10 2024-09-13T17:26:45.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.221+0000 7fcafe000700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fcae8066850 0x7fcae8068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.221+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fcaf8085b00 con 0x7fcb0806fe10 2024-09-13T17:26:45.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.221+0000 7fcb05400700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fcae8066850 0x7fcae8068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.221+0000 7fcb05400700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fcae8066850 0x7fcae8068d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb081f58a0 tx=0x7fcaf4009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:45.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.229+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcaf8052da0 con 0x7fcb0806fe10 2024-09-13T17:26:45.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.413+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 --> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb080ccb10 con 0x7fcae8066850 2024-09-13T17:26:45.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.421+0000 7fcafe000700 1 -- 172.21.15.139:0/4265845941 <== mgr.5613 v2:172.21.15.139:6832/650854402 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47994 (secure 0 0 0) 0x7fcb080ccb10 con 0x7fcae8066850 2024-09-13T17:26:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.421+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fcae8066850 msgr2=0x7fcae8068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.421+0000 7fcb07200700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fcae8066850 0x7fcae8068d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb081f58a0 tx=0x7fcaf4009040 comp rx=0 tx=0).stop 2024-09-13T17:26:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.421+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 msgr2=0x7fcb081f1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.421+0000 7fcb07200700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 0x7fcb081f1b70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8013040 tx=0x7fcaf8004770 comp rx=0 tx=0).stop 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 shutdown_connections 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fcae8066850 0x7fcae8068d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0815cc00 0x7fcb0815f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb080b2b70 0x7fcb08145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 --2- 172.21.15.139:0/4265845941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb0806fe10 0x7fcb081f1b70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 >> 172.21.15.139:0/4265845941 conn(0x7fcb080ce9d0 msgr2=0x7fcb08070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 shutdown_connections 2024-09-13T17:26:45.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.425+0000 7fcb07200700 1 -- 172.21.15.139:0/4265845941 wait complete. 2024-09-13T17:26:45.432 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-13T17:26:45.455 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T17:26:44.886574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":225576,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754749144,"statfs":{"total":773094113280,"available":772863123456,"internally_reserved":0,"allocated":5447680,"data_stored":3047360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225431096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003502"},"pg_stats":[{"pgid":"1.0","version":"45'140","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T17:26:28.399444+0000","last_change":"2024-09-13T17:26:28.399600+0000","last_active":"2024-09-13T17:26:28.399444+0000","last_peered":"2024-09-13T17:26:28.399444+0000","last_clean":"2024-09-13T17:26:28.399444+0000","last_became_active":"2024-09-13T17:24:08.172293+0000","last_became_peered":"2024-09-13T17:24:08.172293+0000","last_unstale":"2024-09-13T17:26:28.399444+0000","last_undegraded":"2024-09-13T17:26:28.399444+0000","last_fullsized":"2024-09-13T17:26:28.399444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'140","last_scrub_stamp":"2024-09-13T17:26:28.399419+0000","last_deep_scrub":"45'140","last_deep_scrub_stamp":"2024-09-13T17:26:28.399419+0000","last_clean_scrub_stamp":"2024-09-13T17:26:28.399419+0000","objects_scrubbed":2,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:31.672159+0000","scrub_duration":0.010158423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1126400,"data_stored":823696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.1220000000000001,"15min":1.1599999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.429,"5min":1.522,"15min":1.522},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.1870000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.1850000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5029999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.21,"15min":1.23},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.631,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1439999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.169,"15min":1.177},"min":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5469999999999999,"5min":1.673,"15min":1.673},"last":1.264},{"interface":"front","average":{"1min":1.125,"5min":1.2130000000000001,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3660000000000001,"5min":1.623,"15min":1.623},"last":1.3879999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5680000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.306},{"interface":"front","average":{"1min":1.173,"5min":1.298,"15min":1.319},"min":{"1min":0.83899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.639,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3440000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.218,"15min":1.224},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6970000000000001,"5min":1.966,"15min":1.966},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3,"15min":1.3200000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.631,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.5740000000000001,"5min":1.881,"15min":1.881},"last":1.486},{"interface":"front","average":{"1min":1.242,"5min":1.4490000000000001,"15min":1.4830000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4730000000000001,"5min":2.069,"15min":2.069},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:26:06 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.454,"15min":1.486},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5980000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4330000000000001,"15min":1.4570000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.7110000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.444}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2470000000000001,"15min":1.26},"min":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7689999999999999,"5min":2.399,"15min":2.399},"last":1.268},{"interface":"front","average":{"1min":1.155,"5min":1.1830000000000001,"15min":1.1870000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.49,"5min":2.476,"15min":2.476},"last":1.218}]},{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2609999999999999,"15min":1.2649999999999999},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8420000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.298,"15min":1.3},"min":{"1min":0.84299999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5509999999999999,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.125,"15min":1.137},"min":{"1min":0.76100000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4359999999999999,"5min":1.593,"15min":1.593},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2250000000000001,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.462,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.99299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.25,"15min":1.27},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.5920000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.3919999999999999,"15min":1.4419999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3360000000000001,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.1080000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.81399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8879999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.343},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4370000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.7310000000000001,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.304,"15min":1.321},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5389999999999999,"5min":1.883,"15min":1.883},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.341,"5min":1.401,"15min":1.411},"min":{"1min":0.99299999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8660000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.119}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.395,"15min":1.401},"min":{"1min":0.92600000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.659,"5min":2.863,"15min":2.863},"last":0.873},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.784,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.038}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2090000000000001,"15min":1.2390000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.464,"5min":1.855,"15min":1.855},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4330000000000001,"5min":2.218,"15min":2.218},"last":1.365}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.169,"15min":1.1870000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4019999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.284},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.2250000000000001,"15min":1.252},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4079999999999999,"5min":1.718,"15min":1.718},"last":1.454}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2050000000000001,"15min":1.2270000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.51,"5min":1.929,"15min":1.929},"last":1.149},{"interface":"front","average":{"1min":1.093,"5min":1.2010000000000001,"15min":1.2190000000000001},"min":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5569999999999999,"5min":1.593,"15min":1.593},"last":1.516}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.292},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4219999999999999,"5min":1.78,"15min":1.78},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.298,"15min":1.3340000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.542,"5min":1.786,"15min":1.786},"last":1.4810000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2589999999999999,"15min":1.274},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4930000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.429},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3480000000000001,"15min":1.3660000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5169999999999999,"5min":2.625,"15min":2.625},"last":1.2430000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.3400000000000001,"15min":1.369},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4930000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.3819999999999999,"15min":1.405},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.573,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":1.5640000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.528,"15min":1.5640000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5129999999999999,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":1.325},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.599,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.643}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.083,"15min":1.089},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.145,"15min":1.159},"min":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2709999999999999,"15min":1.302},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1679999999999999,"15min":1.175},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5369999999999999,"5min":1.825,"15min":1.825},"last":1.306}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2789999999999999,"15min":1.2989999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5900000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.206},{"interface":"front","average":{"1min":1.198,"5min":1.2549999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.266,"15min":1.282},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7130000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.262},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.446,"15min":1.464},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.5940000000000001,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.5089999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.363,"15min":1.377},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.748,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.113},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3600000000000001,"15min":1.3799999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.778,"5min":2.274,"15min":2.274},"last":1.379}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4419999999999999,"15min":1.454},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9690000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4059999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4350000000000001,"15min":1.4590000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9199999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.474},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5009999999999999,"15min":1.5149999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7849999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.573}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":1.02,"15min":1.056},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2729999999999999,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.468,"15min":1.468},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90500000000000003,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.99199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1930000000000001,"5min":1.554,"15min":1.554},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.222,"15min":1.252},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5680000000000001,"5min":1.708,"15min":1.708},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.246,"15min":1.2669999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5580000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.4379999999999999,"15min":1.476},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.7390000000000001,"5min":2.972,"15min":2.972},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.383,"15min":1.4159999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6659999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4630000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.278,"15min":1.304},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.4950000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.454,"15min":1.4930000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.823,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.5469999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.3819999999999999,"15min":1.4199999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4910000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.403},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.341,"15min":1.3660000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6850000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.575}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31640,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93000000000000005,"15min":0.93799999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.27,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.98299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":0.84399999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.85599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4610000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.331,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.512,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5740000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.151}]},{"osd":4,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.337,"15min":1.359},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4550000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5069999999999999,"5min":3.077,"15min":3.077},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.389,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.673,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.28},{"interface":"front","average":{"1min":1.367,"5min":1.4630000000000001,"15min":1.4790000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6000000000000001,"5min":2.387,"15min":2.387},"last":1.3360000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3240000000000001,"15min":1.3420000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.504,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.371,"15min":1.391},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5840000000000001,"5min":2.298,"15min":2.298},"last":1.1950000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.425,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.502,"15min":1.524},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.7170000000000001,"5min":2.254,"15min":2.254},"last":1.4179999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":233328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1859999999999999,"5min":1.345,"15min":1.345},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3160000000000001,"5min":1.474,"15min":1.474},"last":1.03}]},{"osd":2,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.153,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.872},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.026,"15min":1.0409999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.377,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.93999999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.70399999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.405,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.081},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0620000000000001,"15min":1.0800000000000001},"min":{"1min":0.58799999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.395,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.153}]},{"osd":4,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.373,"15min":1.403},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.5069999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.3160000000000001,"15min":1.343},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5980000000000001,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":1.3220000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.522,"5min":2.04,"15min":2.04},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4199999999999999,"15min":1.444},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.506,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.272}]},{"osd":6,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.5580000000000001,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.381},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.375,"15min":1.4059999999999999},"min":{"1min":0.93500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5780000000000001,"5min":3.452,"15min":3.452},"last":1.1160000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:26:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.458,"15min":1.486},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.7310000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.357},{"interface":"front","average":{"1min":1.202,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.90000000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8620000000000001,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.2270000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1126400,"data_stored":823696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0740000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1220000000000001,"5min":1.53,"15min":1.53},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92000000000000004,"15min":0.92300000000000004},"min":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.873},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1639999999999999,"15min":1.181},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.2330000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2450000000000001,"15min":1.2529999999999999},"min":{"1min":0.92300000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.52,"5min":1.702,"15min":1.702},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2,"15min":1.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4590000000000001,"5min":1.946,"15min":1.946},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.341,"15min":1.351},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7230000000000001,"5min":2.093,"15min":2.093},"last":1.284},{"interface":"front","average":{"1min":1.302,"5min":1.403,"15min":1.4199999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.776,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.3720000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3839999999999999,"15min":1.395},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.75,"5min":1.857,"15min":1.857},"last":1.458},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.679,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1259999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:26:10 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.395,"15min":1.4119999999999999},"min":{"1min":0.83199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.514,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.21},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8380000000000001,"5min":2.177,"15min":2.177},"last":1.4119999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:26:45.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T17:26:45.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 Processor -- start 2024-09-13T17:26:45.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 -- start start 2024-09-13T17:26:45.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f333c15cc00 0x7f333c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f333c06fe10 0x7f333c0adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0cd160 con 0x7f333c0b2b70 2024-09-13T17:26:45.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0ae100 con 0x7f333c06fe10 2024-09-13T17:26:45.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f3341c00700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0aceb0 con 0x7f333c15cc00 2024-09-13T17:26:45.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f333b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f333c06fe10 0x7f333c0adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f333b400700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f333c06fe10 0x7f333c0adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55976/0 (socket says 172.21.15.139:55976) 2024-09-13T17:26:45.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f333b400700 1 -- 172.21.15.139:0/493901532 learned_addr learned my addr 172.21.15.139:0/493901532 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:45.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.617+0000 7f333be00700 1 --2- 172.21.15.139:0/493901532 >> v2:172.21.15.176:3300/0 conn(0x7f333c15cc00 0x7f333c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333b400700 1 -- 172.21.15.139:0/493901532 >> v2:172.21.15.176:3300/0 conn(0x7f333c15cc00 msgr2=0x7f333c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:26:45.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333b400700 1 --2- 172.21.15.139:0/493901532 >> v2:172.21.15.176:3300/0 conn(0x7f333c15cc00 0x7f333c0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333b400700 1 -- 172.21.15.139:0/493901532 >> v1:172.21.15.176:6789/0 conn(0x7f333c0b2b70 legacy=0x7f333c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333b400700 1 -- 172.21.15.139:0/493901532 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0ad190 con 0x7f333c06fe10 2024-09-13T17:26:45.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333b400700 1 --2- 172.21.15.139:0/493901532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c06fe10 0x7f333c0adbc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f333c06fa70 tx=0x7f3328009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e205f5d2e2878053 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:45.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333aa00700 1 -- 172.21.15.139:0/493901532 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328011830 con 0x7f333c06fe10 2024-09-13T17:26:45.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333aa00700 1 -- 172.21.15.139:0/493901532 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3328011990 con 0x7f333c06fe10 2024-09-13T17:26:45.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f333aa00700 1 -- 172.21.15.139:0/493901532 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328011d20 con 0x7f333c06fe10 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 -- 172.21.15.139:0/493901532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c06fe10 msgr2=0x7f333c0adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 --2- 172.21.15.139:0/493901532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c06fe10 0x7f333c0adbc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f333c06fa70 tx=0x7f3328009bf0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 -- 172.21.15.139:0/493901532 shutdown_connections 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 --2- 172.21.15.139:0/493901532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c06fe10 0x7f333c0adbc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 --2- 172.21.15.139:0/493901532 >> v2:172.21.15.176:3300/0 conn(0x7f333c15cc00 0x7f333c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 -- 172.21.15.139:0/493901532 >> 172.21.15.139:0/493901532 conn(0x7f333c0ce9d0 msgr2=0x7f333c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 -- 172.21.15.139:0/493901532 shutdown_connections 2024-09-13T17:26:45.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.621+0000 7f3341c00700 1 -- 172.21.15.139:0/493901532 wait complete. 2024-09-13T17:26:45.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.625+0000 7f3341c00700 1 Processor -- start 2024-09-13T17:26:45.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.625+0000 7f3341c00700 1 -- start start 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f333c06fe10 0x7f333c1f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f333c0b2b70 0x7f333c1f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 0x7f333c06b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0c39d0 con 0x7f333c15cc00 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0c3c20 con 0x7f333c0b2b70 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0c3f00 con 0x7f333c06fe10 2024-09-13T17:26:45.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 0x7f333c06b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 0x7f333c06b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55990/0 (socket says 172.21.15.139:55990) 2024-09-13T17:26:45.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 -- 172.21.15.139:0/851716340 learned_addr learned my addr 172.21.15.139:0/851716340 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:45.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f333b400700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f333c0b2b70 0x7f333c1f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f333be00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f333c06fe10 0x7f333c1f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 -- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f333c06fe10 msgr2=0x7f333c1f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f333c06fe10 0x7f333c1f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 -- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f333c0b2b70 msgr2=0x7f333c1f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f333c0b2b70 0x7f333c1f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 -- 172.21.15.139:0/851716340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009570 con 0x7f333c15cc00 2024-09-13T17:26:45.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341200700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 0x7f333c06b340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f333400cc50 tx=0x7f333400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:45.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334003c20 con 0x7f333c15cc00 2024-09-13T17:26:45.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334003d80 con 0x7f333c15cc00 2024-09-13T17:26:45.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400aab0 con 0x7f333c15cc00 2024-09-13T17:26:45.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c0c41e0 con 0x7f333c15cc00 2024-09-13T17:26:45.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.629+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c0c47a0 con 0x7f333c15cc00 2024-09-13T17:26:45.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.633+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c0adbc0 con 0x7f333c15cc00 2024-09-13T17:26:45.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.633+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f333400ac10 con 0x7f333c15cc00 2024-09-13T17:26:45.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.633+0000 7f3333e00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f331c066850 0x7f331c068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:45.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.633+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f33340843a0 con 0x7f333c15cc00 2024-09-13T17:26:45.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.637+0000 7f333be00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f331c066850 0x7f331c068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:45.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.637+0000 7f333be00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f331c066850 0x7f331c068d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f333c0cbbe0 tx=0x7f332c009240 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:45.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.641+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3334051520 con 0x7f333c15cc00 2024-09-13T17:26:45.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.817+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f333c0af010 con 0x7f333c15cc00 2024-09-13T17:26:45.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.829+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3334001cd0 con 0x7f333c15cc00 2024-09-13T17:26:45.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.829+0000 7f3333e00700 1 -- 172.21.15.139:0/851716340 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3334054b40 con 0x7f333c15cc00 2024-09-13T17:26:45.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.829+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f331c066850 msgr2=0x7f331c068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.829+0000 7f3341c00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f331c066850 0x7f331c068d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f333c0cbbe0 tx=0x7f332c009240 comp rx=0 tx=0).stop 2024-09-13T17:26:45.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.829+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 msgr2=0x7f333c06b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.829+0000 7f3341c00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 0x7f333c06b340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f333400cc50 tx=0x7f333400cf60 comp rx=0 tx=0).stop 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 shutdown_connections 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7f331c066850 0x7f331c068d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c15cc00 0x7f333c06b340 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f333c0b2b70 0x7f333c1f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 --2- 172.21.15.139:0/851716340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f333c06fe10 0x7f333c1f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 >> 172.21.15.139:0/851716340 conn(0x7f333c0ce9d0 msgr2=0x7f333c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 shutdown_connections 2024-09-13T17:26:45.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:45.833+0000 7f3341c00700 1 -- 172.21.15.139:0/851716340 wait complete. 2024-09-13T17:26:45.862 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:26:45.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:26:46.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.021+0000 7fb573e00700 1 Processor -- start 2024-09-13T17:26:46.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.021+0000 7fb573e00700 1 -- start start 2024-09-13T17:26:46.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.021+0000 7fb573e00700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5740b3280 0x7fb5740cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:46.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740cd8a0 con 0x7fb5740cd450 2024-09-13T17:26:46.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57414aab0 con 0x7fb57414a6d0 2024-09-13T17:26:46.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740cc3b0 con 0x7fb5740b3280 2024-09-13T17:26:46.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb572000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5740b3280 0x7fb5740cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:46.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573400700 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb5740cd450 0x7fb574161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44794/0 (socket says 172.21.15.139:44794) 2024-09-13T17:26:46.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb572000700 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb5740b3280 0x7fb5740cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56004/0 (socket says 172.21.15.139:56004) 2024-09-13T17:26:46.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573400700 1 -- 172.21.15.139:0/3782685613 learned_addr learned my addr 172.21.15.139:0/3782685613 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-13T17:26:46.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb572000700 1 -- 172.21.15.139:0/3782685613 >> v1:172.21.15.176:6789/0 conn(0x7fb57414a6d0 legacy=0x7fb5740b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb572000700 1 -- 172.21.15.139:0/3782685613 >> v1:172.21.15.139:6789/0 conn(0x7fb5740cd450 legacy=0x7fb574161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb572000700 1 -- 172.21.15.139:0/3782685613 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740cc690 con 0x7fb5740b3280 2024-09-13T17:26:46.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb571600700 1 -- 172.21.15.139:0/3782685613 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706794133 0 0) 0x7fb56c001490 con 0x7fb5740cd450 2024-09-13T17:26:46.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb572000700 1 --2- 172.21.15.139:0/3782685613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740b3280 0x7fb5740cbd40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb560009850 tx=0x7fb560009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433ce6849991bb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:46.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb571600700 1 -- 172.21.15.139:0/3782685613 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011830 con 0x7fb5740b3280 2024-09-13T17:26:46.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb571600700 1 -- 172.21.15.139:0/3782685613 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb560011990 con 0x7fb5740b3280 2024-09-13T17:26:46.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb571600700 1 -- 172.21.15.139:0/3782685613 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011d40 con 0x7fb5740b3280 2024-09-13T17:26:46.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- 172.21.15.139:0/3782685613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740b3280 msgr2=0x7fb5740cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 --2- 172.21.15.139:0/3782685613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740b3280 0x7fb5740cbd40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb560009850 tx=0x7fb560009b60 comp rx=0 tx=0).stop 2024-09-13T17:26:46.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- 172.21.15.139:0/3782685613 shutdown_connections 2024-09-13T17:26:46.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 --2- 172.21.15.139:0/3782685613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740b3280 0x7fb5740cbd40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- 172.21.15.139:0/3782685613 >> 172.21.15.139:0/3782685613 conn(0x7fb5740ce9d0 msgr2=0x7fb5740cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:46.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- 172.21.15.139:0/3782685613 shutdown_connections 2024-09-13T17:26:46.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.025+0000 7fb573e00700 1 -- 172.21.15.139:0/3782685613 wait complete. 2024-09-13T17:26:46.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 Processor -- start 2024-09-13T17:26:46.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 -- start start 2024-09-13T17:26:46.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5740b3280 0x7fb57406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:46.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 0x7fb57415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:46.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb57414a6d0 0x7fb57415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:46.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57406d350 con 0x7fb5740cd450 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb574159010 con 0x7fb57414a6d0 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573e00700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57415ae50 con 0x7fb5740b3280 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb572000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 0x7fb57415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb572000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 0x7fb57415a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56006/0 (socket says 172.21.15.139:56006) 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb572000700 1 -- 172.21.15.139:0/1755199703 learned_addr learned my addr 172.21.15.139:0/1755199703 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb573400700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb57414a6d0 0x7fb57415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:46.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.029+0000 7fb572a00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5740b3280 0x7fb57406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:46.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb572000700 1 -- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5740b3280 msgr2=0x7fb57406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb572000700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5740b3280 0x7fb57406bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb572000700 1 -- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb57414a6d0 msgr2=0x7fb57415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb572000700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb57414a6d0 0x7fb57415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb572000700 1 -- 172.21.15.139:0/1755199703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600094b0 con 0x7fb5740cd450 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb572000700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 0x7fb57415a3d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb5600090b0 tx=0x7fb560004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000ba70 con 0x7fb5740cd450 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb56001f070 con 0x7fb5740cd450 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57406c730 con 0x7fb5740cd450 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000be10 con 0x7fb5740cd450 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57406cf70 con 0x7fb5740cd450 2024-09-13T17:26:46.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.033+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57406d490 con 0x7fb5740cd450 2024-09-13T17:26:46.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.037+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb56001a430 con 0x7fb5740cd450 2024-09-13T17:26:46.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.037+0000 7fb56aa00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb554066850 0x7fb554068d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:26:46.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.037+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5908+0+0 (secure 0 0 0) 0x7fb560021070 con 0x7fb5740cd450 2024-09-13T17:26:46.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.037+0000 7fb572a00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb554066850 0x7fb554068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:26:46.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.037+0000 7fb572a00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb554066850 0x7fb554068d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb57406b710 tx=0x7fb564009040 comp rx=0 tx=0).ready entity=mgr.5613 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:26:46.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.041+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb57406d490 con 0x7fb5740cd450 2024-09-13T17:26:46.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.273+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb57406d490 con 0x7fb5740cd450 2024-09-13T17:26:46.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.273+0000 7fb56aa00700 1 -- 172.21.15.139:0/1755199703 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fb57406d490 con 0x7fb5740cd450 2024-09-13T17:26:46.279 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T17:26:46.279 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3190530157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3190530157},{"type":"v1","addr":"172.21.15.176:6835","nonce":3190530157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/1007068477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1007068477},{"type":"v1","addr":"172.21.15.139:6836","nonce":1007068477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2472926620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2472926620},{"type":"v1","addr":"172.21.15.139:6837","nonce":2472926620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1672966037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1672966037},{"type":"v1","addr":"172.21.15.176:6833","nonce":1672966037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb554066850 msgr2=0x7fb554068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb554066850 0x7fb554068d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb57406b710 tx=0x7fb564009040 comp rx=0 tx=0).stop 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 msgr2=0x7fb57415a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 0x7fb57415a3d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb5600090b0 tx=0x7fb560004770 comp rx=0 tx=0).stop 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 shutdown_connections 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:6832/650854402,v1:172.21.15.139:6833/650854402] conn(0x7fb554066850 0x7fb554068d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb57414a6d0 0x7fb57415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5740cd450 0x7fb57415a3d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 --2- 172.21.15.139:0/1755199703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5740b3280 0x7fb57406bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:26:46.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 >> 172.21.15.139:0/1755199703 conn(0x7fb5740ce9d0 msgr2=0x7fb574145750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:26:46.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 shutdown_connections 2024-09-13T17:26:46.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T17:26:46.277+0000 7fb573e00700 1 -- 172.21.15.139:0/1755199703 wait complete. 2024-09-13T17:26:46.284 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 18 2024-09-13T17:26:46.306 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T17:26:46.306 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T17:26:46.307 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:26:46.307 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:46.326 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:26:46.326 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:26:46.326 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:46.394 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:26:46.394 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:26:46.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:46.420 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:26:46.420 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:26:46.420 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:46.487 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:26:46.487 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T17:26:46.487 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T17:26:46.487 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:51.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T17:26:52.589 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T17:26:52.589 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T17:26:52.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:52.680 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T17:26:52.681 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T17:26:52.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:57.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-13T17:26:57.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T17:26:58.782 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T17:26:58.782 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T17:26:58.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:58.880 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T17:26:58.881 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T17:26:58.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:26:58.971 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T17:26:58.972 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T17:26:58.972 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:02.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T17:27:02.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-13T17:27:05.073 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T17:27:05.074 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T17:27:05.074 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:05.163 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T17:27:05.163 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T17:27:05.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:08.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T17:27:08.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T17:27:11.265 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T17:27:11.265 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T17:27:11.265 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T17:27:11.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:11.334 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T17:27:11.334 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T17:27:11.334 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:11.396 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T17:27:11.396 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T17:27:11.396 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T17:27:11.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:11.434 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T17:27:11.434 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T17:27:11.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:11.467 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T17:27:11.467 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T17:27:11.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:27:11.538 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T17:27:11.538 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T17:27:11.539 DEBUG:teuthology.orchestra.run.smithi139:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T17:27:11.590 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:27:11.590 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T17:27:11.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:27:11.886 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T17:27:12.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:27:12.075 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T17:27:12.323 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:27:12.324 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T17:27:12.559 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:27:12.559 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T17:27:12.716 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:27:12.722 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:27:12.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:27:12.824 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T17:27:13.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:27:13.033 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T17:27:13.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:27:13.204 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T17:27:13.406 INFO:tasks.ceph:Archiving mon data... 2024-09-13T17:27:13.409 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/data/mon.a.tgz 2024-09-13T17:27:13.409 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-13T17:27:13.427 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.4sWo8WdDw4 2024-09-13T17:27:13.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4sWo8WdDw4 2024-09-13T17:27:13.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T17:27:13.636 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.4sWo8WdDw4 2024-09-13T17:27:13.734 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.4sWo8WdDw4 is 718KB 2024-09-13T17:27:13.812 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.4sWo8WdDw4 2024-09-13T17:27:13.830 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/data/mon.b.tgz 2024-09-13T17:27:13.830 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-13T17:27:13.845 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.xXrjv6ETbQ 2024-09-13T17:27:13.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xXrjv6ETbQ 2024-09-13T17:27:14.103 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.xXrjv6ETbQ 2024-09-13T17:27:14.203 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.xXrjv6ETbQ is 1018KB 2024-09-13T17:27:14.281 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.xXrjv6ETbQ 2024-09-13T17:27:14.301 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/data/mon.c.tgz 2024-09-13T17:27:14.301 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-13T17:27:14.358 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.Pns2uXoUhc 2024-09-13T17:27:14.358 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Pns2uXoUhc 2024-09-13T17:27:14.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.Pns2uXoUhc 2024-09-13T17:27:14.711 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.Pns2uXoUhc is 1018KB 2024-09-13T17:27:14.797 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.Pns2uXoUhc 2024-09-13T17:27:14.813 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T17:27:14.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:27:14.817 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:27:14.886 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T17:27:14.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:27:14.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:27:14.941 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:27:14.983 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:27:14.997 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T17:27:14.999 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/remote/smithi139/crash 2024-09-13T17:27:14.999 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:27:15.033 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/remote/smithi176/crash 2024-09-13T17:27:15.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:27:15.070 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T17:27:15.070 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:27:15.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:27:15.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:27:15.218 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:27:15.251 INFO:tasks.ceph:Compressing logs... 2024-09-13T17:27:15.252 DEBUG:teuthology.orchestra.run.smithi139:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:15.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:18.799 INFO:tasks.ceph:Archiving logs... 2024-09-13T17:27:18.799 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/remote/smithi139/log 2024-09-13T17:27:18.800 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:27:19.410 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/remote/smithi176/log 2024-09-13T17:27:19.411 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:27:19.879 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:27:19.888 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:27:19.888 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:27:19.894 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:27:20.001 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:27:20.009 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:27:20.009 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:27:20.015 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:27:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:27:20.047 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-13T17:27:20.047 INFO:teuthology.orchestra.run.smithi139.stdout:*hv01.front.sepi 67.205.162.81 3 u 63 64 177 0.087 0.200 0.374 2024-09-13T17:27:20.047 INFO:teuthology.orchestra.run.smithi139.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 177 0.114 -0.906 0.309 2024-09-13T17:27:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi 74.6.168.72 3 u 56 64 177 0.094 0.966 0.303 2024-09-13T17:27:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:27:20.054 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:27:20.055 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-09-13T17:27:20.055 INFO:teuthology.orchestra.run.smithi176.stdout:+hv01.front.sepi 67.205.162.81 3 u 60 64 177 0.056 0.732 1.566 2024-09-13T17:27:20.055 INFO:teuthology.orchestra.run.smithi176.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 64 177 0.116 -0.448 1.541 2024-09-13T17:27:20.055 INFO:teuthology.orchestra.run.smithi176.stdout:*hv03.front.sepi 74.6.168.72 3 u 65 64 177 0.092 2.484 1.389 2024-09-13T17:27:20.055 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:27:20.057 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:27:20.066 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:27:20.066 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:27:20.093 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:27:20.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:27:20.124 INFO:teuthology.task.internal:Duration was 906.396133 seconds 2024-09-13T17:27:20.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:27:20.133 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:27:20.133 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:27:20.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:27:20.275 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:27:20.276 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T17:27:20.276 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:27:20.306 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-13T17:27:20.307 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:27:20.341 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:27:20.342 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:20.358 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:20.441 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:27:20.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:27:20.447 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:27:20.552 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:27:20.734 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:27:20.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:27:20.769 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:27:20.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:27:20.818 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:27:20.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:27:20.852 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-13T17:27:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-13T17:27:20.912 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:27:20.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:27:20.945 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:27:20.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:27:20.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:27:20.978 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:27:20.978 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/remote/smithi139 2024-09-13T17:27:20.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:27:21.033 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903883/remote/smithi176 2024-09-13T17:27:21.033 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:27:21.075 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:27:21.076 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:27:21.081 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:27:21.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:27:21.149 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:27:21.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:27:21.158 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:27:21.158 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:27:21.164 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:27:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: 1181009 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:27 /home/ubuntu/cephtest 2024-09-13T17:27:21.206 INFO:teuthology.orchestra.run.smithi176.stdout: 1181009 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:27 /home/ubuntu/cephtest 2024-09-13T17:27:21.212 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:27:21.223 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:27:21.310 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap_schedule_snapdir} duration: 906.3961327075958 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:27:21.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:27:21.405 INFO:teuthology.run:pass